-- Logs begin at Sat 2022-05-14 15:00:54 UTC, end at Sat 2022-05-14 16:11:28 UTC. -- May 14 15:31:49.114494 dv-cinder-839793-11-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 14 15:31:49.122859 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 14 15:31:49.124892 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 14 15:31:49 2022] *** May 14 15:31:49.124892 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 14 15:31:49.124892 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 14 15:31:49.124892 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: nodename: dv-cinder-839793-11-iscsi May 14 15:31:49.124892 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: machine: x86_64 May 14 15:31:49.124892 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: clock source: unix May 14 15:31:49.124892 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: pcre jit disabled May 14 15:31:49.124892 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: detected number of CPU cores: 4 May 14 15:31:49.124892 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: current working directory: / May 14 15:31:49.125460 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: detected binary path: /usr/bin/uwsgi-core May 14 15:31:49.125460 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: your processes number limit is 47680 May 14 15:31:49.125460 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: your memory page size is 4096 bytes May 14 15:31:49.125460 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: detected max file descriptor number: 2048 May 14 15:31:49.125460 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: lock engine: pthread robust mutexes May 14 15:31:49.125460 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: thunder lock: enabled May 14 15:31:49.125460 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 14 15:31:49.125460 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 14 15:31:49.172704 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: Python main interpreter initialized at 0x55a355bc09c0 May 14 15:31:49.172704 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: python threads support enabled May 14 15:31:49.172704 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: your server socket listen backlog is limited to 100 connections May 14 15:31:49.172704 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: your mercy for graceful operations on workers is 90 seconds May 14 15:31:49.173096 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: mapped 403077 bytes (393 KB) for 2 cores May 14 15:31:49.173171 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: *** Operational MODE: preforking *** May 14 15:31:49.173455 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: *** uWSGI is running in multiple interpreter mode *** May 14 15:31:49.173455 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: spawned uWSGI master process (pid: 86454) May 14 15:31:49.173663 dv-cinder-839793-11-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 14 15:31:49.174785 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: spawned uWSGI worker 1 (pid: 86463, cores: 1) May 14 15:31:49.174785 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: spawned uWSGI worker 2 (pid: 86464, cores: 1) May 14 15:31:49.174785 dv-cinder-839793-11-iscsi devstack@keystone.service[86454]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 14 15:31:54.922071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:31:54.922071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: from cryptography.utils import int_from_bytes May 14 15:31:54.923420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:31:54.923420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: from cryptography.utils import int_from_bytes May 14 15:31:54.927470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:31:54.927470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: from cryptography.utils import int_from_bytes May 14 15:31:54.928812 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 15:31:54.928812 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: from cryptography.utils import int_from_bytes May 14 15:31:54.972245 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 15:31:54.972496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 15:31:54.972653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] command line args: [] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 15:31:54.972899 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 15:31:54.973079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ================================================================================ {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 15:31:54.973333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] admin_token = **** {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.973579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] config_dir = [] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.973769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.973953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] config_source = [] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.974133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] debug = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.974345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.976860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.976860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.976860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.976860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.976860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] list_limit = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.976860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] log_config_append = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.976860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.976860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] log_dir = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.976860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] log_file = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.977305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.977305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.977305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.977468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 15:31:54.977468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 15:31:54.977576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.977576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.977686 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] command line args: [] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 15:31:54.977743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.978119 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 15:31:54.978348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.978536 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ================================================================================ {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 15:31:54.978730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.978954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] admin_token = **** {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.979662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.979827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] config_dir = [] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.980020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.980214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.980214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] config_source = [] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.980583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.980779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] debug = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.980971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.981164 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.981380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.981380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.981380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.981931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.981931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.982289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.982539 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.982701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] publish_errors = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.982898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.983090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.983245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] list_limit = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.983414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.983569 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] log_config_append = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.983698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.983866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.983866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] log_dir = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.984149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.984281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] log_file = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.984408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.984530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.984690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] standard_threads = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.984825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.984968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.985102 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.985227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.985227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.985467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.985593 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] use_journal = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.985723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.985857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] use_json = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.986011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.986141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] use_stderr = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.986269 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.986416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] use_syslog = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.986552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.986700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.986832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.986961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.987143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.987280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.987412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.987545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.987677 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.987807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.987937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.988069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.988200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.988324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.988466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.988627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.988627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.988627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.989022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.989022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] publish_errors = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.989263 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.989400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.989524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.989654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.989783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.989907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.990029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.990168 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.990293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.990451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.990574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.990707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] standard_threads = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.990832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.991091 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.991237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.991364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.991364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.991603 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.991809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] use_journal = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.991943 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.992068 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] use_json = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.992201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.992324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] use_stderr = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.992324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] use_syslog = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.992573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.992704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 15:31:54.992829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.992952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.993075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.993204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.993336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.993460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.993587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.993711 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.993845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.993968 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.994103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.994228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.994415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.994546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.994675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.994847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.995533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.995747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.995976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.996115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.996247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.996371 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.996514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.996640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.996764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.996887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.997012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.997136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.997266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.997401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.997533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.997658 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.997782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.997911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.998046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.998180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.998339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.998472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.998607 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.998732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.998932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.999066 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.999192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.999315 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.999444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.999575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.999708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.999840 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:54.999966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.000100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.000231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.000356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.000488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.000613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.000736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.000859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.000988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.001125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.001251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.001381 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.001511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.001676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.003246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.003469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.003635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.003826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.004016 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.004202 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.004391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.004391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.004763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.004950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.005144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.005334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.005521 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.005781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.005944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.006130 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.006347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.006508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.006693 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.006915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.007117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.007339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.007536 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.007698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.007885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.008080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.008237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.008405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.008563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.008691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.008815 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.008815 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.009093 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.009218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.009341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.009464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.009464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.009464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.009862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.009988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.010129 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.010255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.010255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.010564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.010718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.010854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.011036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.011167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.011291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.011416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.011540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.011677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.011804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.011929 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.012067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.012199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.012332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.012457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.012580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.012705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.012829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.012961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.013087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.013222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.013347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.013480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.013648 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.013817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.013947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.014083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.014209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.014378 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.014509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.014635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.014770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.014970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.015106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.015232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.015357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.015480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.015604 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.015746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.015879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.016010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.016137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.016266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.016391 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.016528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.016655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.016779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.016904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.017033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.017159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.017301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.017428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.017562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.017687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.017810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.017947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.018081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.018213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.018355 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.018486 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.018610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.018744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.018871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.019003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.019128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] auth.external = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.019128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.019373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.019373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.019607 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.019741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.019867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.019867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] auth.password = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.019867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] auth.token = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.020211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.020336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.020471 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.020597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.020721 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.020844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.020977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.021161 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.021300 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.021427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.021551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.021675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.021799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.021923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.022079 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.022215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] credential.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.022416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.022551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.022676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.022802 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.022935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.023060 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.023194 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.023321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.023446 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.023571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.023695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.023820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.023953 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.024079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.024212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] auth.external = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.024362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.024598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.024760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.024899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.025034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.025160 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.025285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.025410 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] auth.password = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.025542 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.025669 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] auth.token = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.025805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.025932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.026056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.026181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.026332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.026474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.026611 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] federation.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.026736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.026862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.026987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.027120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.027256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.027382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.027513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.027651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.027778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] credential.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.027911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.028046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.028303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.028462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.028592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.028718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.028852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.028978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.029104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.029228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.029353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.029478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.029611 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.029736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.029861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.029985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.030109 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.030243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.030484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.030616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.030742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.030867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.030992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.031117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.031251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.031377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.031502 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.031627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.031752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.031877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.032020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.032154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] federation.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.032281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.032406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.032531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.032657 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.032790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.032992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.033137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.033265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.033390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.033515 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.033649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.033776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.033910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.034035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.034160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.034291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.034452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.034581 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.034707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.034838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.034963 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.035088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.035221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.035348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.035472 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.035607 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.035734 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.035872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.036006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.036138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.036265 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.036390 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.036515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.036649 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.036777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.036901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.037032 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.037169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.037295 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.037295 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.037552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.037676 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.037676 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.037676 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.038022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.038022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.038267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.038441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.038568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.038692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.038816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.038816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.039074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.039206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.039332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.039457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.039580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.039713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.039839 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.039966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.040090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.040214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.040338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.040470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.040596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.040721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.040855 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.040981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.041111 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.041246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.041373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.041498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.041623 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.042261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.042412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.042550 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.042678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.042803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.042927 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.043053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.043194 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.043328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.043455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.043580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.043704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.043827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.043952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.044086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.044213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.044338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.044462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.044592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.044717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.044859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.044985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.045110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.045243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.045370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.045494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.045626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.045760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.045886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.046018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.046150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.046282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.046480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.046615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.046758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.046889 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.047027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.047162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.047303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.047436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.047567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.047698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.047828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.047966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.048106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.048239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.048372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.048513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.048645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.048776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.048915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.049048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.049179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.049310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.049444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.049575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.049714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.049847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.049979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.050110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.050242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.050406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.050552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.050685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.050816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.050947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.051077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.051217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.051350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.051483 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.051614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.051745 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.051877 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.052016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.052149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.052291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.052422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.052554 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.052685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.052823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.052956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.053087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.053218 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] resource.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.053348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.053478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.053619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.053751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.053882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.054023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.054155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.054285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.054461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.054597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.054729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.054861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.054992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.055124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.055263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.055396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.055396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.055645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.055777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] role.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.055777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] role.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.056113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.056248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.056248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.056504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.056636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.056768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.056908 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.057051 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.057190 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.057370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.058000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.058128 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.058262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.058423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.058551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.058677 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.058803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.058935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.059078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.059211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.059344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.059476 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.059608 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.059740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.059881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.060014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.060014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.060276 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.060407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] resource.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.060538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.060678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.060811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.060944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.061075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.061206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.061337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.061477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.061610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.061741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.061872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.062015 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.062147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.062287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.062470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.062603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.062734 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.062865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.063009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.063143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] role.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.063274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.063406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] role.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.063537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.063668 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.063818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.063953 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.064086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.064218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.064351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.064482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.064622 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.064754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.064892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.065026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.065166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.065299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.065439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.065583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.065715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] token.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.065847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.065985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.066119 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.066260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.066415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.066549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.066681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.066813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.066954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.067104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.067240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.067372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.067372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.067632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.067764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.067904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.068038 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.068169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.068308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.068444 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.068576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.068717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.068851 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.068983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.069115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.069256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.069389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.069529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.069662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.069794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.069925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.070056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.070188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.070385 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.070526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.connection = **** {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.070671 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.070813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.070946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.071077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.071219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.071360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.071493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.071631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.071764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.071895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.072026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.072166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.072298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.072430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.072561 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.072691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.072823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] token.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.073015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.073166 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.073300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.073300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.073551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.073682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.073821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.073954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.074086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.074218 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.074366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.074504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.074649 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.074783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.074925 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86464) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 15:31:55.075587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.075587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.076678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.connection = **** {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.076678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.076678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.076678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.076678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.076678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.076678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.076678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.076678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.077998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.077998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.077998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.077998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.077998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.077998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.077998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.077998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.077998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.079155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 15:31:55.079155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 15:31:55.091063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.091344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.091503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.094195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.094458 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.094693 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.100125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.103614 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.129731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.129971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.131806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.132046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.185429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.186723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.238877 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.239180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.241916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.242159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.304892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.305146 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.305309 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.305455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.305616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.305760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.305902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.306081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.306238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.306442 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.306587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.306725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.330216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.330453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.330615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.330759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.330897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.331035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.331173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.331324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.331474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.331615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.331752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.331891 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.332028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.332175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.343696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.343898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.358985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.359224 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.359384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.359527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.359665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.359805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.359943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.360090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.360230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.360369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.360507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.360645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86464) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.360796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.360796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86463) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 14 15:31:55.377930 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.378125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 14 15:31:55.378480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.378635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.378789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 14 15:31:55.378930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 14 15:31:55.379068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.379205 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.379342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.379492 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 14 15:31:55.379640 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.379782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.379920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.380056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.380056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.380332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.391645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.391842 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.391988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.392128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.392267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.392433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.392575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.392714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.400425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.400582 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.404235 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.404512 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.404659 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.404902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.405061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.405222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.405363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.405501 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.405639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.405776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.405915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.406104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.406252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.406421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.406561 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.406698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.406864 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.407007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.407145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.407283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.407421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.407421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.433981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.434976 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.435631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.435907 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.436615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.436894 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.441220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.441497 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.441776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.442218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.442524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.442807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.449213 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.449488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.450433 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.450714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.454084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.454388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.454666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.454941 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.455211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.455369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.455511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.455650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.455798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.455937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.456095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.456238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.456414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.456686 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.456952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.457219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.474978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.475250 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.476849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.477125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.480560 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.482358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.484158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.484448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.485969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.486261 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.489468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.491315 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.493025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.495000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.496786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.497080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.497360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.497641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.497916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.498192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.498827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.499126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.499409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.499691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.499963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.500239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.517107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.517477 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.517744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.518007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.519403 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.519780 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.520052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.520316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.525903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.528168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.528439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.529028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.530760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.531036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.531513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.531926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.532130 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.532413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.532698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.534105 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.534411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.534700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.534988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.535265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.546150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.546450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.546727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.547012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.547289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.547569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.547852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.548821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.549099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.549380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.549677 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.549958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.550242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.550546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.565857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.568664 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.569135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.571977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.572455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.574694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.576101 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.576308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.576586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.576939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.577697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.579364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.579645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.579943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.584371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.585922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.587460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.589108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.589477 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.589763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.590044 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.590348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.592360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.592649 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.592932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.593207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.601598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.601832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.602119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.602725 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.603012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.603289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.611177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86464) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.611457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.611737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.611973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86463) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 14 15:31:55.612122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.612261 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.612400 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.612539 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.612693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.612835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.612973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.613112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.613249 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.613396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.613575 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.613727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.613918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.614069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.614210 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.614389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.614536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.614676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.614826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.614968 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.615106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86464) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.615257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.615257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.615521 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86463) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 14 15:31:55.654805 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a355bc09c0 pid: 86463 (default app) May 14 15:31:55.655455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a355bc09c0 pid: 86464 (default app) May 14 15:31:55.658163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79c23c-08a8-46c7-8a22-b98cb9391e92 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:31:55.658486 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79c23c-08a8-46c7-8a22-b98cb9391e92 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:31:55.658778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79c23c-08a8-46c7-8a22-b98cb9391e92 None None] PATH_INFO: `/v3` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:31:55.663026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Sat May 14 15:31:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:03.818457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aa351-1fbd-4a80-ac66-01e75c5638d1 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:03.819017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aa351-1fbd-4a80-ac66-01e75c5638d1 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:03.819017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40aa351-1fbd-4a80-ac66-01e75c5638d1 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:03.823905 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:03.829533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b8469-9b93-4ba1-9b5b-db9ecc0a8153 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:03.829996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b8469-9b93-4ba1-9b5b-db9ecc0a8153 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:03.830076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b8469-9b93-4ba1-9b5b-db9ecc0a8153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:03.873721 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG oslo_db.sqlalchemy.engines [None req-2d4b8469-9b93-4ba1-9b5b-db9ecc0a8153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:32:04.100599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG passlib.handlers.bcrypt [None req-2d4b8469-9b93-4ba1-9b5b-db9ecc0a8153 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86463) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 14 15:32:04.100934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG passlib.handlers.bcrypt [None req-2d4b8469-9b93-4ba1-9b5b-db9ecc0a8153 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86463) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 14 15:32:04.161739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-2d4b8469-9b93-4ba1-9b5b-db9ecc0a8153 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:04.163377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2d4b8469-9b93-4ba1-9b5b-db9ecc0a8153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:04.314108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 14 15:32:04.415019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40aa351-1fbd-4a80-ac66-01e75c5638d1 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:04.449839 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG oslo_db.sqlalchemy.engines [None req-e40aa351-1fbd-4a80-ac66-01e75c5638d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86464) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 15:32:04.598207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40aa351-1fbd-4a80-ac66-01e75c5638d1 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:04.603901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05feaa3-b9e1-41d6-93b9-4975813ebc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:04.605569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05feaa3-b9e1-41d6-93b9-4975813ebc79 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:04.606091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05feaa3-b9e1-41d6-93b9-4975813ebc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:04.606572 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05feaa3-b9e1-41d6-93b9-4975813ebc79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:04.615845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05feaa3-b9e1-41d6-93b9-4975813ebc79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:04.673331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a05feaa3-b9e1-41d6-93b9-4975813ebc79 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 14 15:32:04.673581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05feaa3-b9e1-41d6-93b9-4975813ebc79 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:04.685284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Sat May 14 15:32:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 15:32:04.691595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b8469-9b93-4ba1-9b5b-db9ecc0a8153 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:04.707623 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b8469-9b93-4ba1-9b5b-db9ecc0a8153 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:04.712634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fae649-8b1d-4dcf-9315-6d09f20809e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:04.713938 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae649-8b1d-4dcf-9315-6d09f20809e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:04.714227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae649-8b1d-4dcf-9315-6d09f20809e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:04.714529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae649-8b1d-4dcf-9315-6d09f20809e9 admin admin] PATH_INFO: `/v3/projects/562024bfc95645e098dcd57dfe3300a0` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:04.716316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fae649-8b1d-4dcf-9315-6d09f20809e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=562024bfc95645e098dcd57dfe3300a0)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:04.771871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e6fae649-8b1d-4dcf-9315-6d09f20809e9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 14 15:32:04.772208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fae649-8b1d-4dcf-9315-6d09f20809e9 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:04.776996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Sat May 14 15:32:04 2022] GET /identity/v3/projects/562024bfc95645e098dcd57dfe3300a0 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:06.975761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577dc2-5817-400d-9f0b-9712541641a4 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:06.976559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577dc2-5817-400d-9f0b-9712541641a4 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:06.976559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59577dc2-5817-400d-9f0b-9712541641a4 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:06.981345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:06.986891 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731445c-39d7-4e76-8ca8-48b3aa763c87 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:06.987270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731445c-39d7-4e76-8ca8-48b3aa763c87 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:06.987444 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731445c-39d7-4e76-8ca8-48b3aa763c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:07.007640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c731445c-39d7-4e76-8ca8-48b3aa763c87 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:07.009139 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c731445c-39d7-4e76-8ca8-48b3aa763c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:07.017411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 14 15:32:07.039612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59577dc2-5817-400d-9f0b-9712541641a4 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:07.052043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59577dc2-5817-400d-9f0b-9712541641a4 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:07.056212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad245eb-d3bc-4d18-bf84-39087bb75ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:07.056840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad245eb-d3bc-4d18-bf84-39087bb75ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:07.057697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad245eb-d3bc-4d18-bf84-39087bb75ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:07.057977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad245eb-d3bc-4d18-bf84-39087bb75ea6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:07.065422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad245eb-d3bc-4d18-bf84-39087bb75ea6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:07.067229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad245eb-d3bc-4d18-bf84-39087bb75ea6 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:07.075822 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Sat May 14 15:32:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:32:07.080951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731445c-39d7-4e76-8ca8-48b3aa763c87 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:07.089682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731445c-39d7-4e76-8ca8-48b3aa763c87 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:07.093897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f30b9d-4fe0-48e4-8588-ff92f93d563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:07.094784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30b9d-4fe0-48e4-8588-ff92f93d563b admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:07.095066 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30b9d-4fe0-48e4-8588-ff92f93d563b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:07.095338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30b9d-4fe0-48e4-8588-ff92f93d563b admin admin] PATH_INFO: `/v3/users/a7162b13b2c54f8cadf583b1df8219b5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:07.096728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f30b9d-4fe0-48e4-8588-ff92f93d563b admin admin] RBAC: Authorizing `identity:get_user(user_id=a7162b13b2c54f8cadf583b1df8219b5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:07.098560 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f30b9d-4fe0-48e4-8588-ff92f93d563b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:07.100092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Sat May 14 15:32:07 2022] GET /identity/v3/users/a7162b13b2c54f8cadf583b1df8219b5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:09.393138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694e47a-e8ed-4eee-b3be-ecdfd643d6ad None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:09.393657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694e47a-e8ed-4eee-b3be-ecdfd643d6ad None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:09.393770 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1694e47a-e8ed-4eee-b3be-ecdfd643d6ad None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:09.393967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b16e-e704-472e-a659-d6f3a77f1f46 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:09.394377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b16e-e704-472e-a659-d6f3a77f1f46 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:09.394575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6b16e-e704-472e-a659-d6f3a77f1f46 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:09.395061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:09.395915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:32:09.399790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae01d-99d8-4daf-ade8-c01f27e0da56 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:09.400073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae01d-99d8-4daf-ade8-c01f27e0da56 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:09.400345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae01d-99d8-4daf-ade8-c01f27e0da56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:09.401040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b44203-4d2f-4ac3-8fb1-5129158d24cf None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:09.401568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b44203-4d2f-4ac3-8fb1-5129158d24cf None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:09.401828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b44203-4d2f-4ac3-8fb1-5129158d24cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:09.441792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG passlib.handlers.bcrypt [None req-b16ae01d-99d8-4daf-ade8-c01f27e0da56 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86464) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 14 15:32:09.442201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG passlib.handlers.bcrypt [None req-b16ae01d-99d8-4daf-ade8-c01f27e0da56 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86464) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 14 15:32:09.490553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b16ae01d-99d8-4daf-ade8-c01f27e0da56 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:09.492167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b16ae01d-99d8-4daf-ade8-c01f27e0da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:09.527915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c2b44203-4d2f-4ac3-8fb1-5129158d24cf None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:09.529114 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c2b44203-4d2f-4ac3-8fb1-5129158d24cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:09.603571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:09.605260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:09.626017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ae01d-99d8-4daf-ade8-c01f27e0da56 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:09.628711 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b44203-4d2f-4ac3-8fb1-5129158d24cf None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:09.721369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ae01d-99d8-4daf-ade8-c01f27e0da56 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:09.723040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b44203-4d2f-4ac3-8fb1-5129158d24cf None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:09.753656 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e272b-6c00-4651-962c-9d4cb6e56b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:09.754573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e272b-6c00-4651-962c-9d4cb6e56b27 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:09.754863 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e272b-6c00-4651-962c-9d4cb6e56b27 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:09.755137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e272b-6c00-4651-962c-9d4cb6e56b27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:09.755863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6a1c-4564-485b-a7bc-a8d263eb330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:09.756658 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6a1c-4564-485b-a7bc-a8d263eb330b None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:09.756942 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6a1c-4564-485b-a7bc-a8d263eb330b None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:09.757217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc6a1c-4564-485b-a7bc-a8d263eb330b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:09.768958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc6a1c-4564-485b-a7bc-a8d263eb330b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-e3bc6a1c-4564-485b-a7bc-a8d263eb330b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:09.780195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:09.781237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:09.782273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 8/14] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:32:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:32:09.787203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6a1c-4564-485b-a7bc-a8d263eb330b None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:09.821847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e272b-6c00-4651-962c-9d4cb6e56b27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:09.823844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e272b-6c00-4651-962c-9d4cb6e56b27 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:09.883175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc6a1c-4564-485b-a7bc-a8d263eb330b None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:09.914697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12f7d-88d1-4aa5-bbf4-f7dfce2db9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:09.915362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12f7d-88d1-4aa5-bbf4-f7dfce2db9be None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:09.915643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12f7d-88d1-4aa5-bbf4-f7dfce2db9be None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:09.915916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d12f7d-88d1-4aa5-bbf4-f7dfce2db9be None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:09.917360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d12f7d-88d1-4aa5-bbf4-f7dfce2db9be None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:09.917665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d12f7d-88d1-4aa5-bbf4-f7dfce2db9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:09.919118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d12f7d-88d1-4aa5-bbf4-f7dfce2db9be None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:09.921071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 7/15] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:09.926643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e272b-6c00-4651-962c-9d4cb6e56b27 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:09.930735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 9/16] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:09.936848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12f7d-88d1-4aa5-bbf4-f7dfce2db9be None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:10.040702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d12f7d-88d1-4aa5-bbf4-f7dfce2db9be None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:10.073753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd165e-f133-4044-a1f5-756e6e0a1980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:10.074650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd165e-f133-4044-a1f5-756e6e0a1980 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:10.074932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd165e-f133-4044-a1f5-756e6e0a1980 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:10.075208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd165e-f133-4044-a1f5-756e6e0a1980 None admin] PATH_INFO: `/v3/users/a7162b13b2c54f8cadf583b1df8219b5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:10.076412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd165e-f133-4044-a1f5-756e6e0a1980 None admin] RBAC: Authorizing `identity:get_user(user_id=a7162b13b2c54f8cadf583b1df8219b5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:10.077868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd165e-f133-4044-a1f5-756e6e0a1980 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:10.079520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 10/17] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:09 2022] GET /identity/v3/users/a7162b13b2c54f8cadf583b1df8219b5 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:10.084968 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd165e-f133-4044-a1f5-756e6e0a1980 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:10.128915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e272b-6c00-4651-962c-9d4cb6e56b27 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:10.160748 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d52bb-8537-4d3c-9368-bca037fdf4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:10.161531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d52bb-8537-4d3c-9368-bca037fdf4f2 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:10.161812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d52bb-8537-4d3c-9368-bca037fdf4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:10.162086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d52bb-8537-4d3c-9368-bca037fdf4f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:10.179290 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd165e-f133-4044-a1f5-756e6e0a1980 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:10.180422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d52bb-8537-4d3c-9368-bca037fdf4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:10.181893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d52bb-8537-4d3c-9368-bca037fdf4f2 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-cf8d52bb-8537-4d3c-9368-bca037fdf4f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:32:10.201651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:10.202657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:10.203459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:32:10.203459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:32:10.203459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:32:10.203459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:10.203459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 8/18] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:32:10.208665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d52bb-8537-4d3c-9368-bca037fdf4f2 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:10.210929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99660e1-77da-4ea4-95e0-d62b2b3450c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:10.211726 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99660e1-77da-4ea4-95e0-d62b2b3450c4 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:10.212011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99660e1-77da-4ea4-95e0-d62b2b3450c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:10.212294 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99660e1-77da-4ea4-95e0-d62b2b3450c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:10.214126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99660e1-77da-4ea4-95e0-d62b2b3450c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:10.215612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99660e1-77da-4ea4-95e0-d62b2b3450c4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:10.217213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 11/19] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:10.222726 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99660e1-77da-4ea4-95e0-d62b2b3450c4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:10.302925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d52bb-8537-4d3c-9368-bca037fdf4f2 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:10.315840 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99660e1-77da-4ea4-95e0-d62b2b3450c4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:10.335468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a530c6-9ada-44bc-b922-e5ae2a9f43d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:10.336127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a530c6-9ada-44bc-b922-e5ae2a9f43d8 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:10.336413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a530c6-9ada-44bc-b922-e5ae2a9f43d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:10.336690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a530c6-9ada-44bc-b922-e5ae2a9f43d8 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:10.337421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a530c6-9ada-44bc-b922-e5ae2a9f43d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:10.337726 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a530c6-9ada-44bc-b922-e5ae2a9f43d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:10.339216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a530c6-9ada-44bc-b922-e5ae2a9f43d8 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:10.347799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57447209-30a4-40ac-914e-ec375b56f47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:10.348441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57447209-30a4-40ac-914e-ec375b56f47d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:10.348724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57447209-30a4-40ac-914e-ec375b56f47d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:10.348998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57447209-30a4-40ac-914e-ec375b56f47d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:10.349841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57447209-30a4-40ac-914e-ec375b56f47d None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.domain.id=default, user.id=a7162b13b2c54f8cadf583b1df8219b5) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:10.350146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57447209-30a4-40ac-914e-ec375b56f47d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:10.351840 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57447209-30a4-40ac-914e-ec375b56f47d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:10.356209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 9/20] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:10.358500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 12/21] 10.222.0.61 () {56 vars in 1322 bytes} [Sat May 14 15:32:10 2022] GET /identity/v3/role_assignments?user.id=a7162b13b2c54f8cadf583b1df8219b5&scope.domain.id=default&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:13.488692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262707d-b87c-450b-8e09-8aaf56b26e2d None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:13.489235 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262707d-b87c-450b-8e09-8aaf56b26e2d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:13.489235 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262707d-b87c-450b-8e09-8aaf56b26e2d None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:13.490722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 10/22] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:13.498017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e439-e745-4b59-b1bb-8eb4b0e6676b None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:13.499015 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e439-e745-4b59-b1bb-8eb4b0e6676b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:13.499506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363e439-e745-4b59-b1bb-8eb4b0e6676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:13.535598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-8363e439-e745-4b59-b1bb-8eb4b0e6676b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:13.537228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8363e439-e745-4b59-b1bb-8eb4b0e6676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:13.641356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 13/23] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:13.686232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262707d-b87c-450b-8e09-8aaf56b26e2d None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:13.715505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6192877-7e68-42d8-b627-a00200f00d81 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:13.716890 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6192877-7e68-42d8-b627-a00200f00d81 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:13.717384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6192877-7e68-42d8-b627-a00200f00d81 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:13.719009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 14/24] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:13.725828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102c2e0-68f1-4428-85be-51bad71a1150 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:13.726392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102c2e0-68f1-4428-85be-51bad71a1150 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:13.727119 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102c2e0-68f1-4428-85be-51bad71a1150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:13.763560 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-f102c2e0-68f1-4428-85be-51bad71a1150 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:13.765090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f102c2e0-68f1-4428-85be-51bad71a1150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:13.864301 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 15/25] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:13.865898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fd88-48ff-48ef-af7f-723ac622052e None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:13.866373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fd88-48ff-48ef-af7f-723ac622052e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:13.866800 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4fd88-48ff-48ef-af7f-723ac622052e None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:13.868269 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 16/26] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:13.869504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d70c-bf02-4120-a56b-51a201cb1ee0 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:13.869920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d70c-bf02-4120-a56b-51a201cb1ee0 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:13.870340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5d70c-bf02-4120-a56b-51a201cb1ee0 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:13.878474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 17/27] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:13.879704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd6c4-150c-438e-90db-e0a4d7f40a3c None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:13.879996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd6c4-150c-438e-90db-e0a4d7f40a3c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:13.880297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebd6c4-150c-438e-90db-e0a4d7f40a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:13.886751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262707d-b87c-450b-8e09-8aaf56b26e2d None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:13.917852 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-11ebd6c4-150c-438e-90db-e0a4d7f40a3c None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:13.919345 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-11ebd6c4-150c-438e-90db-e0a4d7f40a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:13.924732 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a26c0-c795-4b33-8870-f59c2507ebc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:13.925540 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a26c0-c795-4b33-8870-f59c2507ebc9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:13.925821 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a26c0-c795-4b33-8870-f59c2507ebc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:13.926093 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a26c0-c795-4b33-8870-f59c2507ebc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:13.940970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a26c0-c795-4b33-8870-f59c2507ebc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-4f4a26c0-c795-4b33-8870-f59c2507ebc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:13.949952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:13.950906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:13.951645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:13.958483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 11/28] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:32:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:13.960057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e877f6f-89ad-4724-9490-f3d1247993c7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:13.960351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e877f6f-89ad-4724-9490-f3d1247993c7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:13.960629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e877f6f-89ad-4724-9490-f3d1247993c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:13.987910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-3e877f6f-89ad-4724-9490-f3d1247993c7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:13.989316 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-3e877f6f-89ad-4724-9490-f3d1247993c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:14.006457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 18/29] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:14.007590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebd6c4-150c-438e-90db-e0a4d7f40a3c None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:14.133721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 12/30] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:14.142403 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e877f6f-89ad-4724-9490-f3d1247993c7 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:14.194355 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebd6c4-150c-438e-90db-e0a4d7f40a3c None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:14.249369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e3f67-8e5b-46a0-8872-4219693602c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:14.250430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e3f67-8e5b-46a0-8872-4219693602c7 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:14.253905 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e3f67-8e5b-46a0-8872-4219693602c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:14.254440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e3f67-8e5b-46a0-8872-4219693602c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:14.256937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e3f67-8e5b-46a0-8872-4219693602c7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:14.258625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e3f67-8e5b-46a0-8872-4219693602c7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:14.313935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e877f6f-89ad-4724-9490-f3d1247993c7 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:14.352511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44257dd-f624-4cf2-9707-7fb67907ba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:14.353521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44257dd-f624-4cf2-9707-7fb67907ba20 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:14.354559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44257dd-f624-4cf2-9707-7fb67907ba20 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:14.355135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44257dd-f624-4cf2-9707-7fb67907ba20 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:14.356108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44257dd-f624-4cf2-9707-7fb67907ba20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:14.356613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44257dd-f624-4cf2-9707-7fb67907ba20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:14.358233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44257dd-f624-4cf2-9707-7fb67907ba20 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:14.376184 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 13/31] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:14.377373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44257dd-f624-4cf2-9707-7fb67907ba20 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:14.441417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 19/32] 10.222.0.61 () {60 vars in 1131 bytes} [Sat May 14 15:32:14 2022] POST /identity/v3/roles => generated 225 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:14.444261 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e3f67-8e5b-46a0-8872-4219693602c7 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:14.505135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44257dd-f624-4cf2-9707-7fb67907ba20 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:14.564173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e3481-d11f-4f50-a4da-0d039abd0ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:14.564173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e3481-d11f-4f50-a4da-0d039abd0ca1 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:14.564173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e3481-d11f-4f50-a4da-0d039abd0ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:14.564173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e3481-d11f-4f50-a4da-0d039abd0ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:14.583669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e3481-d11f-4f50-a4da-0d039abd0ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:14.587174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e3481-d11f-4f50-a4da-0d039abd0ca1 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-fc8e3481-d11f-4f50-a4da-0d039abd0ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:32:14.623789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:14.624646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:14.625431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:32:14.625431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:32:14.625431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:32:14.625431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:14.625431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 14/33] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:14.630332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e3f67-8e5b-46a0-8872-4219693602c7 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:14.638335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e3481-d11f-4f50-a4da-0d039abd0ca1 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:14.708024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9e8dd-780b-4c27-a492-45d2be0998b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:14.709503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e8dd-780b-4c27-a492-45d2be0998b6 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:14.710101 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e8dd-780b-4c27-a492-45d2be0998b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:14.711673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9e8dd-780b-4c27-a492-45d2be0998b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:14.712534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9e8dd-780b-4c27-a492-45d2be0998b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:14.715243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9e8dd-780b-4c27-a492-45d2be0998b6 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:14.745823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 20/34] 10.222.0.61 () {60 vars in 1131 bytes} [Sat May 14 15:32:14 2022] POST /identity/v3/roles => generated 219 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:14.747341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9e8dd-780b-4c27-a492-45d2be0998b6 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:14.812113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e3481-d11f-4f50-a4da-0d039abd0ca1 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:14.864661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc251c14-ee34-413a-99f2-8ca5abc74f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:14.865573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc251c14-ee34-413a-99f2-8ca5abc74f52 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:14.865845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc251c14-ee34-413a-99f2-8ca5abc74f52 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:14.866123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc251c14-ee34-413a-99f2-8ca5abc74f52 None admin] PATH_INFO: `/v3/users/a7162b13b2c54f8cadf583b1df8219b5` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:14.870634 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc251c14-ee34-413a-99f2-8ca5abc74f52 None admin] RBAC: Authorizing `identity:get_user(user_id=a7162b13b2c54f8cadf583b1df8219b5)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:14.872647 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc251c14-ee34-413a-99f2-8ca5abc74f52 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:14.878881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 15/35] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:14 2022] GET /identity/v3/users/a7162b13b2c54f8cadf583b1df8219b5 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:14.878881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dc03e-c17c-4718-9a4c-dd30f79dbe20 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:14.878881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dc03e-c17c-4718-9a4c-dd30f79dbe20 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:14.878881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dc03e-c17c-4718-9a4c-dd30f79dbe20 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:14.879792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 16/36] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:14.881108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f7005-87bd-4004-9843-cbd093010aec None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:14.881258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f7005-87bd-4004-9843-cbd093010aec None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:14.881540 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f7005-87bd-4004-9843-cbd093010aec None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:14.882833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 17/37] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:14.883530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f7005-87bd-4004-9843-cbd093010aec None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:14.914717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9e8dd-780b-4c27-a492-45d2be0998b6 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:14.953310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fccab2-00bc-4697-9b10-16d2e8ac12ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:14.954105 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fccab2-00bc-4697-9b10-16d2e8ac12ea None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:14.954577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fccab2-00bc-4697-9b10-16d2e8ac12ea None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:14.954865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fccab2-00bc-4697-9b10-16d2e8ac12ea None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:14.955690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fccab2-00bc-4697-9b10-16d2e8ac12ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:14.955933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fccab2-00bc-4697-9b10-16d2e8ac12ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:14.957393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fccab2-00bc-4697-9b10-16d2e8ac12ea None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:14.982783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 21/38] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:14.982783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505da06-1c58-4895-8561-b32957f9c0ed None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:14.982783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505da06-1c58-4895-8561-b32957f9c0ed None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:14.982783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505da06-1c58-4895-8561-b32957f9c0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:15.002063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b505da06-1c58-4895-8561-b32957f9c0ed None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:15.004087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b505da06-1c58-4895-8561-b32957f9c0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:15.037852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f7005-87bd-4004-9843-cbd093010aec None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:15.078486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d6b6c-9a91-4ca9-ac53-1e7c7824f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:15.079441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d6b6c-9a91-4ca9-ac53-1e7c7824f989 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:15.079948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d6b6c-9a91-4ca9-ac53-1e7c7824f989 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:15.080071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d6b6c-9a91-4ca9-ac53-1e7c7824f989 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:15.081177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d6b6c-9a91-4ca9-ac53-1e7c7824f989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:15.082753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d6b6c-9a91-4ca9-ac53-1e7c7824f989 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:15.086945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 22/39] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:15.089748 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 18/40] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:15.091357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d6b6c-9a91-4ca9-ac53-1e7c7824f989 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:15.091779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac30b59-7602-4169-942a-c6824e75a040 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:15.092069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac30b59-7602-4169-942a-c6824e75a040 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:15.092425 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac30b59-7602-4169-942a-c6824e75a040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:15.110558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6ac30b59-7602-4169-942a-c6824e75a040 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:15.111941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6ac30b59-7602-4169-942a-c6824e75a040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:15.186415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 23/41] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:15.186415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac30b59-7602-4169-942a-c6824e75a040 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:15.202736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d6b6c-9a91-4ca9-ac53-1e7c7824f989 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:15.239957 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106810f-99c2-481d-960e-cd124ebc1e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:15.240564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106810f-99c2-481d-960e-cd124ebc1e92 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:15.240849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106810f-99c2-481d-960e-cd124ebc1e92 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:15.241449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106810f-99c2-481d-960e-cd124ebc1e92 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:15.241858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106810f-99c2-481d-960e-cd124ebc1e92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:15.243422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106810f-99c2-481d-960e-cd124ebc1e92 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:15.288981 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac30b59-7602-4169-942a-c6824e75a040 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:15.325489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09148472-90c2-4a7f-99b4-c7994252e40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:15.326399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09148472-90c2-4a7f-99b4-c7994252e40f None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:15.326691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09148472-90c2-4a7f-99b4-c7994252e40f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:15.326977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09148472-90c2-4a7f-99b4-c7994252e40f None admin] PATH_INFO: `/v3/domains/default/users/a7162b13b2c54f8cadf583b1df8219b5/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:15.329017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09148472-90c2-4a7f-99b4-c7994252e40f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a7162b13b2c54f8cadf583b1df8219b5, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:15.330608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09148472-90c2-4a7f-99b4-c7994252e40f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:15.346391 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 24/42] 10.222.0.61 () {58 vars in 1361 bytes} [Sat May 14 15:32:15 2022] PUT /identity/v3/domains/default/users/a7162b13b2c54f8cadf583b1df8219b5/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:32:15.355819 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09148472-90c2-4a7f-99b4-c7994252e40f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:15.386809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 19/43] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:32:15 2022] POST /identity/v3/projects => generated 301 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:15.387678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106810f-99c2-481d-960e-cd124ebc1e92 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:15.520397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09148472-90c2-4a7f-99b4-c7994252e40f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:15.529358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106810f-99c2-481d-960e-cd124ebc1e92 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:15.576052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62a7af-d9ca-475a-ae42-f8fbc610346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:15.577179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62a7af-d9ca-475a-ae42-f8fbc610346c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:15.577592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62a7af-d9ca-475a-ae42-f8fbc610346c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:15.578012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62a7af-d9ca-475a-ae42-f8fbc610346c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:15.579786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62a7af-d9ca-475a-ae42-f8fbc610346c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:15.581012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b303696-61b7-45d9-a25f-9246a63a2baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:15.581276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62a7af-d9ca-475a-ae42-f8fbc610346c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:15.582121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303696-61b7-45d9-a25f-9246a63a2baa None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:15.582667 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303696-61b7-45d9-a25f-9246a63a2baa None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:15.583006 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 25/44] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:15.583343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303696-61b7-45d9-a25f-9246a63a2baa None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:15.584327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b303696-61b7-45d9-a25f-9246a63a2baa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:15.586099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b303696-61b7-45d9-a25f-9246a63a2baa None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:15.594032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62a7af-d9ca-475a-ae42-f8fbc610346c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:15.614338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 20/45] 10.222.0.61 () {60 vars in 1131 bytes} [Sat May 14 15:32:15 2022] POST /identity/v3/roles => generated 223 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:15.742878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62a7af-d9ca-475a-ae42-f8fbc610346c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:15.790620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4815645-154b-4934-b7e5-2e05e9293c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:15.791310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4815645-154b-4934-b7e5-2e05e9293c73 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:15.791600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4815645-154b-4934-b7e5-2e05e9293c73 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:15.791877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4815645-154b-4934-b7e5-2e05e9293c73 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:15.792640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4815645-154b-4934-b7e5-2e05e9293c73 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:15.794151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4815645-154b-4934-b7e5-2e05e9293c73 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:15.830013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 26/46] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:32:15 2022] POST /identity/v3/projects => generated 312 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:17.732769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429bbc-7cc9-4bc8-8a12-20fd35e171c1 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:17.733278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429bbc-7cc9-4bc8-8a12-20fd35e171c1 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:17.733386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17429bbc-7cc9-4bc8-8a12-20fd35e171c1 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:17.734843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 21/47] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:17.740646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ef71-0c7d-423e-9246-74438deeee78 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:17.741059 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ef71-0c7d-423e-9246-74438deeee78 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:17.741215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5ef71-0c7d-423e-9246-74438deeee78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:17.758273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e8d5ef71-0c7d-423e-9246-74438deeee78 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:17.759602 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e8d5ef71-0c7d-423e-9246-74438deeee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:17.838530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 27/48] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:17.868823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17429bbc-7cc9-4bc8-8a12-20fd35e171c1 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:18.004083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17429bbc-7cc9-4bc8-8a12-20fd35e171c1 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:18.042614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55b0c3-f88c-4d47-b4f8-ef53040338d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:18.043422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55b0c3-f88c-4d47-b4f8-ef53040338d3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:18.043709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55b0c3-f88c-4d47-b4f8-ef53040338d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:18.043991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55b0c3-f88c-4d47-b4f8-ef53040338d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:18.054689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55b0c3-f88c-4d47-b4f8-ef53040338d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-ed55b0c3-f88c-4d47-b4f8-ef53040338d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:18.062975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:18.063859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:18.064632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 22/49] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:32:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:18.071466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5ef71-0c7d-423e-9246-74438deeee78 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:18.175880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5ef71-0c7d-423e-9246-74438deeee78 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:18.188054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aee8d2-bcf2-45fc-b5b2-959008cdc841 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:18.188338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aee8d2-bcf2-45fc-b5b2-959008cdc841 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:18.188858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aee8d2-bcf2-45fc-b5b2-959008cdc841 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:18.191041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 23/50] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:32:18.196343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c45e2-b47a-46b5-b1eb-b14a55ca4f63 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:18.196673 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c45e2-b47a-46b5-b1eb-b14a55ca4f63 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:18.196939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c45e2-b47a-46b5-b1eb-b14a55ca4f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:18.211217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c278b-6a52-463d-a377-b4c9f87a3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:18.211874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c278b-6a52-463d-a377-b4c9f87a3d85 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:18.212158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c278b-6a52-463d-a377-b4c9f87a3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:18.212435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c278b-6a52-463d-a377-b4c9f87a3d85 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:18.213769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c278b-6a52-463d-a377-b4c9f87a3d85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:18.214075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c278b-6a52-463d-a377-b4c9f87a3d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:18.215484 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c278b-6a52-463d-a377-b4c9f87a3d85 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:18.217117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-435c45e2-b47a-46b5-b1eb-b14a55ca4f63 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:18.218737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-435c45e2-b47a-46b5-b1eb-b14a55ca4f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:18.223803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 28/51] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:18.229964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c278b-6a52-463d-a377-b4c9f87a3d85 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:18.287463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 24/52] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:18.312098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c45e2-b47a-46b5-b1eb-b14a55ca4f63 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:18.334681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c278b-6a52-463d-a377-b4c9f87a3d85 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:18.370674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a7abf-bee2-44b7-8794-d32697f2bbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:18.371601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a7abf-bee2-44b7-8794-d32697f2bbf0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:18.372077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a7abf-bee2-44b7-8794-d32697f2bbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:18.372351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a7abf-bee2-44b7-8794-d32697f2bbf0 None admin] PATH_INFO: `/v3/users/a7162b13b2c54f8cadf583b1df8219b5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:18.373716 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a7abf-bee2-44b7-8794-d32697f2bbf0 None admin] RBAC: Authorizing `identity:get_user(user_id=a7162b13b2c54f8cadf583b1df8219b5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:18.375211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a7abf-bee2-44b7-8794-d32697f2bbf0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:18.376845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 29/53] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:18 2022] GET /identity/v3/users/a7162b13b2c54f8cadf583b1df8219b5 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:18.382180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a7abf-bee2-44b7-8794-d32697f2bbf0 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:18.415248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c45e2-b47a-46b5-b1eb-b14a55ca4f63 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:18.451491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035ff0f-3a8b-4c57-8b80-db92fd82873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:18.452293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035ff0f-3a8b-4c57-8b80-db92fd82873c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:18.452572 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035ff0f-3a8b-4c57-8b80-db92fd82873c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:18.452859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035ff0f-3a8b-4c57-8b80-db92fd82873c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:18.454030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035ff0f-3a8b-4c57-8b80-db92fd82873c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:18.455539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2035ff0f-3a8b-4c57-8b80-db92fd82873c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:18.457484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 25/54] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:18.462631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035ff0f-3a8b-4c57-8b80-db92fd82873c None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:18.492179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a7abf-bee2-44b7-8794-d32697f2bbf0 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:18.529752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc486c-04b2-4bcf-8f60-4e7a970c488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:18.530847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc486c-04b2-4bcf-8f60-4e7a970c488f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:18.531142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc486c-04b2-4bcf-8f60-4e7a970c488f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:18.531440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc486c-04b2-4bcf-8f60-4e7a970c488f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:18.532748 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc486c-04b2-4bcf-8f60-4e7a970c488f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:18.534209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc486c-04b2-4bcf-8f60-4e7a970c488f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:18.536341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 30/55] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:18.544656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc486c-04b2-4bcf-8f60-4e7a970c488f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:18.574921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035ff0f-3a8b-4c57-8b80-db92fd82873c None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:18.610611 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa094270-4fbd-4b20-a5bd-49091461333a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:18.611275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094270-4fbd-4b20-a5bd-49091461333a None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:18.611560 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094270-4fbd-4b20-a5bd-49091461333a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:18.611851 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094270-4fbd-4b20-a5bd-49091461333a None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:18.612550 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa094270-4fbd-4b20-a5bd-49091461333a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:18.614091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa094270-4fbd-4b20-a5bd-49091461333a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:18.639990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 26/56] 10.222.0.61 () {60 vars in 1140 bytes} [Sat May 14 15:32:18 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:32:18.659521 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc486c-04b2-4bcf-8f60-4e7a970c488f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:18.703762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7de6b2-2ad6-4e1f-b58d-0b52358116d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:18.704459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7de6b2-2ad6-4e1f-b58d-0b52358116d3 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:18.704750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7de6b2-2ad6-4e1f-b58d-0b52358116d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:18.705035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7de6b2-2ad6-4e1f-b58d-0b52358116d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:18.705906 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7de6b2-2ad6-4e1f-b58d-0b52358116d3 None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.domain.id=default, user.id=a7162b13b2c54f8cadf583b1df8219b5) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:18.706222 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7de6b2-2ad6-4e1f-b58d-0b52358116d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:18.707767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7de6b2-2ad6-4e1f-b58d-0b52358116d3 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:18.715641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 31/57] 10.222.0.61 () {56 vars in 1322 bytes} [Sat May 14 15:32:18 2022] GET /identity/v3/role_assignments?user.id=a7162b13b2c54f8cadf583b1df8219b5&scope.domain.id=default&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 530 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:20.931880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a133b8-78f3-46f9-81f3-31c1785db316 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:20.932381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a133b8-78f3-46f9-81f3-31c1785db316 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:20.932526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a133b8-78f3-46f9-81f3-31c1785db316 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:20.933894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 27/58] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:20.939169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1628be-1327-483b-9279-10e74ec41620 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:20.939555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1628be-1327-483b-9279-10e74ec41620 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:20.939717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1628be-1327-483b-9279-10e74ec41620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:20.956722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-ec1628be-1327-483b-9279-10e74ec41620 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:20.957918 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ec1628be-1327-483b-9279-10e74ec41620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:21.023814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 32/59] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:21.048737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a133b8-78f3-46f9-81f3-31c1785db316 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:21.147811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a133b8-78f3-46f9-81f3-31c1785db316 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:21.179198 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca92517-8382-416d-ad28-a3c13d8e2070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:21.179983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92517-8382-416d-ad28-a3c13d8e2070 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:21.180267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92517-8382-416d-ad28-a3c13d8e2070 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:21.180541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca92517-8382-416d-ad28-a3c13d8e2070 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:21.182435 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca92517-8382-416d-ad28-a3c13d8e2070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:21.183894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca92517-8382-416d-ad28-a3c13d8e2070 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:21.185486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 28/60] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:21.192928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1628be-1327-483b-9279-10e74ec41620 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:21.283135 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1628be-1327-483b-9279-10e74ec41620 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:21.314739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ad29f-4de4-4345-aa4c-d21428f5a363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:21.315394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad29f-4de4-4345-aa4c-d21428f5a363 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:21.315677 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad29f-4de4-4345-aa4c-d21428f5a363 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:21.315954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ad29f-4de4-4345-aa4c-d21428f5a363 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:21.316663 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ad29f-4de4-4345-aa4c-d21428f5a363 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:21.318090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ad29f-4de4-4345-aa4c-d21428f5a363 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:21.341770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 33/61] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:32:21 2022] POST /identity/v3/users => generated 275 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:24.909701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9c0e2-47e6-4bc1-80a4-a58ab9e52913 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:24.910700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9c0e2-47e6-4bc1-80a4-a58ab9e52913 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:24.911188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9c0e2-47e6-4bc1-80a4-a58ab9e52913 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:24.912745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 29/62] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:24.918954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de8db3-5ebe-497d-bff8-4ae291fd942c None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:24.919798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de8db3-5ebe-497d-bff8-4ae291fd942c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:24.920282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de8db3-5ebe-497d-bff8-4ae291fd942c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:24.943301 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-07de8db3-5ebe-497d-bff8-4ae291fd942c None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:24.944814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-07de8db3-5ebe-497d-bff8-4ae291fd942c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:24.977586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fa51e-70b2-41f7-a69a-ec7c2f35bde8 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:24.978188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fa51e-70b2-41f7-a69a-ec7c2f35bde8 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:24.979362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fa51e-70b2-41f7-a69a-ec7c2f35bde8 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:24.981015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 30/63] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:32:24.986370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1465a0-bdb0-4a66-ac63-efff66a779bf None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:24.986895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1465a0-bdb0-4a66-ac63-efff66a779bf None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:24.987398 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1465a0-bdb0-4a66-ac63-efff66a779bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.019342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7e1465a0-bdb0-4a66-ac63-efff66a779bf None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:25.020905 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7e1465a0-bdb0-4a66-ac63-efff66a779bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:25.024850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 34/64] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:25.048694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de8db3-5ebe-497d-bff8-4ae291fd942c None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:25.131465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 31/65] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:25.133088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752aa5-a4a4-4180-80cc-0531486c3c58 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.133588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752aa5-a4a4-4180-80cc-0531486c3c58 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.134062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c752aa5-a4a4-4180-80cc-0531486c3c58 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.136124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 32/66] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:25.141573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d876-bc0f-4a93-ae47-0921bef890b4 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.142103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d876-bc0f-4a93-ae47-0921bef890b4 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.142615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974d876-bc0f-4a93-ae47-0921bef890b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.163068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7974d876-bc0f-4a93-ae47-0921bef890b4 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:25.164742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7974d876-bc0f-4a93-ae47-0921bef890b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:25.205244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de8db3-5ebe-497d-bff8-4ae291fd942c None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:25.242490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 33/67] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:25.250329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974d876-bc0f-4a93-ae47-0921bef890b4 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:25.267004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c7a5d-6102-4657-a9d0-a95d43b383be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:25.268832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7a5d-6102-4657-a9d0-a95d43b383be None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.269741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7a5d-6102-4657-a9d0-a95d43b383be None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.270564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7a5d-6102-4657-a9d0-a95d43b383be None admin] PATH_INFO: `/v3/roles/member` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.288999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c7a5d-6102-4657-a9d0-a95d43b383be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-e69c7a5d-6102-4657-a9d0-a95d43b383be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:25.304729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:25.305634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:25.306416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:25.307742 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 35/68] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:32:25.310341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46181e-b983-4c64-8129-854977dd2e71 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.310927 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46181e-b983-4c64-8129-854977dd2e71 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.311386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46181e-b983-4c64-8129-854977dd2e71 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.313386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 36/69] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:25.314244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46181e-b983-4c64-8129-854977dd2e71 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:25.367141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974d876-bc0f-4a93-ae47-0921bef890b4 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:25.400893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426bfe-6c89-4756-bf7b-550b0c2ee01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:25.401692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426bfe-6c89-4756-bf7b-550b0c2ee01c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.401980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426bfe-6c89-4756-bf7b-550b0c2ee01c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.402261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426bfe-6c89-4756-bf7b-550b0c2ee01c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.411998 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af426bfe-6c89-4756-bf7b-550b0c2ee01c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-af426bfe-6c89-4756-bf7b-550b0c2ee01c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:25.420446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:25.421278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:25.422027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 34/70] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:32:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:25.423139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426bfe-6c89-4756-bf7b-550b0c2ee01c None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:25.434105 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46181e-b983-4c64-8129-854977dd2e71 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:25.470749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a117d0-0456-4c8e-b477-8355d8baaf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:25.471688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a117d0-0456-4c8e-b477-8355d8baaf89 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.471893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a117d0-0456-4c8e-b477-8355d8baaf89 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.472134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a117d0-0456-4c8e-b477-8355d8baaf89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.483932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a117d0-0456-4c8e-b477-8355d8baaf89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-f2a117d0-0456-4c8e-b477-8355d8baaf89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:25.492281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:25.493214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:25.495082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 37/71] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:32:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:25.496023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e8af8-8ca6-4562-865d-c3153002aaa9 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.497030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e8af8-8ca6-4562-865d-c3153002aaa9 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.497030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e8af8-8ca6-4562-865d-c3153002aaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.513243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-4f9e8af8-8ca6-4562-865d-c3153002aaa9 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:25.514766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4f9e8af8-8ca6-4562-865d-c3153002aaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:25.527095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426bfe-6c89-4756-bf7b-550b0c2ee01c None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:25.559805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1387d-b777-445b-a7b9-b34023db0d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:25.560480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1387d-b777-445b-a7b9-b34023db0d84 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.560767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1387d-b777-445b-a7b9-b34023db0d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.561051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1387d-b777-445b-a7b9-b34023db0d84 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.561813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1387d-b777-445b-a7b9-b34023db0d84 None admin] RBAC: Adding query filter params (name=member) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:25.562129 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1387d-b777-445b-a7b9-b34023db0d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:25.563567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1387d-b777-445b-a7b9-b34023db0d84 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:25.571960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 35/72] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:25.573953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1387d-b777-445b-a7b9-b34023db0d84 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:25.594334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 38/73] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:25.594334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e8af8-8ca6-4562-865d-c3153002aaa9 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:25.672903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1387d-b777-445b-a7b9-b34023db0d84 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:25.696209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e8af8-8ca6-4562-865d-c3153002aaa9 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:25.704527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9953b7-385e-4be0-9338-a41343a8ca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:25.705199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9953b7-385e-4be0-9338-a41343a8ca09 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.705481 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9953b7-385e-4be0-9338-a41343a8ca09 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.705758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9953b7-385e-4be0-9338-a41343a8ca09 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.706555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9953b7-385e-4be0-9338-a41343a8ca09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:25.706869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9953b7-385e-4be0-9338-a41343a8ca09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:25.708259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9953b7-385e-4be0-9338-a41343a8ca09 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:25.716070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 36/74] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:25.718030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9953b7-385e-4be0-9338-a41343a8ca09 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:25.729073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8facce-eaa9-4eb5-a74b-5faf89636b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:25.729745 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8facce-eaa9-4eb5-a74b-5faf89636b49 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.730027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8facce-eaa9-4eb5-a74b-5faf89636b49 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.730301 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8facce-eaa9-4eb5-a74b-5faf89636b49 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.731082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8facce-eaa9-4eb5-a74b-5faf89636b49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:25.731389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8facce-eaa9-4eb5-a74b-5faf89636b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:25.732805 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8facce-eaa9-4eb5-a74b-5faf89636b49 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:25.740454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 39/75] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:32:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:25.741240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8facce-eaa9-4eb5-a74b-5faf89636b49 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:25.811666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9953b7-385e-4be0-9338-a41343a8ca09 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:25.834196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8facce-eaa9-4eb5-a74b-5faf89636b49 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:25.845578 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573bcd8-f93d-433a-9a13-71b29580221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:25.846484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573bcd8-f93d-433a-9a13-71b29580221a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.846772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573bcd8-f93d-433a-9a13-71b29580221a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.847052 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573bcd8-f93d-433a-9a13-71b29580221a None admin] PATH_INFO: `/v3/users/bfcb42b66d894bf19c19d3ce4885a45f` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.862209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573bcd8-f93d-433a-9a13-71b29580221a None admin] RBAC: Authorizing `identity:get_user(user_id=bfcb42b66d894bf19c19d3ce4885a45f)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:25.863703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573bcd8-f93d-433a-9a13-71b29580221a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:25.865364 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 37/76] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:25 2022] GET /identity/v3/users/bfcb42b66d894bf19c19d3ce4885a45f => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:25.866614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fd856-daaf-42d6-b8ed-3b1f1c25cc2e None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.866896 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fd856-daaf-42d6-b8ed-3b1f1c25cc2e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.867176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fd856-daaf-42d6-b8ed-3b1f1c25cc2e None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.867743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a12b0-3124-4c51-a233-8dccbfd9d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:25.868533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 38/77] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:25.868647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a12b0-3124-4c51-a233-8dccbfd9d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:25.868821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a12b0-3124-4c51-a233-8dccbfd9d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:25.869361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a12b0-3124-4c51-a233-8dccbfd9d7f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:25.871109 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fd856-daaf-42d6-b8ed-3b1f1c25cc2e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:25.879535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a12b0-3124-4c51-a233-8dccbfd9d7f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-f53a12b0-3124-4c51-a233-8dccbfd9d7f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:25.888031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:25.888830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 40/78] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:25.894272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a12b0-3124-4c51-a233-8dccbfd9d7f0 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:25.968195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fd856-daaf-42d6-b8ed-3b1f1c25cc2e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:25.984709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a12b0-3124-4c51-a233-8dccbfd9d7f0 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:25.999904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c068d50-44df-48e0-81b8-f3203ea33a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.000768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c068d50-44df-48e0-81b8-f3203ea33a22 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.001050 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c068d50-44df-48e0-81b8-f3203ea33a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.001325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c068d50-44df-48e0-81b8-f3203ea33a22 None admin] PATH_INFO: `/v3/users/a7162b13b2c54f8cadf583b1df8219b5` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.002533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c068d50-44df-48e0-81b8-f3203ea33a22 None admin] RBAC: Authorizing `identity:get_user(user_id=a7162b13b2c54f8cadf583b1df8219b5)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.003983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c068d50-44df-48e0-81b8-f3203ea33a22 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:26.005596 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 39/79] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:25 2022] GET /identity/v3/users/a7162b13b2c54f8cadf583b1df8219b5 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:26.010811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c068d50-44df-48e0-81b8-f3203ea33a22 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:26.021610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b837636-fa3f-4d0f-9e4b-07564d4e858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.022508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837636-fa3f-4d0f-9e4b-07564d4e858d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.022800 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837636-fa3f-4d0f-9e4b-07564d4e858d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.023074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837636-fa3f-4d0f-9e4b-07564d4e858d None admin] PATH_INFO: `/v3/users/bfcb42b66d894bf19c19d3ce4885a45f` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.024258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b837636-fa3f-4d0f-9e4b-07564d4e858d None admin] RBAC: Authorizing `identity:get_user(user_id=bfcb42b66d894bf19c19d3ce4885a45f)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.026287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b837636-fa3f-4d0f-9e4b-07564d4e858d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:26.027928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 41/80] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:25 2022] GET /identity/v3/users/bfcb42b66d894bf19c19d3ce4885a45f => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:26.029063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897074d-f975-4e55-b7f2-cda98cadde24 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.029353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897074d-f975-4e55-b7f2-cda98cadde24 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.029630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897074d-f975-4e55-b7f2-cda98cadde24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.046767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-8897074d-f975-4e55-b7f2-cda98cadde24 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:26.047957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8897074d-f975-4e55-b7f2-cda98cadde24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:26.099746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c068d50-44df-48e0-81b8-f3203ea33a22 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:26.111193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 42/81] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:26.112808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897074d-f975-4e55-b7f2-cda98cadde24 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:26.141974 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e917cea-3a73-4f28-8201-13d8c8a83e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.142662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e917cea-3a73-4f28-8201-13d8c8a83e4d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.142955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e917cea-3a73-4f28-8201-13d8c8a83e4d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.143240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e917cea-3a73-4f28-8201-13d8c8a83e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.204974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897074d-f975-4e55-b7f2-cda98cadde24 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:26.206549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e917cea-3a73-4f28-8201-13d8c8a83e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.208027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e917cea-3a73-4f28-8201-13d8c8a83e4d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:26.237576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83948161-ce45-4fba-928a-7d1fb5a746f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.238180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83948161-ce45-4fba-928a-7d1fb5a746f4 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.238495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83948161-ce45-4fba-928a-7d1fb5a746f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.238764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83948161-ce45-4fba-928a-7d1fb5a746f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.239503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83948161-ce45-4fba-928a-7d1fb5a746f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:26.239809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83948161-ce45-4fba-928a-7d1fb5a746f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.241178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83948161-ce45-4fba-928a-7d1fb5a746f4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:26.249087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 43/82] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:26.254817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83948161-ce45-4fba-928a-7d1fb5a746f4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:26.302254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 40/83] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:26.303015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e917cea-3a73-4f28-8201-13d8c8a83e4d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:26.346952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83948161-ce45-4fba-928a-7d1fb5a746f4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:26.378083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8747a0-df1f-478f-93fd-a840a854d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.378743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8747a0-df1f-478f-93fd-a840a854d8bf None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.379026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8747a0-df1f-478f-93fd-a840a854d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.379302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8747a0-df1f-478f-93fd-a840a854d8bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.393735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e917cea-3a73-4f28-8201-13d8c8a83e4d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:26.425634 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a472880-0731-4678-98a4-b5763ed6b21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.426280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472880-0731-4678-98a4-b5763ed6b21f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.426597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472880-0731-4678-98a4-b5763ed6b21f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.426873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472880-0731-4678-98a4-b5763ed6b21f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.441764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8747a0-df1f-478f-93fd-a840a854d8bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.443235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8747a0-df1f-478f-93fd-a840a854d8bf None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:26.490643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a472880-0731-4678-98a4-b5763ed6b21f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.492056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a472880-0731-4678-98a4-b5763ed6b21f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:26.536314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 44/84] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:26.537979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8747a0-df1f-478f-93fd-a840a854d8bf None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:26.583439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 41/85] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:26.585364 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a472880-0731-4678-98a4-b5763ed6b21f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:26.629895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8747a0-df1f-478f-93fd-a840a854d8bf None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:26.662050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0befc-5234-497f-8e0f-c5dc0f21ac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.662858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0befc-5234-497f-8e0f-c5dc0f21ac86 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.663147 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0befc-5234-497f-8e0f-c5dc0f21ac86 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.663425 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0befc-5234-497f-8e0f-c5dc0f21ac86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.664596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0befc-5234-497f-8e0f-c5dc0f21ac86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.666660 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0befc-5234-497f-8e0f-c5dc0f21ac86 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:26.668597 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 45/86] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:26.669277 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0befc-5234-497f-8e0f-c5dc0f21ac86 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:26.678186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a472880-0731-4678-98a4-b5763ed6b21f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:26.711053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4c778-d3f5-4a29-86cb-2eaa2015748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.711925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4c778-d3f5-4a29-86cb-2eaa2015748d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.712211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4c778-d3f5-4a29-86cb-2eaa2015748d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.712492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4c778-d3f5-4a29-86cb-2eaa2015748d None admin] PATH_INFO: `/v3/users/bfcb42b66d894bf19c19d3ce4885a45f` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.714268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4c778-d3f5-4a29-86cb-2eaa2015748d None admin] RBAC: Authorizing `identity:get_user(user_id=bfcb42b66d894bf19c19d3ce4885a45f)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.715747 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4c778-d3f5-4a29-86cb-2eaa2015748d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:26.717381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 42/87] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:26 2022] GET /identity/v3/users/bfcb42b66d894bf19c19d3ce4885a45f => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:26.721819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4c778-d3f5-4a29-86cb-2eaa2015748d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:26.764908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0befc-5234-497f-8e0f-c5dc0f21ac86 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:26.797404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d6f06-9dfc-421a-b367-3e95fcd18253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.798264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d6f06-9dfc-421a-b367-3e95fcd18253 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.798582 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d6f06-9dfc-421a-b367-3e95fcd18253 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.798860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d6f06-9dfc-421a-b367-3e95fcd18253 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.800055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d6f06-9dfc-421a-b367-3e95fcd18253 None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.801501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d6f06-9dfc-421a-b367-3e95fcd18253 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:26.803225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 46/88] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:26 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:26.803991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d6f06-9dfc-421a-b367-3e95fcd18253 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:26.815308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4c778-d3f5-4a29-86cb-2eaa2015748d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:26.849459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43308057-4644-4044-8a66-8929541d9c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.850367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43308057-4644-4044-8a66-8929541d9c4b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.850740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43308057-4644-4044-8a66-8929541d9c4b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.851049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43308057-4644-4044-8a66-8929541d9c4b None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.852502 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43308057-4644-4044-8a66-8929541d9c4b None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.854565 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43308057-4644-4044-8a66-8929541d9c4b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:26.856336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 43/89] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:26 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:26.859071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43308057-4644-4044-8a66-8929541d9c4b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:26.905319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d6f06-9dfc-421a-b367-3e95fcd18253 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:26.938398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0967f1b-f92d-4595-8769-a7305cf4d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.939244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0967f1b-f92d-4595-8769-a7305cf4d4ad None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.939525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0967f1b-f92d-4595-8769-a7305cf4d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.939825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0967f1b-f92d-4595-8769-a7305cf4d4ad None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.940991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0967f1b-f92d-4595-8769-a7305cf4d4ad None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.942467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0967f1b-f92d-4595-8769-a7305cf4d4ad None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:26.944142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 47/90] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:26 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:26.944892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0967f1b-f92d-4595-8769-a7305cf4d4ad None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:26.958163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43308057-4644-4044-8a66-8929541d9c4b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:26.990769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f15816-5390-4db9-8c87-4e51e5a9c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:26.991434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f15816-5390-4db9-8c87-4e51e5a9c31f None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:26.991715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f15816-5390-4db9-8c87-4e51e5a9c31f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:26.991989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f15816-5390-4db9-8c87-4e51e5a9c31f None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:26.992701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f15816-5390-4db9-8c87-4e51e5a9c31f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:26.994163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f15816-5390-4db9-8c87-4e51e5a9c31f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:27.018385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 44/91] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:32:26 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:27.019167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f15816-5390-4db9-8c87-4e51e5a9c31f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:27.040292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0967f1b-f92d-4595-8769-a7305cf4d4ad None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:27.077759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60355518-1dbd-435d-879f-df2708adf210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:27.078463 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60355518-1dbd-435d-879f-df2708adf210 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:27.078751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60355518-1dbd-435d-879f-df2708adf210 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:27.079027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60355518-1dbd-435d-879f-df2708adf210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:27.125264 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f15816-5390-4db9-8c87-4e51e5a9c31f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:27.150060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60355518-1dbd-435d-879f-df2708adf210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:27.152576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60355518-1dbd-435d-879f-df2708adf210 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:27.162465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f18f-25a0-4394-86c8-9fbaa89495ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:27.163142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f18f-25a0-4394-86c8-9fbaa89495ef None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:27.163479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f18f-25a0-4394-86c8-9fbaa89495ef None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:27.163759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f18f-25a0-4394-86c8-9fbaa89495ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:27.164616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f18f-25a0-4394-86c8-9fbaa89495ef None admin] RBAC: Adding query filter params (role.id=15a2a347c19845c9ac397da513eb944a, scope.project.id=235c60e5703c440590e4c72e2d095f74, user.id=bfcb42b66d894bf19c19d3ce4885a45f) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:27.164928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f18f-25a0-4394-86c8-9fbaa89495ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:27.166789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429f18f-25a0-4394-86c8-9fbaa89495ef None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:27.182715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 45/92] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:27 2022] GET /identity/v3/role_assignments?user.id=bfcb42b66d894bf19c19d3ce4885a45f&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=15a2a347c19845c9ac397da513eb944a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:27.182715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f18f-25a0-4394-86c8-9fbaa89495ef None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:27.259445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 48/93] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:27.260247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60355518-1dbd-435d-879f-df2708adf210 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:27.293831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429f18f-25a0-4394-86c8-9fbaa89495ef None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:27.331015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b0fc-d9ac-47f7-831e-8646bfe52b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:27.331694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b0fc-d9ac-47f7-831e-8646bfe52b85 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:27.331977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b0fc-d9ac-47f7-831e-8646bfe52b85 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:27.332310 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b0fc-d9ac-47f7-831e-8646bfe52b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:27.333227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44b0fc-d9ac-47f7-831e-8646bfe52b85 None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=235c60e5703c440590e4c72e2d095f74, user.id=a7162b13b2c54f8cadf583b1df8219b5) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:27.333552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44b0fc-d9ac-47f7-831e-8646bfe52b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:27.335099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44b0fc-d9ac-47f7-831e-8646bfe52b85 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:27.341773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 46/94] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:27 2022] GET /identity/v3/role_assignments?user.id=a7162b13b2c54f8cadf583b1df8219b5&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:27.342463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b0fc-d9ac-47f7-831e-8646bfe52b85 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:27.368137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60355518-1dbd-435d-879f-df2708adf210 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:27.406581 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82bce3-aeb6-4e7f-b501-7b4b570c7c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:27.407249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82bce3-aeb6-4e7f-b501-7b4b570c7c2c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:27.407532 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82bce3-aeb6-4e7f-b501-7b4b570c7c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:27.407824 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82bce3-aeb6-4e7f-b501-7b4b570c7c2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:27.408659 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82bce3-aeb6-4e7f-b501-7b4b570c7c2c None admin] RBAC: Adding query filter params (role.id=97f5bd452f314fa093a222f49facdac7, scope.project.id=235c60e5703c440590e4c72e2d095f74, user.id=bfcb42b66d894bf19c19d3ce4885a45f) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:27.408970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82bce3-aeb6-4e7f-b501-7b4b570c7c2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:27.410455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82bce3-aeb6-4e7f-b501-7b4b570c7c2c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:27.417048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 49/95] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:27 2022] GET /identity/v3/role_assignments?user.id=bfcb42b66d894bf19c19d3ce4885a45f&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=97f5bd452f314fa093a222f49facdac7 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:27.460559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b0fc-d9ac-47f7-831e-8646bfe52b85 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:27.504484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199b5c7-b9eb-42cd-860a-f495d33240f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:27.505451 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b5c7-b9eb-42cd-860a-f495d33240f5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:27.505731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b5c7-b9eb-42cd-860a-f495d33240f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:27.506004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b5c7-b9eb-42cd-860a-f495d33240f5 None admin] PATH_INFO: `/v3/projects/1b556f29749b4ba3a0402cbe066721a3` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:27.507544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199b5c7-b9eb-42cd-860a-f495d33240f5 None admin] RBAC: Authorizing `identity:get_project(project_id=1b556f29749b4ba3a0402cbe066721a3)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:27.509070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199b5c7-b9eb-42cd-860a-f495d33240f5 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:27.511635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 47/96] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:27 2022] GET /identity/v3/projects/1b556f29749b4ba3a0402cbe066721a3 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:27.517424 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82bce3-aeb6-4e7f-b501-7b4b570c7c2c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:27.629896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82bce3-aeb6-4e7f-b501-7b4b570c7c2c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:27.667223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdc115-90b3-4f58-8323-f36c575f3733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:27.667897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc115-90b3-4f58-8323-f36c575f3733 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:27.668187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc115-90b3-4f58-8323-f36c575f3733 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:27.668464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdc115-90b3-4f58-8323-f36c575f3733 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:27.669317 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdc115-90b3-4f58-8323-f36c575f3733 None admin] RBAC: Adding query filter params (role.id=15a2a347c19845c9ac397da513eb944a, scope.project.id=1b556f29749b4ba3a0402cbe066721a3, user.id=bfcb42b66d894bf19c19d3ce4885a45f) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:27.669626 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdc115-90b3-4f58-8323-f36c575f3733 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:27.671140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdc115-90b3-4f58-8323-f36c575f3733 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:27.677763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 50/97] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:27 2022] GET /identity/v3/role_assignments?user.id=bfcb42b66d894bf19c19d3ce4885a45f&scope.project.id=1b556f29749b4ba3a0402cbe066721a3&role.id=15a2a347c19845c9ac397da513eb944a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:30.131355 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8e2db-f7ec-4952-8234-2fe820fcd346 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:30.132360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8e2db-f7ec-4952-8234-2fe820fcd346 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:30.132857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8e2db-f7ec-4952-8234-2fe820fcd346 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:30.135227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 48/98] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:30.141085 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702af38-a526-4b47-bce0-067c5f7f49e1 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:30.142020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702af38-a526-4b47-bce0-067c5f7f49e1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:30.142527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702af38-a526-4b47-bce0-067c5f7f49e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:30.167332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-d702af38-a526-4b47-bce0-067c5f7f49e1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:30.168856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d702af38-a526-4b47-bce0-067c5f7f49e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:30.248918 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 51/99] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:30.290172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8e2db-f7ec-4952-8234-2fe820fcd346 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:30.443131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8e2db-f7ec-4952-8234-2fe820fcd346 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:30.492272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7a477-f487-4858-8d25-b71527a6a75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:30.493078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a477-f487-4858-8d25-b71527a6a75f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:30.493370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a477-f487-4858-8d25-b71527a6a75f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:30.493653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7a477-f487-4858-8d25-b71527a6a75f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:30.509591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7a477-f487-4858-8d25-b71527a6a75f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f0f7a477-f487-4858-8d25-b71527a6a75f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:30.517686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:30.518657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:30.519431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 49/100] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:30.527267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702af38-a526-4b47-bce0-067c5f7f49e1 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:30.631144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b41bd-3323-42e4-809c-9b01fd73c48d None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:30.631479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b41bd-3323-42e4-809c-9b01fd73c48d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:30.631718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b41bd-3323-42e4-809c-9b01fd73c48d None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:30.633835 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 50/101] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:32:30.638822 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81171bc-e300-49cc-a95d-94daaee9d975 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:30.639113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81171bc-e300-49cc-a95d-94daaee9d975 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:30.639401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81171bc-e300-49cc-a95d-94daaee9d975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:30.669118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c81171bc-e300-49cc-a95d-94daaee9d975 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:30.670366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c81171bc-e300-49cc-a95d-94daaee9d975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:30.689415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702af38-a526-4b47-bce0-067c5f7f49e1 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:30.759365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7c143-a227-4bd4-8224-5f36c177ef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:30.760041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7c143-a227-4bd4-8224-5f36c177ef04 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:30.760323 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7c143-a227-4bd4-8224-5f36c177ef04 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:30.760598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7c143-a227-4bd4-8224-5f36c177ef04 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:30.761361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7c143-a227-4bd4-8224-5f36c177ef04 None admin] RBAC: Adding query filter params (name=member) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:30.761672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7c143-a227-4bd4-8224-5f36c177ef04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:30.763082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7c143-a227-4bd4-8224-5f36c177ef04 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:30.780976 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 52/102] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:30.788212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e69577-1b63-48cc-9077-10c7f6a2f789 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:30.789478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e69577-1b63-48cc-9077-10c7f6a2f789 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:30.790733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e69577-1b63-48cc-9077-10c7f6a2f789 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:30.792985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 53/103] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:30.796249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e69577-1b63-48cc-9077-10c7f6a2f789 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:30.836778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 51/104] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:30.847213 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8e8e-357f-462c-86b6-c2622afcf4db None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:30.847741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8e8e-357f-462c-86b6-c2622afcf4db None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:30.848209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8e8e-357f-462c-86b6-c2622afcf4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:30.870490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-a47d8e8e-357f-462c-86b6-c2622afcf4db None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:30.872006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a47d8e8e-357f-462c-86b6-c2622afcf4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:30.941313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e69577-1b63-48cc-9077-10c7f6a2f789 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:30.946543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 52/105] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:30.948917 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b99440-6a3c-4c0e-84bb-f5337bf67314 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:30.949371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b99440-6a3c-4c0e-84bb-f5337bf67314 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:30.949792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b99440-6a3c-4c0e-84bb-f5337bf67314 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:30.951322 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 53/106] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:30.952217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b99440-6a3c-4c0e-84bb-f5337bf67314 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:30.992100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792f82a-a59f-425f-a205-8a05c3233213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:30.993090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792f82a-a59f-425f-a205-8a05c3233213 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:30.993376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792f82a-a59f-425f-a205-8a05c3233213 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:30.993653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792f82a-a59f-425f-a205-8a05c3233213 None admin] PATH_INFO: `/v3/users/bfcb42b66d894bf19c19d3ce4885a45f` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:30.994941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792f82a-a59f-425f-a205-8a05c3233213 None admin] RBAC: Authorizing `identity:get_user(user_id=bfcb42b66d894bf19c19d3ce4885a45f)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:30.996389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792f82a-a59f-425f-a205-8a05c3233213 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:30.998362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 54/107] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:30 2022] GET /identity/v3/users/bfcb42b66d894bf19c19d3ce4885a45f => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:30.999704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbdbd6-ed92-4e10-b8d6-a792de340203 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.000190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbdbd6-ed92-4e10-b8d6-a792de340203 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.000607 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbdbd6-ed92-4e10-b8d6-a792de340203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.017971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-02fbdbd6-ed92-4e10-b8d6-a792de340203 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:31.019398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-02fbdbd6-ed92-4e10-b8d6-a792de340203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:31.058371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b99440-6a3c-4c0e-84bb-f5337bf67314 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:31.084884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 55/108] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:31.086961 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbdbd6-ed92-4e10-b8d6-a792de340203 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:31.095828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e23d3-700e-4790-a84f-3453713461cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:31.096645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e23d3-700e-4790-a84f-3453713461cb None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.096931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e23d3-700e-4790-a84f-3453713461cb None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.097209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e23d3-700e-4790-a84f-3453713461cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.108591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e23d3-700e-4790-a84f-3453713461cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-b20e23d3-700e-4790-a84f-3453713461cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:31.116700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:31.117498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:31.118257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 54/109] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:32:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:31.119964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e23d3-700e-4790-a84f-3453713461cb None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:31.180468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbdbd6-ed92-4e10-b8d6-a792de340203 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:31.213040 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e23d3-700e-4790-a84f-3453713461cb None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:31.213497 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46caa77-b2b6-4e87-8880-0a343a35bea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:31.214026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46caa77-b2b6-4e87-8880-0a343a35bea3 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.214316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46caa77-b2b6-4e87-8880-0a343a35bea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.214619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46caa77-b2b6-4e87-8880-0a343a35bea3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.215786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46caa77-b2b6-4e87-8880-0a343a35bea3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:31.217215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46caa77-b2b6-4e87-8880-0a343a35bea3 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:31.218850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 56/110] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:31.220001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1ac12-e44a-4f0b-a705-1858d546f10f None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.220282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1ac12-e44a-4f0b-a705-1858d546f10f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.220554 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1ac12-e44a-4f0b-a705-1858d546f10f None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.226134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 57/111] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:31.226134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae440d3-5ea8-4d5e-8a7f-6866e099761b None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.226134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae440d3-5ea8-4d5e-8a7f-6866e099761b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.226134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae440d3-5ea8-4d5e-8a7f-6866e099761b None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.226134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 58/112] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:31.226134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae440d3-5ea8-4d5e-8a7f-6866e099761b None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:31.246592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5e281-2f91-48e6-88af-336023fcdf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:31.247433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e281-2f91-48e6-88af-336023fcdf39 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.247721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e281-2f91-48e6-88af-336023fcdf39 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.247999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5e281-2f91-48e6-88af-336023fcdf39 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.249201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5e281-2f91-48e6-88af-336023fcdf39 None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:31.250686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5e281-2f91-48e6-88af-336023fcdf39 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:31.252383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 55/113] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:31 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:31.253223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5e281-2f91-48e6-88af-336023fcdf39 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:31.325236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae440d3-5ea8-4d5e-8a7f-6866e099761b None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:31.346783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5e281-2f91-48e6-88af-336023fcdf39 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:31.358230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457e71c-2321-4b09-9532-9fea631bccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:31.359061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e71c-2321-4b09-9532-9fea631bccf9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.359350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e71c-2321-4b09-9532-9fea631bccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.359631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457e71c-2321-4b09-9532-9fea631bccf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.370147 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457e71c-2321-4b09-9532-9fea631bccf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-9457e71c-2321-4b09-9532-9fea631bccf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:31.377712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:31.378767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 59/114] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:31.379777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457e71c-2321-4b09-9532-9fea631bccf9 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:31.380847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90547955-d6a7-453a-ac04-a7b664a44d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:31.381399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90547955-d6a7-453a-ac04-a7b664a44d3e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.381692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90547955-d6a7-453a-ac04-a7b664a44d3e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.382014 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90547955-d6a7-453a-ac04-a7b664a44d3e None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.382895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90547955-d6a7-453a-ac04-a7b664a44d3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:31.383241 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90547955-d6a7-453a-ac04-a7b664a44d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:31.385482 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90547955-d6a7-453a-ac04-a7b664a44d3e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:31.393456 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 56/115] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:32:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:31.395727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d7aac-ad0d-4e10-96c1-b47ce29038a5 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.396023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d7aac-ad0d-4e10-96c1-b47ce29038a5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.396303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d7aac-ad0d-4e10-96c1-b47ce29038a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.412129 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-6a5d7aac-ad0d-4e10-96c1-b47ce29038a5 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:31.413311 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6a5d7aac-ad0d-4e10-96c1-b47ce29038a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:31.474175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457e71c-2321-4b09-9532-9fea631bccf9 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:31.475760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 57/116] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:31.478691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e702df-c4ef-4221-9262-c673013b74cf None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.478992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e702df-c4ef-4221-9262-c673013b74cf None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.479275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e702df-c4ef-4221-9262-c673013b74cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.498141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-74e702df-c4ef-4221-9262-c673013b74cf None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:31.499341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-74e702df-c4ef-4221-9262-c673013b74cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:31.507155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541981a6-8cd9-4208-a22f-3dadc3a29d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:31.507816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541981a6-8cd9-4208-a22f-3dadc3a29d0e None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.508100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541981a6-8cd9-4208-a22f-3dadc3a29d0e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.508379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541981a6-8cd9-4208-a22f-3dadc3a29d0e None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.509080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541981a6-8cd9-4208-a22f-3dadc3a29d0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:31.511263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541981a6-8cd9-4208-a22f-3dadc3a29d0e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:31.535348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 60/117] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:32:31 2022] POST /identity/v3/projects => generated 302 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:31.536316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541981a6-8cd9-4208-a22f-3dadc3a29d0e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:31.567355 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 58/118] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:31.568074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e702df-c4ef-4221-9262-c673013b74cf None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:31.655719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541981a6-8cd9-4208-a22f-3dadc3a29d0e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:31.675067 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e702df-c4ef-4221-9262-c673013b74cf None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:31.695047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b788f24-ceab-4d40-9477-73f9283f6178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:31.695959 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b788f24-ceab-4d40-9477-73f9283f6178 None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.696240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b788f24-ceab-4d40-9477-73f9283f6178 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.696513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b788f24-ceab-4d40-9477-73f9283f6178 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74/users/bfcb42b66d894bf19c19d3ce4885a45f/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.698739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b788f24-ceab-4d40-9477-73f9283f6178 None admin] RBAC: Authorizing `identity:create_grant(project_id=235c60e5703c440590e4c72e2d095f74, user_id=bfcb42b66d894bf19c19d3ce4885a45f, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:31.700344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b788f24-ceab-4d40-9477-73f9283f6178 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:31.712159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b3c92-6b01-4b5b-a3b1-52d18c2b361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:31.712928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b3c92-6b01-4b5b-a3b1-52d18c2b361f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.713214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b3c92-6b01-4b5b-a3b1-52d18c2b361f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.726479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 61/119] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:32:31 2022] PUT /identity/v3/projects/235c60e5703c440590e4c72e2d095f74/users/bfcb42b66d894bf19c19d3ce4885a45f/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:32:31.726937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b3c92-6b01-4b5b-a3b1-52d18c2b361f None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.727050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b788f24-ceab-4d40-9477-73f9283f6178 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:31.727139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b3c92-6b01-4b5b-a3b1-52d18c2b361f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:31.727139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b3c92-6b01-4b5b-a3b1-52d18c2b361f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:31.727139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b3c92-6b01-4b5b-a3b1-52d18c2b361f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:31.727139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 59/120] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:31.727411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b3c92-6b01-4b5b-a3b1-52d18c2b361f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:31.853171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b3c92-6b01-4b5b-a3b1-52d18c2b361f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:31.877014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b788f24-ceab-4d40-9477-73f9283f6178 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:31.896147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71b814-1e92-41ac-8190-970e97b21601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:31.897242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71b814-1e92-41ac-8190-970e97b21601 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.897531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71b814-1e92-41ac-8190-970e97b21601 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.897809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71b814-1e92-41ac-8190-970e97b21601 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.912722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71b814-1e92-41ac-8190-970e97b21601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-7c71b814-1e92-41ac-8190-970e97b21601 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:31.923189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:31.924061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:31.924811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 60/121] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:31.925421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71b814-1e92-41ac-8190-970e97b21601 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:31.926279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa6cae-4fb5-4217-989d-22b436ea7387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:31.927396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa6cae-4fb5-4217-989d-22b436ea7387 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:31.927818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa6cae-4fb5-4217-989d-22b436ea7387 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:31.928212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa6cae-4fb5-4217-989d-22b436ea7387 None admin] PATH_INFO: `/v3/users/bfcb42b66d894bf19c19d3ce4885a45f` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:31.930138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa6cae-4fb5-4217-989d-22b436ea7387 None admin] RBAC: Authorizing `identity:get_user(user_id=bfcb42b66d894bf19c19d3ce4885a45f)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:31.931769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa6cae-4fb5-4217-989d-22b436ea7387 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:31.933550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 62/122] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:31 2022] GET /identity/v3/users/bfcb42b66d894bf19c19d3ce4885a45f => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:31.934203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa6cae-4fb5-4217-989d-22b436ea7387 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.034614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71b814-1e92-41ac-8190-970e97b21601 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:32.047944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa6cae-4fb5-4217-989d-22b436ea7387 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:32.068549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a1666-522b-4906-8bff-6a97bcae9ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:32.069094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a1666-522b-4906-8bff-6a97bcae9ae4 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:32.069389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a1666-522b-4906-8bff-6a97bcae9ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:32.069664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a1666-522b-4906-8bff-6a97bcae9ae4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:32.080442 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a1666-522b-4906-8bff-6a97bcae9ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:32.083573 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28658a-a16b-40db-8bad-6100025d690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:32.084621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28658a-a16b-40db-8bad-6100025d690e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:32.085051 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28658a-a16b-40db-8bad-6100025d690e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:32.085461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28658a-a16b-40db-8bad-6100025d690e None admin] PATH_INFO: `/v3/users/c6575f98944f45c9b548f4d71e618a09` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-689a1666-522b-4906-8bff-6a97bcae9ae4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:32.089411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:32.090458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:32.091408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 61/123] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:32:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:32.095161 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a1666-522b-4906-8bff-6a97bcae9ae4 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.103774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28658a-a16b-40db-8bad-6100025d690e None admin] RBAC: Authorizing `identity:get_user(user_id=c6575f98944f45c9b548f4d71e618a09)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:32.105541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28658a-a16b-40db-8bad-6100025d690e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:32.107462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 63/124] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:31 2022] GET /identity/v3/users/c6575f98944f45c9b548f4d71e618a09 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:32.108361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28658a-a16b-40db-8bad-6100025d690e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.207118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28658a-a16b-40db-8bad-6100025d690e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:32.209946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a1666-522b-4906-8bff-6a97bcae9ae4 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:32.241029 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d0b2-272a-47c2-ae66-df37b244c2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:32.241829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d0b2-272a-47c2-ae66-df37b244c2ef None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:32.242110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d0b2-272a-47c2-ae66-df37b244c2ef None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:32.242414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5d0b2-272a-47c2-ae66-df37b244c2ef None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:32.243616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5d0b2-272a-47c2-ae66-df37b244c2ef None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:32.244641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733244d-8a55-4ffe-aaed-bebc183d7548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:32.245365 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733244d-8a55-4ffe-aaed-bebc183d7548 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:32.245685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5d0b2-272a-47c2-ae66-df37b244c2ef None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:32.245781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733244d-8a55-4ffe-aaed-bebc183d7548 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:32.245975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733244d-8a55-4ffe-aaed-bebc183d7548 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:32.246761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733244d-8a55-4ffe-aaed-bebc183d7548 None admin] RBAC: Adding query filter params (name=member) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:32.247069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733244d-8a55-4ffe-aaed-bebc183d7548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:32.247570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 64/125] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:32 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:32.248170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d0b2-272a-47c2-ae66-df37b244c2ef None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.248515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733244d-8a55-4ffe-aaed-bebc183d7548 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:32.257542 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 62/126] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:32.258234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733244d-8a55-4ffe-aaed-bebc183d7548 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.346779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5d0b2-272a-47c2-ae66-df37b244c2ef None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:32.357566 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733244d-8a55-4ffe-aaed-bebc183d7548 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:32.380709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc2723-e785-46fa-95c3-d4c1f9b6146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:32.381382 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc2723-e785-46fa-95c3-d4c1f9b6146a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:32.381663 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc2723-e785-46fa-95c3-d4c1f9b6146a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:32.381936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc2723-e785-46fa-95c3-d4c1f9b6146a None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:32.382717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc2723-e785-46fa-95c3-d4c1f9b6146a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:32.383021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc2723-e785-46fa-95c3-d4c1f9b6146a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:32.384394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc2723-e785-46fa-95c3-d4c1f9b6146a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:32.391330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f04ad-c87a-419f-9af8-c893f966899e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:32.391984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f04ad-c87a-419f-9af8-c893f966899e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:32.392267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f04ad-c87a-419f-9af8-c893f966899e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:32.392542 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f04ad-c87a-419f-9af8-c893f966899e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:32.393527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 65/127] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:32.394152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc2723-e785-46fa-95c3-d4c1f9b6146a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.461679 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f04ad-c87a-419f-9af8-c893f966899e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:32.463234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f04ad-c87a-419f-9af8-c893f966899e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:32.497743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc2723-e785-46fa-95c3-d4c1f9b6146a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:32.531107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b25fee-38ea-464e-986a-192da9612e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:32.532000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25fee-38ea-464e-986a-192da9612e8c None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:32.532283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25fee-38ea-464e-986a-192da9612e8c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:32.532557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b25fee-38ea-464e-986a-192da9612e8c None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74/users/bfcb42b66d894bf19c19d3ce4885a45f/roles/97f5bd452f314fa093a222f49facdac7` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:32.534819 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25fee-38ea-464e-986a-192da9612e8c None admin] RBAC: Authorizing `identity:create_grant(project_id=235c60e5703c440590e4c72e2d095f74, user_id=bfcb42b66d894bf19c19d3ce4885a45f, role_id=97f5bd452f314fa093a222f49facdac7)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:32.536254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b25fee-38ea-464e-986a-192da9612e8c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:32.553082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 66/128] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:32:32 2022] PUT /identity/v3/projects/235c60e5703c440590e4c72e2d095f74/users/bfcb42b66d894bf19c19d3ce4885a45f/roles/97f5bd452f314fa093a222f49facdac7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:32:32.554000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b25fee-38ea-464e-986a-192da9612e8c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.563375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 63/129] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:32.564325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f04ad-c87a-419f-9af8-c893f966899e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.664803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b25fee-38ea-464e-986a-192da9612e8c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:32.668722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f04ad-c87a-419f-9af8-c893f966899e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:32.699733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf91702-bb17-4a7f-8010-103859e0a9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:32.700617 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91702-bb17-4a7f-8010-103859e0a9e6 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:32.700903 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91702-bb17-4a7f-8010-103859e0a9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:32.701162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf91702-bb17-4a7f-8010-103859e0a9e6 None admin] PATH_INFO: `/v3/users/bfcb42b66d894bf19c19d3ce4885a45f` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:32.702404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf91702-bb17-4a7f-8010-103859e0a9e6 None admin] RBAC: Authorizing `identity:get_user(user_id=bfcb42b66d894bf19c19d3ce4885a45f)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:32.703858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf91702-bb17-4a7f-8010-103859e0a9e6 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:32.704151 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b0fc4-13da-4c7a-8cae-1627880aa6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:32.705045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b0fc4-13da-4c7a-8cae-1627880aa6fa None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:32.705327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b0fc4-13da-4c7a-8cae-1627880aa6fa None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:32.705512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 67/130] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:32 2022] GET /identity/v3/users/bfcb42b66d894bf19c19d3ce4885a45f => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:32.705661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b0fc4-13da-4c7a-8cae-1627880aa6fa None admin] PATH_INFO: `/v3/users/a7162b13b2c54f8cadf583b1df8219b5` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:32.706297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf91702-bb17-4a7f-8010-103859e0a9e6 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.707036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b0fc4-13da-4c7a-8cae-1627880aa6fa None admin] RBAC: Authorizing `identity:get_user(user_id=a7162b13b2c54f8cadf583b1df8219b5)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:32.708563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b0fc4-13da-4c7a-8cae-1627880aa6fa None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:32.710233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 64/131] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:32 2022] GET /identity/v3/users/a7162b13b2c54f8cadf583b1df8219b5 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:32.711036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b0fc4-13da-4c7a-8cae-1627880aa6fa None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.811083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf91702-bb17-4a7f-8010-103859e0a9e6 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:32.820241 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b0fc4-13da-4c7a-8cae-1627880aa6fa None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:32.863613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d7deb-2510-46c2-8275-ac0ef0467d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:32.864007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35084966-0a24-4149-8ed2-db3efdc4953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:32.864503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7deb-2510-46c2-8275-ac0ef0467d17 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:32.864788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7deb-2510-46c2-8275-ac0ef0467d17 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:32.864888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35084966-0a24-4149-8ed2-db3efdc4953f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:32.865063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7deb-2510-46c2-8275-ac0ef0467d17 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:32.865155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35084966-0a24-4149-8ed2-db3efdc4953f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:32.865406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35084966-0a24-4149-8ed2-db3efdc4953f None admin] PATH_INFO: `/v3/projects/1b556f29749b4ba3a0402cbe066721a3` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:32.866661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35084966-0a24-4149-8ed2-db3efdc4953f None admin] RBAC: Authorizing `identity:get_project(project_id=1b556f29749b4ba3a0402cbe066721a3)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:32.868118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35084966-0a24-4149-8ed2-db3efdc4953f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:32.869990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 65/132] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:32 2022] GET /identity/v3/projects/1b556f29749b4ba3a0402cbe066721a3 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:32.870773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35084966-0a24-4149-8ed2-db3efdc4953f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.870888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d7deb-2510-46c2-8275-ac0ef0467d17 None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:32.872525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d7deb-2510-46c2-8275-ac0ef0467d17 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:32.874028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 68/133] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:32 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:32.875832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d7deb-2510-46c2-8275-ac0ef0467d17 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:32.990960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35084966-0a24-4149-8ed2-db3efdc4953f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:33.002283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d7deb-2510-46c2-8275-ac0ef0467d17 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:33.026362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6d24-32b5-43f0-8ad1-604ccf8d7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:33.027325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6d24-32b5-43f0-8ad1-604ccf8d7db3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:33.027682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6d24-32b5-43f0-8ad1-604ccf8d7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:33.028030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d6d24-32b5-43f0-8ad1-604ccf8d7db3 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:33.029317 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d6d24-32b5-43f0-8ad1-604ccf8d7db3 None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:33.030910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d6d24-32b5-43f0-8ad1-604ccf8d7db3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:33.032686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 66/134] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:32 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:33.033527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6d24-32b5-43f0-8ad1-604ccf8d7db3 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:33.047452 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb8029-711b-4e11-bb93-ea57b4133328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:33.048635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb8029-711b-4e11-bb93-ea57b4133328 None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:33.049090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb8029-711b-4e11-bb93-ea57b4133328 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:33.049533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb8029-711b-4e11-bb93-ea57b4133328 None admin] PATH_INFO: `/v3/projects/1b556f29749b4ba3a0402cbe066721a3/users/bfcb42b66d894bf19c19d3ce4885a45f/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:33.057189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb8029-711b-4e11-bb93-ea57b4133328 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b556f29749b4ba3a0402cbe066721a3, user_id=bfcb42b66d894bf19c19d3ce4885a45f, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:33.060510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb8029-711b-4e11-bb93-ea57b4133328 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:33.084617 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 69/135] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:32:32 2022] PUT /identity/v3/projects/1b556f29749b4ba3a0402cbe066721a3/users/bfcb42b66d894bf19c19d3ce4885a45f/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:32:33.087111 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb8029-711b-4e11-bb93-ea57b4133328 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:33.207916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d6d24-32b5-43f0-8ad1-604ccf8d7db3 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:33.231094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb8029-711b-4e11-bb93-ea57b4133328 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:33.245131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79d93b-1717-48f9-b5cb-613ccef3b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:33.246529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d93b-1717-48f9-b5cb-613ccef3b485 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:33.247013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d93b-1717-48f9-b5cb-613ccef3b485 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:33.247500 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79d93b-1717-48f9-b5cb-613ccef3b485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:33.248536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79d93b-1717-48f9-b5cb-613ccef3b485 None admin] RBAC: Adding query filter params (role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be, scope.project.id=235c60e5703c440590e4c72e2d095f74, user.id=c6575f98944f45c9b548f4d71e618a09) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:33.249165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79d93b-1717-48f9-b5cb-613ccef3b485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:33.250843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79d93b-1717-48f9-b5cb-613ccef3b485 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:33.256764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 67/136] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:33 2022] GET /identity/v3/role_assignments?user.id=c6575f98944f45c9b548f4d71e618a09&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:33.277790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7106ebd-6096-4627-bb1a-d854ad94d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:33.278791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7106ebd-6096-4627-bb1a-d854ad94d920 None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:33.279082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7106ebd-6096-4627-bb1a-d854ad94d920 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:33.279393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7106ebd-6096-4627-bb1a-d854ad94d920 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74/users/a7162b13b2c54f8cadf583b1df8219b5/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:33.288062 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7106ebd-6096-4627-bb1a-d854ad94d920 None admin] RBAC: Authorizing `identity:create_grant(project_id=235c60e5703c440590e4c72e2d095f74, user_id=a7162b13b2c54f8cadf583b1df8219b5, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:33.289550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7106ebd-6096-4627-bb1a-d854ad94d920 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:33.319806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 70/137] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:32:33 2022] PUT /identity/v3/projects/235c60e5703c440590e4c72e2d095f74/users/a7162b13b2c54f8cadf583b1df8219b5/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:32:34.692403 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8f9eb-8d94-43e4-b06b-e31cc9aa1358 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:34.693426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8f9eb-8d94-43e4-b06b-e31cc9aa1358 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:34.693912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8f9eb-8d94-43e4-b06b-e31cc9aa1358 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:34.695508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 68/138] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:34.701976 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b19e4d-05f8-4230-85a7-5787877daee3 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:34.702435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b19e4d-05f8-4230-85a7-5787877daee3 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:34.702629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b19e4d-05f8-4230-85a7-5787877daee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:34.724092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c0b19e4d-05f8-4230-85a7-5787877daee3 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:34.725283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c0b19e4d-05f8-4230-85a7-5787877daee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:34.746482 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83014294-9c61-4b33-99ea-77fd4662b9dc None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:34.746767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83014294-9c61-4b33-99ea-77fd4662b9dc None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:34.747046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83014294-9c61-4b33-99ea-77fd4662b9dc None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:34.748414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 69/139] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:32:34.762205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491aca6-fb01-4b7c-85db-b270e53e7126 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:34.762509 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491aca6-fb01-4b7c-85db-b270e53e7126 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:34.762792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491aca6-fb01-4b7c-85db-b270e53e7126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:34.787160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-a491aca6-fb01-4b7c-85db-b270e53e7126 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:34.788380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a491aca6-fb01-4b7c-85db-b270e53e7126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:34.855416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 71/140] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:34.901540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b19e4d-05f8-4230-85a7-5787877daee3 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:35.000058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 70/141] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:35.038704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491aca6-fb01-4b7c-85db-b270e53e7126 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:35.052303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b19e4d-05f8-4230-85a7-5787877daee3 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:35.089603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2bbc0-95fc-452a-9b8a-4a718edf454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:35.090438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2bbc0-95fc-452a-9b8a-4a718edf454b None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:35.090764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2bbc0-95fc-452a-9b8a-4a718edf454b None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:35.091044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2bbc0-95fc-452a-9b8a-4a718edf454b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:35.102429 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2bbc0-95fc-452a-9b8a-4a718edf454b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-2ea2bbc0-95fc-452a-9b8a-4a718edf454b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:35.110975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:35.111822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:35.112580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 72/142] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:32:35.120090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2bbc0-95fc-452a-9b8a-4a718edf454b None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:35.231256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2bbc0-95fc-452a-9b8a-4a718edf454b None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:35.268451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b8d97-2034-48c6-a2fa-09a9ceb65b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:35.269048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b8d97-2034-48c6-a2fa-09a9ceb65b4f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:35.269331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b8d97-2034-48c6-a2fa-09a9ceb65b4f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:35.269608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b8d97-2034-48c6-a2fa-09a9ceb65b4f None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:35.270377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b8d97-2034-48c6-a2fa-09a9ceb65b4f None admin] RBAC: Adding query filter params (name=member) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:35.270687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b8d97-2034-48c6-a2fa-09a9ceb65b4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:35.272726 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b8d97-2034-48c6-a2fa-09a9ceb65b4f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:35.282841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 73/143] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:35.288169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b8d97-2034-48c6-a2fa-09a9ceb65b4f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:35.294503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491aca6-fb01-4b7c-85db-b270e53e7126 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:35.384382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf3ffd-6b7c-49e8-927d-8c93e16a70b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:35.385832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf3ffd-6b7c-49e8-927d-8c93e16a70b2 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:35.386115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf3ffd-6b7c-49e8-927d-8c93e16a70b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:35.386407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf3ffd-6b7c-49e8-927d-8c93e16a70b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:35.391039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf3ffd-6b7c-49e8-927d-8c93e16a70b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:35.392693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf3ffd-6b7c-49e8-927d-8c93e16a70b2 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:35.394668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 71/144] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:35.399762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf3ffd-6b7c-49e8-927d-8c93e16a70b2 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:35.461292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b8d97-2034-48c6-a2fa-09a9ceb65b4f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:35.513956 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06e894-1840-4e67-bc59-80f4f447fffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:35.515554 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e894-1840-4e67-bc59-80f4f447fffa None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:35.516042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e894-1840-4e67-bc59-80f4f447fffa None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:35.516518 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06e894-1840-4e67-bc59-80f4f447fffa None admin] PATH_INFO: `/v3/users/bfcb42b66d894bf19c19d3ce4885a45f` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:35.518052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06e894-1840-4e67-bc59-80f4f447fffa None admin] RBAC: Authorizing `identity:get_user(user_id=bfcb42b66d894bf19c19d3ce4885a45f)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:35.520673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc06e894-1840-4e67-bc59-80f4f447fffa None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:35.523587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 74/145] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:35 2022] GET /identity/v3/users/bfcb42b66d894bf19c19d3ce4885a45f => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:35.531654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06e894-1840-4e67-bc59-80f4f447fffa None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:35.596592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf3ffd-6b7c-49e8-927d-8c93e16a70b2 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:35.672867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be0d3d-96ba-4ea1-8b08-73b8488a9903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:35.673548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be0d3d-96ba-4ea1-8b08-73b8488a9903 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:35.673830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be0d3d-96ba-4ea1-8b08-73b8488a9903 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:35.674106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be0d3d-96ba-4ea1-8b08-73b8488a9903 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:35.674865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be0d3d-96ba-4ea1-8b08-73b8488a9903 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:35.676307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be0d3d-96ba-4ea1-8b08-73b8488a9903 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:35.710000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc06e894-1840-4e67-bc59-80f4f447fffa None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:35.713532 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 72/146] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:32:35 2022] POST /identity/v3/users => generated 283 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:32:35.769998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f4ad-9bc5-4ec2-923f-1a8909359599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:35.770835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f4ad-9bc5-4ec2-923f-1a8909359599 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:35.771066 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f4ad-9bc5-4ec2-923f-1a8909359599 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:35.771346 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418f4ad-9bc5-4ec2-923f-1a8909359599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:35.799765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0379ac7-b2bf-4179-a8a0-5957821b299b None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:35.800047 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0379ac7-b2bf-4179-a8a0-5957821b299b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:35.800486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0379ac7-b2bf-4179-a8a0-5957821b299b None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:35.802243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 73/147] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:35.807978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcb516-d5b4-486c-8e3a-d6ae6ed1399d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:35.808494 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcb516-d5b4-486c-8e3a-d6ae6ed1399d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:35.808942 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcb516-d5b4-486c-8e3a-d6ae6ed1399d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:35.845585 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418f4ad-9bc5-4ec2-923f-1a8909359599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:35.846954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-25fcb516-d5b4-486c-8e3a-d6ae6ed1399d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:35.847145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418f4ad-9bc5-4ec2-923f-1a8909359599 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:35.848190 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-25fcb516-d5b4-486c-8e3a-d6ae6ed1399d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:35.953114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 74/149] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:35.954214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 75/149] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:35.957913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcb516-d5b4-486c-8e3a-d6ae6ed1399d None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:35.990877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f4ad-9bc5-4ec2-923f-1a8909359599 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:36.101487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcb516-d5b4-486c-8e3a-d6ae6ed1399d None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:36.158206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418f4ad-9bc5-4ec2-923f-1a8909359599 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:36.185778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3f779-2839-4030-868f-dbabc142fbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:36.186684 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f779-2839-4030-868f-dbabc142fbff None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.186969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f779-2839-4030-868f-dbabc142fbff None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.187247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f779-2839-4030-868f-dbabc142fbff None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.188447 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3f779-2839-4030-868f-dbabc142fbff None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:36.190031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3f779-2839-4030-868f-dbabc142fbff None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:36.195864 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2815-b9cc-4cf3-9bb3-6f84c59470b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:36.196283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 75/150] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:35 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:36.201989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2815-b9cc-4cf3-9bb3-6f84c59470b5 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.202332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2815-b9cc-4cf3-9bb3-6f84c59470b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.202581 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2815-b9cc-4cf3-9bb3-6f84c59470b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.204344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3f779-2839-4030-868f-dbabc142fbff None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:36.216419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c2815-b9cc-4cf3-9bb3-6f84c59470b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-1b9c2815-b9cc-4cf3-9bb3-6f84c59470b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:36.229834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:36.230755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:36.231505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:36.236936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 76/151] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:32:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:36.238364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2815-b9cc-4cf3-9bb3-6f84c59470b5 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:36.362786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3f779-2839-4030-868f-dbabc142fbff None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:36.424304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb03f9-0f17-4731-aa34-0a1d44ec37e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:36.425361 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb03f9-0f17-4731-aa34-0a1d44ec37e0 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.426517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb03f9-0f17-4731-aa34-0a1d44ec37e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.427012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb03f9-0f17-4731-aa34-0a1d44ec37e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.428892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb03f9-0f17-4731-aa34-0a1d44ec37e0 None admin] RBAC: Adding query filter params (role.id=15a2a347c19845c9ac397da513eb944a, scope.project.id=235c60e5703c440590e4c72e2d095f74, user.id=bfcb42b66d894bf19c19d3ce4885a45f) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:36.429810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb03f9-0f17-4731-aa34-0a1d44ec37e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:36.432816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb03f9-0f17-4731-aa34-0a1d44ec37e0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:36.439108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2815-b9cc-4cf3-9bb3-6f84c59470b5 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:36.448215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 76/152] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:36 2022] GET /identity/v3/role_assignments?user.id=bfcb42b66d894bf19c19d3ce4885a45f&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=15a2a347c19845c9ac397da513eb944a => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:36.478695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf5ca4-2f34-43d7-97b2-43f4b9a35678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:36.479423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5ca4-2f34-43d7-97b2-43f4b9a35678 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.479712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5ca4-2f34-43d7-97b2-43f4b9a35678 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.479989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf5ca4-2f34-43d7-97b2-43f4b9a35678 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.480753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf5ca4-2f34-43d7-97b2-43f4b9a35678 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:36.481058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf5ca4-2f34-43d7-97b2-43f4b9a35678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:36.481685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef66af-a9d2-47a7-8b67-6127ee5ad21a None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.482198 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef66af-a9d2-47a7-8b67-6127ee5ad21a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.482559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf5ca4-2f34-43d7-97b2-43f4b9a35678 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:36.482929 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef66af-a9d2-47a7-8b67-6127ee5ad21a None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.484889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 77/153] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:36.495808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 77/154] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:32:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:36.500845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea4c6e-b905-414e-b19a-0b9b4e02b1de None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.501479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea4c6e-b905-414e-b19a-0b9b4e02b1de None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.501958 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea4c6e-b905-414e-b19a-0b9b4e02b1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.507455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf5ca4-2f34-43d7-97b2-43f4b9a35678 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:36.524853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-78ea4c6e-b905-414e-b19a-0b9b4e02b1de None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:36.527274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-78ea4c6e-b905-414e-b19a-0b9b4e02b1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:36.622953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 78/155] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:36.663676 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea4c6e-b905-414e-b19a-0b9b4e02b1de None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:36.701913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf5ca4-2f34-43d7-97b2-43f4b9a35678 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:36.764390 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af045b-c397-409b-a2c6-ccc7486cab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:36.765027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af045b-c397-409b-a2c6-ccc7486cab7d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.765256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af045b-c397-409b-a2c6-ccc7486cab7d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.765524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af045b-c397-409b-a2c6-ccc7486cab7d None admin] PATH_INFO: `/v3/users/bfcb42b66d894bf19c19d3ce4885a45f` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.766806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af045b-c397-409b-a2c6-ccc7486cab7d None admin] RBAC: Authorizing `identity:get_user(user_id=bfcb42b66d894bf19c19d3ce4885a45f)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:36.768257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af045b-c397-409b-a2c6-ccc7486cab7d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:36.769914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 78/156] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:36 2022] GET /identity/v3/users/bfcb42b66d894bf19c19d3ce4885a45f => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:36.772003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5d5b-d3f5-4832-9e35-04785d097e20 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.772287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5d5b-d3f5-4832-9e35-04785d097e20 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.772565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5d5b-d3f5-4832-9e35-04785d097e20 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.773822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 79/157] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:36.779225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e5d5b-d3f5-4832-9e35-04785d097e20 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:36.811374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea4c6e-b905-414e-b19a-0b9b4e02b1de None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:36.852004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7945f-e2fb-4fc9-8925-40400dffc040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:36.852819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7945f-e2fb-4fc9-8925-40400dffc040 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.853511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7945f-e2fb-4fc9-8925-40400dffc040 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.853511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7945f-e2fb-4fc9-8925-40400dffc040 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.874590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7945f-e2fb-4fc9-8925-40400dffc040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:36.886856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e5d5b-d3f5-4832-9e35-04785d097e20 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-02f7945f-e2fb-4fc9-8925-40400dffc040 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:36.887718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:36.888538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:36.889285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:36.890440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 79/158] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:32:36.892312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a692eb-c1cf-454c-ac30-66b73494896e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.892680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a692eb-c1cf-454c-ac30-66b73494896e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.892960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a692eb-c1cf-454c-ac30-66b73494896e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.910938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-a0a692eb-c1cf-454c-ac30-66b73494896e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:36.912267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a0a692eb-c1cf-454c-ac30-66b73494896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:36.922823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b4ab4-8b42-4584-a98b-eabb85738c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:36.923507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b4ab4-8b42-4584-a98b-eabb85738c14 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.923791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b4ab4-8b42-4584-a98b-eabb85738c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.924122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b4ab4-8b42-4584-a98b-eabb85738c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.992053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 80/159] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:36.993501 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8b868-6e9b-4772-b29b-1fe7645bf623 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:36.993844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8b868-6e9b-4772-b29b-1fe7645bf623 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:36.994127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8b868-6e9b-4772-b29b-1fe7645bf623 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:36.995657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 81/160] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:36.996284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8b868-6e9b-4772-b29b-1fe7645bf623 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:36.996895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b4ab4-8b42-4584-a98b-eabb85738c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:36.998119 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b4ab4-8b42-4584-a98b-eabb85738c14 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:37.108506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 80/161] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:37.110166 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fd7bc-d3b9-41a8-8c79-192384b613e6 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:37.110698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fd7bc-d3b9-41a8-8c79-192384b613e6 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:37.111165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fd7bc-d3b9-41a8-8c79-192384b613e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:37.112476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8b868-6e9b-4772-b29b-1fe7645bf623 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:37.129471 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-095fd7bc-d3b9-41a8-8c79-192384b613e6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:37.130997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-095fd7bc-d3b9-41a8-8c79-192384b613e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:37.153664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049b2ec-d654-4956-86a1-aa2900ba38b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:37.154480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049b2ec-d654-4956-86a1-aa2900ba38b2 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:37.154830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049b2ec-d654-4956-86a1-aa2900ba38b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:37.155262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049b2ec-d654-4956-86a1-aa2900ba38b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:37.156319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049b2ec-d654-4956-86a1-aa2900ba38b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:37.156621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049b2ec-d654-4956-86a1-aa2900ba38b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:37.159569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049b2ec-d654-4956-86a1-aa2900ba38b2 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:37.170575 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 82/162] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:37.174337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049b2ec-d654-4956-86a1-aa2900ba38b2 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:37.206681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 81/163] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:37.208274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fd7bc-d3b9-41a8-8c79-192384b613e6 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:37.338476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049b2ec-d654-4956-86a1-aa2900ba38b2 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:37.339745 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fd7bc-d3b9-41a8-8c79-192384b613e6 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:37.380173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f29bdd-a6db-441e-b39b-d48d633c9f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:37.380890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29bdd-a6db-441e-b39b-d48d633c9f42 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:37.381174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29bdd-a6db-441e-b39b-d48d633c9f42 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:37.381455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f29bdd-a6db-441e-b39b-d48d633c9f42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:37.387939 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96555920-037a-4085-a846-aa9a907da9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:37.388802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555920-037a-4085-a846-aa9a907da9a6 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:37.389133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555920-037a-4085-a846-aa9a907da9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:37.389409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96555920-037a-4085-a846-aa9a907da9a6 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:37.390821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96555920-037a-4085-a846-aa9a907da9a6 None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:37.392284 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96555920-037a-4085-a846-aa9a907da9a6 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:37.395104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 82/164] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:37 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:37.395877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96555920-037a-4085-a846-aa9a907da9a6 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:37.414143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f29bdd-a6db-441e-b39b-d48d633c9f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-e1f29bdd-a6db-441e-b39b-d48d633c9f42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:37.423257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:37.424150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:37.424995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 83/165] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:37.425612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f29bdd-a6db-441e-b39b-d48d633c9f42 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:37.549775 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f29bdd-a6db-441e-b39b-d48d633c9f42 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:37.594256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96555920-037a-4085-a846-aa9a907da9a6 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:37.604252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6aebca-31d5-4acd-beca-d8139c7e413b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:37.605375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aebca-31d5-4acd-beca-d8139c7e413b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:37.605847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aebca-31d5-4acd-beca-d8139c7e413b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:37.606326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aebca-31d5-4acd-beca-d8139c7e413b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:37.622504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6aebca-31d5-4acd-beca-d8139c7e413b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-4f6aebca-31d5-4acd-beca-d8139c7e413b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:37.632106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:37.633007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:37.633778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:37.641506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 84/166] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:37.643550 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6aebca-31d5-4acd-beca-d8139c7e413b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:37.668280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5fc5-3d23-4722-8dea-fb4a18008ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:37.669482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5fc5-3d23-4722-8dea-fb4a18008ad0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:37.669983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5fc5-3d23-4722-8dea-fb4a18008ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:37.670490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d5fc5-3d23-4722-8dea-fb4a18008ad0 None admin] PATH_INFO: `/v3/users/c6575f98944f45c9b548f4d71e618a09` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:37.672593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d5fc5-3d23-4722-8dea-fb4a18008ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=c6575f98944f45c9b548f4d71e618a09)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:37.674216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d5fc5-3d23-4722-8dea-fb4a18008ad0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:37.676200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 83/167] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:37 2022] GET /identity/v3/users/c6575f98944f45c9b548f4d71e618a09 => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:37.677381 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5fc5-3d23-4722-8dea-fb4a18008ad0 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:37.797804 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6aebca-31d5-4acd-beca-d8139c7e413b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:37.840385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326ae4b-937e-430b-9d0f-82ace06146d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:37.841697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ae4b-937e-430b-9d0f-82ace06146d3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:37.842207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ae4b-937e-430b-9d0f-82ace06146d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:37.842696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ae4b-937e-430b-9d0f-82ace06146d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:37.843723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326ae4b-937e-430b-9d0f-82ace06146d3 None admin] RBAC: Adding query filter params (role.id=97f5bd452f314fa093a222f49facdac7, scope.project.id=235c60e5703c440590e4c72e2d095f74, user.id=bfcb42b66d894bf19c19d3ce4885a45f) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:37.844223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326ae4b-937e-430b-9d0f-82ace06146d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:37.845881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3326ae4b-937e-430b-9d0f-82ace06146d3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:37.854481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d5fc5-3d23-4722-8dea-fb4a18008ad0 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:37.861874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 85/168] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:37 2022] GET /identity/v3/role_assignments?user.id=bfcb42b66d894bf19c19d3ce4885a45f&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=97f5bd452f314fa093a222f49facdac7 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:37.863021 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326ae4b-937e-430b-9d0f-82ace06146d3 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:37.895901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abcc40-b547-4862-9081-14ddccce5971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:37.896511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abcc40-b547-4862-9081-14ddccce5971 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:37.896795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abcc40-b547-4862-9081-14ddccce5971 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:37.897072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abcc40-b547-4862-9081-14ddccce5971 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:37.897847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abcc40-b547-4862-9081-14ddccce5971 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:37.898154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abcc40-b547-4862-9081-14ddccce5971 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:37.899616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abcc40-b547-4862-9081-14ddccce5971 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:37.917270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 84/169] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:37.918139 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abcc40-b547-4862-9081-14ddccce5971 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:38.042791 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326ae4b-937e-430b-9d0f-82ace06146d3 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:38.106226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abcc40-b547-4862-9081-14ddccce5971 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:38.111039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35826eb-891d-453b-badc-b2424a669960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:38.112013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35826eb-891d-453b-badc-b2424a669960 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:38.112494 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35826eb-891d-453b-badc-b2424a669960 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:38.112953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35826eb-891d-453b-badc-b2424a669960 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:38.113907 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35826eb-891d-453b-badc-b2424a669960 None admin] RBAC: Adding query filter params (name=member) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:38.114655 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35826eb-891d-453b-badc-b2424a669960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:38.116280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35826eb-891d-453b-badc-b2424a669960 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:38.130335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 86/170] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:38.131541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35826eb-891d-453b-badc-b2424a669960 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:38.145701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b5ced-ef29-40d0-8abf-0dff1cc69b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:38.146650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b5ced-ef29-40d0-8abf-0dff1cc69b3b None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:38.146871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b5ced-ef29-40d0-8abf-0dff1cc69b3b None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:38.147435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b5ced-ef29-40d0-8abf-0dff1cc69b3b None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:38.148336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b5ced-ef29-40d0-8abf-0dff1cc69b3b None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:38.149790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b5ced-ef29-40d0-8abf-0dff1cc69b3b None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:38.152855 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 85/171] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:37 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:38.153444 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b5ced-ef29-40d0-8abf-0dff1cc69b3b None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:38.259451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b5ced-ef29-40d0-8abf-0dff1cc69b3b None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:38.295254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c0b3d-1c8d-4927-9667-11ee945b9fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:38.296133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c0b3d-1c8d-4927-9667-11ee945b9fd9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:38.296413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c0b3d-1c8d-4927-9667-11ee945b9fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:38.296687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c0b3d-1c8d-4927-9667-11ee945b9fd9 None admin] PATH_INFO: `/v3/users/bfcb42b66d894bf19c19d3ce4885a45f` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:38.297894 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c0b3d-1c8d-4927-9667-11ee945b9fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=bfcb42b66d894bf19c19d3ce4885a45f)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:38.299383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c0b3d-1c8d-4927-9667-11ee945b9fd9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:38.301184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 86/172] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:38 2022] GET /identity/v3/users/bfcb42b66d894bf19c19d3ce4885a45f => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:38.301754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c0b3d-1c8d-4927-9667-11ee945b9fd9 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:38.327829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35826eb-891d-453b-badc-b2424a669960 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:38.388027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738ec8e-4433-4fd6-a4c1-4cb9f2dc5f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:38.389305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738ec8e-4433-4fd6-a4c1-4cb9f2dc5f63 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:38.389832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738ec8e-4433-4fd6-a4c1-4cb9f2dc5f63 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:38.390294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738ec8e-4433-4fd6-a4c1-4cb9f2dc5f63 None admin] PATH_INFO: `/v3/users/a7162b13b2c54f8cadf583b1df8219b5` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:38.395133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738ec8e-4433-4fd6-a4c1-4cb9f2dc5f63 None admin] RBAC: Authorizing `identity:get_user(user_id=a7162b13b2c54f8cadf583b1df8219b5)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:38.396937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738ec8e-4433-4fd6-a4c1-4cb9f2dc5f63 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:38.398905 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 87/173] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:38 2022] GET /identity/v3/users/a7162b13b2c54f8cadf583b1df8219b5 => generated 247 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:38.399861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738ec8e-4433-4fd6-a4c1-4cb9f2dc5f63 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:38.404178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c0b3d-1c8d-4927-9667-11ee945b9fd9 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:38.438879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1a06d-1f3b-45a3-822c-44b62c249a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:38.439772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a06d-1f3b-45a3-822c-44b62c249a6e None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:38.440053 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a06d-1f3b-45a3-822c-44b62c249a6e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:38.440329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a06d-1f3b-45a3-822c-44b62c249a6e None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74/users/c6575f98944f45c9b548f4d71e618a09/roles/ff4f4562c9e74c8aa9b5c5b9739ee3be` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:38.442339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1a06d-1f3b-45a3-822c-44b62c249a6e None admin] RBAC: Authorizing `identity:create_grant(project_id=235c60e5703c440590e4c72e2d095f74, user_id=c6575f98944f45c9b548f4d71e618a09, role_id=ff4f4562c9e74c8aa9b5c5b9739ee3be)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:38.443803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e1a06d-1f3b-45a3-822c-44b62c249a6e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:38.463210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 87/174] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:32:38 2022] PUT /identity/v3/projects/235c60e5703c440590e4c72e2d095f74/users/c6575f98944f45c9b548f4d71e618a09/roles/ff4f4562c9e74c8aa9b5c5b9739ee3be => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:32:38.465963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1a06d-1f3b-45a3-822c-44b62c249a6e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:38.566707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738ec8e-4433-4fd6-a4c1-4cb9f2dc5f63 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:38.609894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5778f7-c21e-43a4-90d4-d651cf06a647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:38.611192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5778f7-c21e-43a4-90d4-d651cf06a647 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:38.611476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5778f7-c21e-43a4-90d4-d651cf06a647 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:38.611963 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5778f7-c21e-43a4-90d4-d651cf06a647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:38.685367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1a06d-1f3b-45a3-822c-44b62c249a6e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:38.699973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5778f7-c21e-43a4-90d4-d651cf06a647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:38.701473 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5778f7-c21e-43a4-90d4-d651cf06a647 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:38.739618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f58e2-f3ff-4a4d-b788-7e907b8eff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:38.740279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f58e2-f3ff-4a4d-b788-7e907b8eff7f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:38.740562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f58e2-f3ff-4a4d-b788-7e907b8eff7f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:38.740834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f58e2-f3ff-4a4d-b788-7e907b8eff7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:38.833218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f58e2-f3ff-4a4d-b788-7e907b8eff7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:38.834713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f58e2-f3ff-4a4d-b788-7e907b8eff7f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:38.941874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 88/175] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:38.949810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 88/176] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:38.954264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f58e2-f3ff-4a4d-b788-7e907b8eff7f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:38.968692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5778f7-c21e-43a4-90d4-d651cf06a647 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:39.066552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f58e2-f3ff-4a4d-b788-7e907b8eff7f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:39.104709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e67ad-44c0-4137-afb9-020c93dc8ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:39.105720 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e67ad-44c0-4137-afb9-020c93dc8ed6 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:39.106004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e67ad-44c0-4137-afb9-020c93dc8ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:39.106275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e67ad-44c0-4137-afb9-020c93dc8ed6 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:39.107506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e67ad-44c0-4137-afb9-020c93dc8ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:39.109519 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e67ad-44c0-4137-afb9-020c93dc8ed6 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:39.112171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 89/177] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:38 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:39.119330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e67ad-44c0-4137-afb9-020c93dc8ed6 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:39.149904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5778f7-c21e-43a4-90d4-d651cf06a647 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:39.195142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fa5c8-9f43-4baf-af3e-028900819ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:39.195938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fa5c8-9f43-4baf-af3e-028900819ca4 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:39.196225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fa5c8-9f43-4baf-af3e-028900819ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:39.196503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fa5c8-9f43-4baf-af3e-028900819ca4 None admin] PATH_INFO: `/v3/projects/1b556f29749b4ba3a0402cbe066721a3` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:39.198445 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fa5c8-9f43-4baf-af3e-028900819ca4 None admin] RBAC: Authorizing `identity:get_project(project_id=1b556f29749b4ba3a0402cbe066721a3)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:39.199918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fa5c8-9f43-4baf-af3e-028900819ca4 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:39.203328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 89/178] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:38 2022] GET /identity/v3/projects/1b556f29749b4ba3a0402cbe066721a3 => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:39.220155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fa5c8-9f43-4baf-af3e-028900819ca4 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:39.242464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e67ad-44c0-4137-afb9-020c93dc8ed6 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:39.307316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a56319-bd63-4723-bacd-57ba86cc875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:39.307981 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56319-bd63-4723-bacd-57ba86cc875c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:39.308264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56319-bd63-4723-bacd-57ba86cc875c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:39.308537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a56319-bd63-4723-bacd-57ba86cc875c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:39.309380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a56319-bd63-4723-bacd-57ba86cc875c None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=235c60e5703c440590e4c72e2d095f74, user.id=a7162b13b2c54f8cadf583b1df8219b5) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:39.309682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a56319-bd63-4723-bacd-57ba86cc875c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:39.311163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a56319-bd63-4723-bacd-57ba86cc875c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:39.321781 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 90/179] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:39 2022] GET /identity/v3/role_assignments?user.id=a7162b13b2c54f8cadf583b1df8219b5&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:39.336368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fa5c8-9f43-4baf-af3e-028900819ca4 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:39.389629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0007116-e5c7-4cda-9201-5bd5fcded7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:39.390303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0007116-e5c7-4cda-9201-5bd5fcded7d2 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:39.390606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0007116-e5c7-4cda-9201-5bd5fcded7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:39.390913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0007116-e5c7-4cda-9201-5bd5fcded7d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:39.391735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0007116-e5c7-4cda-9201-5bd5fcded7d2 None admin] RBAC: Adding query filter params (role.id=15a2a347c19845c9ac397da513eb944a, scope.project.id=1b556f29749b4ba3a0402cbe066721a3, user.id=bfcb42b66d894bf19c19d3ce4885a45f) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:39.392041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0007116-e5c7-4cda-9201-5bd5fcded7d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:39.393509 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0007116-e5c7-4cda-9201-5bd5fcded7d2 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:39.404753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 90/180] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:39 2022] GET /identity/v3/role_assignments?user.id=bfcb42b66d894bf19c19d3ce4885a45f&scope.project.id=1b556f29749b4ba3a0402cbe066721a3&role.id=15a2a347c19845c9ac397da513eb944a => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:39.454652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb484-656e-4014-9e85-fda7c6627fa1 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:39.454937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb484-656e-4014-9e85-fda7c6627fa1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:39.455249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdb484-656e-4014-9e85-fda7c6627fa1 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:39.456564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 91/181] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:39.463066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642f65f-1a34-4d0e-b3f1-2f7557993d3b None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:39.463463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642f65f-1a34-4d0e-b3f1-2f7557993d3b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:39.463938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1642f65f-1a34-4d0e-b3f1-2f7557993d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:39.491595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-1642f65f-1a34-4d0e-b3f1-2f7557993d3b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:39.492838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1642f65f-1a34-4d0e-b3f1-2f7557993d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:39.584614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 91/182] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:39.621640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdb484-656e-4014-9e85-fda7c6627fa1 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:39.742889 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdb484-656e-4014-9e85-fda7c6627fa1 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:39.780642 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316db5-d055-4c97-b96a-41d33c03a63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:39.781434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316db5-d055-4c97-b96a-41d33c03a63e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:39.781725 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316db5-d055-4c97-b96a-41d33c03a63e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:39.782081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316db5-d055-4c97-b96a-41d33c03a63e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:39.792469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54316db5-d055-4c97-b96a-41d33c03a63e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-54316db5-d055-4c97-b96a-41d33c03a63e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:39.800331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:39.801208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:39.802011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 92/183] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:39.809558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642f65f-1a34-4d0e-b3f1-2f7557993d3b None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:39.943995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1642f65f-1a34-4d0e-b3f1-2f7557993d3b None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:39.986198 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676cfe7-7ee6-40fc-810c-9da6143ae894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:39.987556 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676cfe7-7ee6-40fc-810c-9da6143ae894 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:39.987980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676cfe7-7ee6-40fc-810c-9da6143ae894 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:39.988393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676cfe7-7ee6-40fc-810c-9da6143ae894 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:39.989313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676cfe7-7ee6-40fc-810c-9da6143ae894 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:39.989756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676cfe7-7ee6-40fc-810c-9da6143ae894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:39.991301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676cfe7-7ee6-40fc-810c-9da6143ae894 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:40.003332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 92/184] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:40.008331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316db5-d055-4c97-b96a-41d33c03a63e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:40.046858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c0d93-a289-4b95-bae3-1aa747f95074 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.047387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c0d93-a289-4b95-bae3-1aa747f95074 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.047813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c0d93-a289-4b95-bae3-1aa747f95074 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.049315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 93/185] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:32:40.054708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd26245-f02b-4de2-b899-ef38c2962f36 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.055127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd26245-f02b-4de2-b899-ef38c2962f36 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.055467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd26245-f02b-4de2-b899-ef38c2962f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.076890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4cd26245-f02b-4de2-b899-ef38c2962f36 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:40.077732 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4cd26245-f02b-4de2-b899-ef38c2962f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:40.137490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316db5-d055-4c97-b96a-41d33c03a63e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:40.147214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 94/186] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:40.154495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dcc58-62fc-43b2-8c3d-72f7985c9e5b None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.154495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dcc58-62fc-43b2-8c3d-72f7985c9e5b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.154495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dcc58-62fc-43b2-8c3d-72f7985c9e5b None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.154495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 95/187] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:40.157956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be24a-f66e-4313-a54e-3be63c91d640 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.158244 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be24a-f66e-4313-a54e-3be63c91d640 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.158550 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941be24a-f66e-4313-a54e-3be63c91d640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.178159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1927311-796d-493e-9029-02d2b728fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:40.179080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927311-796d-493e-9029-02d2b728fd6f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.179360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927311-796d-493e-9029-02d2b728fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.179632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1927311-796d-493e-9029-02d2b728fd6f None admin] PATH_INFO: `/v3/users/d2dd55eb9ee541799b3845e38eb6e2db` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.180593 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-941be24a-f66e-4313-a54e-3be63c91d640 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:40.182369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-941be24a-f66e-4313-a54e-3be63c91d640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:40.194110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1927311-796d-493e-9029-02d2b728fd6f None admin] RBAC: Authorizing `identity:get_user(user_id=d2dd55eb9ee541799b3845e38eb6e2db)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:40.195614 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1927311-796d-493e-9029-02d2b728fd6f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:40.198192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 93/188] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:40 2022] GET /identity/v3/users/d2dd55eb9ee541799b3845e38eb6e2db => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:40.203103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1927311-796d-493e-9029-02d2b728fd6f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:40.247447 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 96/189] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:40.248199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941be24a-f66e-4313-a54e-3be63c91d640 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:40.303661 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1927311-796d-493e-9029-02d2b728fd6f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:40.337593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194cfda-f998-4f75-b628-743b96c8615a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:40.338424 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194cfda-f998-4f75-b628-743b96c8615a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.338712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194cfda-f998-4f75-b628-743b96c8615a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.338983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194cfda-f998-4f75-b628-743b96c8615a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.340158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194cfda-f998-4f75-b628-743b96c8615a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:40.341605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194cfda-f998-4f75-b628-743b96c8615a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:40.343238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 94/190] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:40.348280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194cfda-f998-4f75-b628-743b96c8615a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:40.355364 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941be24a-f66e-4313-a54e-3be63c91d640 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:40.391750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e70532-2f17-407b-9d72-f0b70de2f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:40.392406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e70532-2f17-407b-9d72-f0b70de2f5ff None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.392685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e70532-2f17-407b-9d72-f0b70de2f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.392961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e70532-2f17-407b-9d72-f0b70de2f5ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.447877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194cfda-f998-4f75-b628-743b96c8615a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:40.464239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e70532-2f17-407b-9d72-f0b70de2f5ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:40.465705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e70532-2f17-407b-9d72-f0b70de2f5ff None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:40.483562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bfbfb-bf23-4886-863e-7533d2374eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:40.484369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bfbfb-bf23-4886-863e-7533d2374eb2 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.484646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bfbfb-bf23-4886-863e-7533d2374eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.484915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bfbfb-bf23-4886-863e-7533d2374eb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.495746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bfbfb-bf23-4886-863e-7533d2374eb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-ed0bfbfb-bf23-4886-863e-7533d2374eb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:40.503881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:40.504744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:40.505523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 95/191] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:32:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:40.506155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bfbfb-bf23-4886-863e-7533d2374eb2 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:40.572789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 97/192] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:40.574780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e70532-2f17-407b-9d72-f0b70de2f5ff None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:40.602351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bfbfb-bf23-4886-863e-7533d2374eb2 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:40.635682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414360ee-bf45-4a5c-9887-ef3d500680f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:40.636350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414360ee-bf45-4a5c-9887-ef3d500680f0 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.636653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414360ee-bf45-4a5c-9887-ef3d500680f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.636899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414360ee-bf45-4a5c-9887-ef3d500680f0 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.637599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414360ee-bf45-4a5c-9887-ef3d500680f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:40.639105 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414360ee-bf45-4a5c-9887-ef3d500680f0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:40.658713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 96/193] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:32:40 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:40.671352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414360ee-bf45-4a5c-9887-ef3d500680f0 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:40.690609 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e70532-2f17-407b-9d72-f0b70de2f5ff None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:40.734932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a27aa-5666-4a07-8cd4-fd0526c1ef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:40.735487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a27aa-5666-4a07-8cd4-fd0526c1ef19 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.735770 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a27aa-5666-4a07-8cd4-fd0526c1ef19 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.736043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a27aa-5666-4a07-8cd4-fd0526c1ef19 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.736833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a27aa-5666-4a07-8cd4-fd0526c1ef19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:40.737101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a27aa-5666-4a07-8cd4-fd0526c1ef19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:40.738556 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a27aa-5666-4a07-8cd4-fd0526c1ef19 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:40.748624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 98/194] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:32:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:40.754140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a27aa-5666-4a07-8cd4-fd0526c1ef19 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:40.786212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414360ee-bf45-4a5c-9887-ef3d500680f0 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:40.825420 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a88ee9-acb8-4095-bcfd-57cb7a2999c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:40.827092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a88ee9-acb8-4095-bcfd-57cb7a2999c0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.827835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a88ee9-acb8-4095-bcfd-57cb7a2999c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.828457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a88ee9-acb8-4095-bcfd-57cb7a2999c0 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.843101 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a88ee9-acb8-4095-bcfd-57cb7a2999c0 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:40.844840 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a88ee9-acb8-4095-bcfd-57cb7a2999c0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:40.846896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 97/195] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:40 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:40.853965 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a88ee9-acb8-4095-bcfd-57cb7a2999c0 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:40.871784 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a27aa-5666-4a07-8cd4-fd0526c1ef19 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:40.908118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdae98-e22d-4c03-bcba-16f043152694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:40.908920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdae98-e22d-4c03-bcba-16f043152694 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:40.909192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdae98-e22d-4c03-bcba-16f043152694 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:40.909464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdae98-e22d-4c03-bcba-16f043152694 None admin] PATH_INFO: `/v3/users/d2dd55eb9ee541799b3845e38eb6e2db` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:40.910705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdae98-e22d-4c03-bcba-16f043152694 None admin] RBAC: Authorizing `identity:get_user(user_id=d2dd55eb9ee541799b3845e38eb6e2db)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:40.912545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdae98-e22d-4c03-bcba-16f043152694 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:40.914340 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 99/196] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:40 2022] GET /identity/v3/users/d2dd55eb9ee541799b3845e38eb6e2db => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:40.921307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdae98-e22d-4c03-bcba-16f043152694 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:40.979321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a88ee9-acb8-4095-bcfd-57cb7a2999c0 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:41.021923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a288e4-5d9f-4f6d-b870-eeca6bcce2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:41.022648 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a288e4-5d9f-4f6d-b870-eeca6bcce2d8 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:41.022907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a288e4-5d9f-4f6d-b870-eeca6bcce2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:41.023225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a288e4-5d9f-4f6d-b870-eeca6bcce2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:41.024004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a288e4-5d9f-4f6d-b870-eeca6bcce2d8 None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=c596122d9ed84658a8bf43ea14abeec6, user.id=d2dd55eb9ee541799b3845e38eb6e2db) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:41.024305 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a288e4-5d9f-4f6d-b870-eeca6bcce2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:41.026490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a288e4-5d9f-4f6d-b870-eeca6bcce2d8 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:41.032554 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 98/197] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:40 2022] GET /identity/v3/role_assignments?user.id=d2dd55eb9ee541799b3845e38eb6e2db&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:41.045483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdae98-e22d-4c03-bcba-16f043152694 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:41.082988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd82fc1-ed1b-49d7-8a68-fefcaa45868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:41.083554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82fc1-ed1b-49d7-8a68-fefcaa45868d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:41.083832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82fc1-ed1b-49d7-8a68-fefcaa45868d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:41.084100 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd82fc1-ed1b-49d7-8a68-fefcaa45868d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:41.161282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd82fc1-ed1b-49d7-8a68-fefcaa45868d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:41.162892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd82fc1-ed1b-49d7-8a68-fefcaa45868d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:41.271095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 100/198] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:41.278493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a288e4-5d9f-4f6d-b870-eeca6bcce2d8 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:41.389172 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a288e4-5d9f-4f6d-b870-eeca6bcce2d8 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:41.423140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4752266-be3f-4ab1-888d-6839a845d07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:41.424317 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752266-be3f-4ab1-888d-6839a845d07e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:41.424818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752266-be3f-4ab1-888d-6839a845d07e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:41.425273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752266-be3f-4ab1-888d-6839a845d07e None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:41.426757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4752266-be3f-4ab1-888d-6839a845d07e None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:41.428435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4752266-be3f-4ab1-888d-6839a845d07e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:41.430666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 99/199] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:41 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:41.436771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd82fc1-ed1b-49d7-8a68-fefcaa45868d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:41.555715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd82fc1-ed1b-49d7-8a68-fefcaa45868d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:41.583549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2759f5e-7c92-4558-9d5a-92dcd167c91b None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:41.584191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2759f5e-7c92-4558-9d5a-92dcd167c91b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:41.584681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2759f5e-7c92-4558-9d5a-92dcd167c91b None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:41.586242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 100/200] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:41.592148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5aaef-52a6-4cd6-88fa-fd5a5092ae12 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:41.592970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5aaef-52a6-4cd6-88fa-fd5a5092ae12 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:41.593473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5aaef-52a6-4cd6-88fa-fd5a5092ae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:41.611589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5357f-369a-4940-b0c8-ecd0605c7401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:41.612115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e0d5aaef-52a6-4cd6-88fa-fd5a5092ae12 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:41.612290 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5357f-369a-4940-b0c8-ecd0605c7401 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:41.612535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5357f-369a-4940-b0c8-ecd0605c7401 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:41.612813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5357f-369a-4940-b0c8-ecd0605c7401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:41.613657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5357f-369a-4940-b0c8-ecd0605c7401 None admin] RBAC: Adding query filter params (role.id=97f5bd452f314fa093a222f49facdac7, scope.project.id=c596122d9ed84658a8bf43ea14abeec6, user.id=d2dd55eb9ee541799b3845e38eb6e2db) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:41.613970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5357f-369a-4940-b0c8-ecd0605c7401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:41.614513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e0d5aaef-52a6-4cd6-88fa-fd5a5092ae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:41.615453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5357f-369a-4940-b0c8-ecd0605c7401 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:41.625018 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 101/201] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:41 2022] GET /identity/v3/role_assignments?user.id=d2dd55eb9ee541799b3845e38eb6e2db&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=97f5bd452f314fa093a222f49facdac7 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:41.721654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 101/202] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:41.759616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5357f-369a-4940-b0c8-ecd0605c7401 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:41.905917 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5357f-369a-4940-b0c8-ecd0605c7401 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:41.947499 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff5154-c42c-4d69-af99-2900b4619513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:41.948330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5154-c42c-4d69-af99-2900b4619513 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:41.948616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5154-c42c-4d69-af99-2900b4619513 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:41.948883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5154-c42c-4d69-af99-2900b4619513 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:41.958999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff5154-c42c-4d69-af99-2900b4619513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-5fff5154-c42c-4d69-af99-2900b4619513 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:41.967252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:41.968113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:41.968888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 102/203] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:41.974596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5aaef-52a6-4cd6-88fa-fd5a5092ae12 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:42.075292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5aaef-52a6-4cd6-88fa-fd5a5092ae12 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:42.109457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc7ee7-7175-4ec5-acda-a7a019decd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:42.110121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc7ee7-7175-4ec5-acda-a7a019decd0e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:42.110424 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc7ee7-7175-4ec5-acda-a7a019decd0e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:42.110700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc7ee7-7175-4ec5-acda-a7a019decd0e None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:42.111447 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc7ee7-7175-4ec5-acda-a7a019decd0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:42.111803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc7ee7-7175-4ec5-acda-a7a019decd0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:42.113229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc7ee7-7175-4ec5-acda-a7a019decd0e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:42.122587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 102/204] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:42.128097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff5154-c42c-4d69-af99-2900b4619513 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:42.231409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff5154-c42c-4d69-af99-2900b4619513 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:42.265074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec8c98-5d8f-45c4-948e-53403844c3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:42.265950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8c98-5d8f-45c4-948e-53403844c3d1 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:42.266227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8c98-5d8f-45c4-948e-53403844c3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:42.266529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec8c98-5d8f-45c4-948e-53403844c3d1 None admin] PATH_INFO: `/v3/users/c6575f98944f45c9b548f4d71e618a09` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:42.267720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec8c98-5d8f-45c4-948e-53403844c3d1 None admin] RBAC: Authorizing `identity:get_user(user_id=c6575f98944f45c9b548f4d71e618a09)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:42.269168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec8c98-5d8f-45c4-948e-53403844c3d1 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:42.271119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 103/205] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:42 2022] GET /identity/v3/users/c6575f98944f45c9b548f4d71e618a09 => generated 289 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:42.277428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc7ee7-7175-4ec5-acda-a7a019decd0e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:42.385717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc7ee7-7175-4ec5-acda-a7a019decd0e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:42.419940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939150a0-69e7-42db-8475-c32449c450e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:42.420583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939150a0-69e7-42db-8475-c32449c450e5 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:42.420864 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939150a0-69e7-42db-8475-c32449c450e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:42.421129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939150a0-69e7-42db-8475-c32449c450e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:42.489076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939150a0-69e7-42db-8475-c32449c450e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:42.490535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939150a0-69e7-42db-8475-c32449c450e5 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:42.588594 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 103/206] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:42.594070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec8c98-5d8f-45c4-948e-53403844c3d1 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:42.693504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec8c98-5d8f-45c4-948e-53403844c3d1 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:42.729805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca387d-faa9-4f97-ba3d-3d8ffb61b056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:42.730741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca387d-faa9-4f97-ba3d-3d8ffb61b056 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:42.731019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca387d-faa9-4f97-ba3d-3d8ffb61b056 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:42.731339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca387d-faa9-4f97-ba3d-3d8ffb61b056 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:42.732533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca387d-faa9-4f97-ba3d-3d8ffb61b056 None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:42.733989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca387d-faa9-4f97-ba3d-3d8ffb61b056 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:42.735997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 104/207] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:42 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:42.741705 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939150a0-69e7-42db-8475-c32449c450e5 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:42.842568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939150a0-69e7-42db-8475-c32449c450e5 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:42.877907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55182e94-80f0-4e42-bda4-00515d47ac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:42.878580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182e94-80f0-4e42-bda4-00515d47ac8e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:42.878862 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182e94-80f0-4e42-bda4-00515d47ac8e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:42.879138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55182e94-80f0-4e42-bda4-00515d47ac8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:42.879962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55182e94-80f0-4e42-bda4-00515d47ac8e None admin] RBAC: Adding query filter params (role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be, scope.project.id=235c60e5703c440590e4c72e2d095f74, user.id=c6575f98944f45c9b548f4d71e618a09) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:42.880267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55182e94-80f0-4e42-bda4-00515d47ac8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:42.881691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55182e94-80f0-4e42-bda4-00515d47ac8e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:42.888569 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 104/208] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:42 2022] GET /identity/v3/role_assignments?user.id=c6575f98944f45c9b548f4d71e618a09&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:43.631513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ea8cc-6ce7-4fe1-9add-af03a016b2d4 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:43.632206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ea8cc-6ce7-4fe1-9add-af03a016b2d4 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:43.632206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ea8cc-6ce7-4fe1-9add-af03a016b2d4 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:43.633426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 105/209] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:43.639398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9e192-3fda-4c6e-bc16-af93778a2337 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:43.639880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9e192-3fda-4c6e-bc16-af93778a2337 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:43.640030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9e192-3fda-4c6e-bc16-af93778a2337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:43.657610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-00a9e192-3fda-4c6e-bc16-af93778a2337 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:43.658826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-00a9e192-3fda-4c6e-bc16-af93778a2337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:43.694726 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c7aa-591d-4a43-8a46-596055343b4e None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:43.695020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c7aa-591d-4a43-8a46-596055343b4e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:43.695281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905c7aa-591d-4a43-8a46-596055343b4e None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:43.696655 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 106/210] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:43.703715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc2fe3-5cf7-43f1-b371-c4cfec116ba3 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:43.704006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc2fe3-5cf7-43f1-b371-c4cfec116ba3 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:43.704281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc2fe3-5cf7-43f1-b371-c4cfec116ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:43.721693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4adc2fe3-5cf7-43f1-b371-c4cfec116ba3 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:43.722919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4adc2fe3-5cf7-43f1-b371-c4cfec116ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:43.732270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 105/211] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:43.755630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9e192-3fda-4c6e-bc16-af93778a2337 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:43.807399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 107/212] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:43.836495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc2fe3-5cf7-43f1-b371-c4cfec116ba3 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:43.881908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9e192-3fda-4c6e-bc16-af93778a2337 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:43.918006 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc69a52-f8e3-4458-aabd-d800dedfa205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:43.919098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69a52-f8e3-4458-aabd-d800dedfa205 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:43.919527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69a52-f8e3-4458-aabd-d800dedfa205 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:43.919948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc69a52-f8e3-4458-aabd-d800dedfa205 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:43.930697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc69a52-f8e3-4458-aabd-d800dedfa205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-edc69a52-f8e3-4458-aabd-d800dedfa205 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:43.939557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:43.940419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:43.941204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:43.943879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 106/213] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:32:43.949772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc69a52-f8e3-4458-aabd-d800dedfa205 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:43.957133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc2fe3-5cf7-43f1-b371-c4cfec116ba3 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:43.992427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbae744-6a45-4359-8192-5150fdbdcd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:43.993222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbae744-6a45-4359-8192-5150fdbdcd31 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:43.993504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbae744-6a45-4359-8192-5150fdbdcd31 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:43.994300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbae744-6a45-4359-8192-5150fdbdcd31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:43.995519 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbae744-6a45-4359-8192-5150fdbdcd31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:43.996969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbae744-6a45-4359-8192-5150fdbdcd31 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:43.998658 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 108/214] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:44.004346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe51ee-4678-447e-ab72-bbcff85143d9 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.004637 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe51ee-4678-447e-ab72-bbcff85143d9 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.004921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe51ee-4678-447e-ab72-bbcff85143d9 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.006344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 109/215] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:44.007360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe51ee-4678-447e-ab72-bbcff85143d9 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:44.059670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc69a52-f8e3-4458-aabd-d800dedfa205 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:44.095122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f270af9-07bd-4be2-b825-84dd01e4af29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:44.095807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f270af9-07bd-4be2-b825-84dd01e4af29 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.096087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f270af9-07bd-4be2-b825-84dd01e4af29 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.096364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f270af9-07bd-4be2-b825-84dd01e4af29 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.097131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f270af9-07bd-4be2-b825-84dd01e4af29 None admin] RBAC: Adding query filter params (name=member) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:44.097431 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f270af9-07bd-4be2-b825-84dd01e4af29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:44.098907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f270af9-07bd-4be2-b825-84dd01e4af29 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:44.108413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 107/216] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:44.110593 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe51ee-4678-447e-ab72-bbcff85143d9 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:44.112064 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846bf77-530c-4e5c-8b9c-f83b0c24fc75 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.112476 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846bf77-530c-4e5c-8b9c-f83b0c24fc75 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.112957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846bf77-530c-4e5c-8b9c-f83b0c24fc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.130610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-d846bf77-530c-4e5c-8b9c-f83b0c24fc75 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:44.131789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d846bf77-530c-4e5c-8b9c-f83b0c24fc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:44.146398 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ba139-7d9b-42e6-8301-40df62e23936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:44.147000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ba139-7d9b-42e6-8301-40df62e23936 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.147283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ba139-7d9b-42e6-8301-40df62e23936 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.147557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ba139-7d9b-42e6-8301-40df62e23936 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.148265 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ba139-7d9b-42e6-8301-40df62e23936 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:44.149765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ba139-7d9b-42e6-8301-40df62e23936 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:44.177421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 110/217] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:32:44 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:32:44.177421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ba139-7d9b-42e6-8301-40df62e23936 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:44.214570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 108/218] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:44.238173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846bf77-530c-4e5c-8b9c-f83b0c24fc75 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:44.304617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ba139-7d9b-42e6-8301-40df62e23936 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:44.341972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c6be9-9b3b-4da7-aab7-73d0847a42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:44.342663 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846bf77-530c-4e5c-8b9c-f83b0c24fc75 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:44.343555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6be9-9b3b-4da7-aab7-73d0847a42db None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.344033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6be9-9b3b-4da7-aab7-73d0847a42db None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.344600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c6be9-9b3b-4da7-aab7-73d0847a42db None admin] PATH_INFO: `/v3/users/2b0f84ed3c8742c7bb1b950dc37dc52e` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.361720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c6be9-9b3b-4da7-aab7-73d0847a42db None admin] RBAC: Authorizing `identity:get_user(user_id=2b0f84ed3c8742c7bb1b950dc37dc52e)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:44.363214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c6be9-9b3b-4da7-aab7-73d0847a42db None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:44.365134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 111/219] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:44 2022] GET /identity/v3/users/2b0f84ed3c8742c7bb1b950dc37dc52e => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:44.366355 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd921ef6-edc8-4685-b762-a174aba30cad None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.366464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd921ef6-edc8-4685-b762-a174aba30cad None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.366740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd921ef6-edc8-4685-b762-a174aba30cad None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.368098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 112/220] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:44.371975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd921ef6-edc8-4685-b762-a174aba30cad None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:44.383168 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a5e0ca-4159-4f05-8a7d-e92d7b18e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:44.385847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e0ca-4159-4f05-8a7d-e92d7b18e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.385847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e0ca-4159-4f05-8a7d-e92d7b18e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.385847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a5e0ca-4159-4f05-8a7d-e92d7b18e7c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.397128 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a5e0ca-4159-4f05-8a7d-e92d7b18e7c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-52a5e0ca-4159-4f05-8a7d-e92d7b18e7c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:44.405803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:44.406704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:44.407508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 109/221] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:32:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:32:44.408362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72efeac-85e0-411d-a2d9-52e1e2996707 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.408690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72efeac-85e0-411d-a2d9-52e1e2996707 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.409186 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72efeac-85e0-411d-a2d9-52e1e2996707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.427700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e72efeac-85e0-411d-a2d9-52e1e2996707 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:44.428874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e72efeac-85e0-411d-a2d9-52e1e2996707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:44.490019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd921ef6-edc8-4685-b762-a174aba30cad None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:44.513139 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 110/222] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:44.514262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72efeac-85e0-411d-a2d9-52e1e2996707 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:44.538149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a415c25-26a7-4abd-ab8f-1f9ff21ba1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:44.538848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a415c25-26a7-4abd-ab8f-1f9ff21ba1a8 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.539223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a415c25-26a7-4abd-ab8f-1f9ff21ba1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.539493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a415c25-26a7-4abd-ab8f-1f9ff21ba1a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.616145 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a415c25-26a7-4abd-ab8f-1f9ff21ba1a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:44.617674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a415c25-26a7-4abd-ab8f-1f9ff21ba1a8 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:44.646127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72efeac-85e0-411d-a2d9-52e1e2996707 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:44.684213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936c2c-a8a7-4878-b099-e62aa9152728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:44.684810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936c2c-a8a7-4878-b099-e62aa9152728 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.685095 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936c2c-a8a7-4878-b099-e62aa9152728 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.685371 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936c2c-a8a7-4878-b099-e62aa9152728 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.686129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936c2c-a8a7-4878-b099-e62aa9152728 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:44.686552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936c2c-a8a7-4878-b099-e62aa9152728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:44.687978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936c2c-a8a7-4878-b099-e62aa9152728 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:44.696916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 111/223] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:44.702834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936c2c-a8a7-4878-b099-e62aa9152728 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:44.725444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 113/224] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:44.726729 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a415c25-26a7-4abd-ab8f-1f9ff21ba1a8 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:44.812400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936c2c-a8a7-4878-b099-e62aa9152728 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:44.828853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a415c25-26a7-4abd-ab8f-1f9ff21ba1a8 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:44.847931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92149d-2e66-4a01-a02b-114ae678425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:44.848750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92149d-2e66-4a01-a02b-114ae678425a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.849032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92149d-2e66-4a01-a02b-114ae678425a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.849304 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92149d-2e66-4a01-a02b-114ae678425a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.861995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab92149d-2e66-4a01-a02b-114ae678425a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-ab92149d-2e66-4a01-a02b-114ae678425a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:44.871203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:44.872115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:44.872882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 112/225] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:32:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:44.873631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92149d-2e66-4a01-a02b-114ae678425a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:44.878628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d447381-e551-4778-b9d8-eece0f17676c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:44.879704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d447381-e551-4778-b9d8-eece0f17676c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:44.880174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d447381-e551-4778-b9d8-eece0f17676c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:44.880610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d447381-e551-4778-b9d8-eece0f17676c None admin] PATH_INFO: `/v3/users/d2dd55eb9ee541799b3845e38eb6e2db` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:44.882033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d447381-e551-4778-b9d8-eece0f17676c None admin] RBAC: Authorizing `identity:get_user(user_id=d2dd55eb9ee541799b3845e38eb6e2db)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:44.883641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d447381-e551-4778-b9d8-eece0f17676c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:44.885871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 114/226] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:44 2022] GET /identity/v3/users/d2dd55eb9ee541799b3845e38eb6e2db => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:44.886832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d447381-e551-4778-b9d8-eece0f17676c None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:44.986416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab92149d-2e66-4a01-a02b-114ae678425a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:44.989104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d447381-e551-4778-b9d8-eece0f17676c None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:45.021871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665333c8-5d5e-4226-8952-8aa1606cc3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:45.022774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665333c8-5d5e-4226-8952-8aa1606cc3a8 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:45.023057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665333c8-5d5e-4226-8952-8aa1606cc3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:45.023332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665333c8-5d5e-4226-8952-8aa1606cc3a8 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:45.024541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665333c8-5d5e-4226-8952-8aa1606cc3a8 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:45.027333 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665333c8-5d5e-4226-8952-8aa1606cc3a8 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:45.027872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd79e5-236b-46ee-b433-ec2819624255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:45.028718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd79e5-236b-46ee-b433-ec2819624255 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:45.029055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 113/227] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:44 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:45.029292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd79e5-236b-46ee-b433-ec2819624255 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:45.029701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd79e5-236b-46ee-b433-ec2819624255 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:45.029808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665333c8-5d5e-4226-8952-8aa1606cc3a8 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:45.030732 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd79e5-236b-46ee-b433-ec2819624255 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:45.031176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd79e5-236b-46ee-b433-ec2819624255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:45.032750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd79e5-236b-46ee-b433-ec2819624255 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:45.044479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 115/228] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:32:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:45.045555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd79e5-236b-46ee-b433-ec2819624255 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:45.141647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665333c8-5d5e-4226-8952-8aa1606cc3a8 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:45.148060 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd79e5-236b-46ee-b433-ec2819624255 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:45.177961 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b9fd9-a6f4-4500-8388-940b8648dcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:45.178922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b9fd9-a6f4-4500-8388-940b8648dcd3 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:45.179209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b9fd9-a6f4-4500-8388-940b8648dcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:45.179493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b9fd9-a6f4-4500-8388-940b8648dcd3 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:45.180718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b9fd9-a6f4-4500-8388-940b8648dcd3 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:45.182936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b9fd9-a6f4-4500-8388-940b8648dcd3 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:45.183339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edc31b-24b1-4c11-b299-dc1e9d96b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:45.184148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edc31b-24b1-4c11-b299-dc1e9d96b449 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:45.184592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edc31b-24b1-4c11-b299-dc1e9d96b449 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:45.185006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48edc31b-24b1-4c11-b299-dc1e9d96b449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:45.185985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edc31b-24b1-4c11-b299-dc1e9d96b449 None admin] RBAC: Adding query filter params (role.id=15a2a347c19845c9ac397da513eb944a, scope.project.id=c596122d9ed84658a8bf43ea14abeec6, user.id=2b0f84ed3c8742c7bb1b950dc37dc52e) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:45.186469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edc31b-24b1-4c11-b299-dc1e9d96b449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:45.188048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48edc31b-24b1-4c11-b299-dc1e9d96b449 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:45.189342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 114/229] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:45 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:45.190295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b9fd9-a6f4-4500-8388-940b8648dcd3 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:45.194739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 116/230] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:45 2022] GET /identity/v3/role_assignments?user.id=2b0f84ed3c8742c7bb1b950dc37dc52e&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=15a2a347c19845c9ac397da513eb944a => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:45.195698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edc31b-24b1-4c11-b299-dc1e9d96b449 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:45.298901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48edc31b-24b1-4c11-b299-dc1e9d96b449 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:45.335406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557fdb2-8473-4d7c-8bab-50e2afca5a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:45.336553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557fdb2-8473-4d7c-8bab-50e2afca5a20 None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:45.336979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557fdb2-8473-4d7c-8bab-50e2afca5a20 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:45.337499 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557fdb2-8473-4d7c-8bab-50e2afca5a20 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6/users/d2dd55eb9ee541799b3845e38eb6e2db/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:45.339925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557fdb2-8473-4d7c-8bab-50e2afca5a20 None admin] RBAC: Authorizing `identity:create_grant(project_id=c596122d9ed84658a8bf43ea14abeec6, user_id=d2dd55eb9ee541799b3845e38eb6e2db, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:45.341563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557fdb2-8473-4d7c-8bab-50e2afca5a20 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:45.369961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 117/231] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:32:45 2022] PUT /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6/users/d2dd55eb9ee541799b3845e38eb6e2db/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:32:45.372081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b9fd9-a6f4-4500-8388-940b8648dcd3 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:45.411968 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7b2de-8ea3-436e-a762-6038ba3a7e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:45.413149 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7b2de-8ea3-436e-a762-6038ba3a7e60 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:45.413577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7b2de-8ea3-436e-a762-6038ba3a7e60 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:45.414029 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7b2de-8ea3-436e-a762-6038ba3a7e60 None admin] PATH_INFO: `/v3/users/d2dd55eb9ee541799b3845e38eb6e2db` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:45.416139 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7b2de-8ea3-436e-a762-6038ba3a7e60 None admin] RBAC: Authorizing `identity:get_user(user_id=d2dd55eb9ee541799b3845e38eb6e2db)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:45.417839 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7b2de-8ea3-436e-a762-6038ba3a7e60 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:45.419781 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 115/232] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:45 2022] GET /identity/v3/users/d2dd55eb9ee541799b3845e38eb6e2db => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:45.427497 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557fdb2-8473-4d7c-8bab-50e2afca5a20 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:45.583118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557fdb2-8473-4d7c-8bab-50e2afca5a20 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:45.626393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9c363-77a9-457b-8030-927fd41146e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:45.627326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c363-77a9-457b-8030-927fd41146e3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:45.627613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c363-77a9-457b-8030-927fd41146e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:45.627891 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c363-77a9-457b-8030-927fd41146e3 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:45.629133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9c363-77a9-457b-8030-927fd41146e3 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:45.630701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9c363-77a9-457b-8030-927fd41146e3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:45.632759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 118/233] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:45 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:45.638678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7b2de-8ea3-436e-a762-6038ba3a7e60 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:45.748688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7b2de-8ea3-436e-a762-6038ba3a7e60 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:45.790907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76378a3-fa26-407c-bc17-052ad563400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:45.791835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76378a3-fa26-407c-bc17-052ad563400c None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:45.792116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76378a3-fa26-407c-bc17-052ad563400c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:45.792389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76378a3-fa26-407c-bc17-052ad563400c None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6/users/d2dd55eb9ee541799b3845e38eb6e2db/roles/97f5bd452f314fa093a222f49facdac7` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:45.798333 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76378a3-fa26-407c-bc17-052ad563400c None admin] RBAC: Authorizing `identity:create_grant(project_id=c596122d9ed84658a8bf43ea14abeec6, user_id=d2dd55eb9ee541799b3845e38eb6e2db, role_id=97f5bd452f314fa093a222f49facdac7)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:45.799801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76378a3-fa26-407c-bc17-052ad563400c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:45.831998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 116/234] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:32:45 2022] PUT /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6/users/d2dd55eb9ee541799b3845e38eb6e2db/roles/97f5bd452f314fa093a222f49facdac7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:32:46.712673 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354e366-4fe0-4d7c-8329-ed3b620b7929 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:46.713267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354e366-4fe0-4d7c-8329-ed3b620b7929 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:46.713267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354e366-4fe0-4d7c-8329-ed3b620b7929 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:46.715081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 119/235] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:46.720553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37271-268f-4556-9c2f-d821400a56aa None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:46.720847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37271-268f-4556-9c2f-d821400a56aa None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:46.721126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37271-268f-4556-9c2f-d821400a56aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:46.730058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64069e6f-65da-4543-b5b0-aabeff8b5a3c None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:46.730363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64069e6f-65da-4543-b5b0-aabeff8b5a3c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:46.730642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64069e6f-65da-4543-b5b0-aabeff8b5a3c None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:46.732242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 120/236] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:46.736902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328f190-e9c7-4a6e-9736-464d26fa7736 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:46.737186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328f190-e9c7-4a6e-9736-464d26fa7736 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:46.737462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328f190-e9c7-4a6e-9736-464d26fa7736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:46.743135 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6bd37271-268f-4556-9c2f-d821400a56aa None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:46.744536 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6bd37271-268f-4556-9c2f-d821400a56aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:46.755783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9328f190-e9c7-4a6e-9736-464d26fa7736 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:46.756955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9328f190-e9c7-4a6e-9736-464d26fa7736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:46.845258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 121/237] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:46.879557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 117/238] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:46.893261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328f190-e9c7-4a6e-9736-464d26fa7736 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:46.926605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd37271-268f-4556-9c2f-d821400a56aa None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:47.052188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328f190-e9c7-4a6e-9736-464d26fa7736 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:47.094129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd37271-268f-4556-9c2f-d821400a56aa None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:47.112563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a11f89-c175-40a3-910f-9ad6eb75cc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:47.113357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a11f89-c175-40a3-910f-9ad6eb75cc9e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:47.113689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a11f89-c175-40a3-910f-9ad6eb75cc9e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:47.113967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a11f89-c175-40a3-910f-9ad6eb75cc9e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:47.125023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a11f89-c175-40a3-910f-9ad6eb75cc9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-94a11f89-c175-40a3-910f-9ad6eb75cc9e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:47.132581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:47.133453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:47.134389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 122/239] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:47.139790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a11f89-c175-40a3-910f-9ad6eb75cc9e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:47.172352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8c7ea-3bda-4194-a543-be009af7a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:47.173211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8c7ea-3bda-4194-a543-be009af7a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:47.173491 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8c7ea-3bda-4194-a543-be009af7a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:47.173758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8c7ea-3bda-4194-a543-be009af7a0e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:47.178996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8c7ea-3bda-4194-a543-be009af7a0e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:47.180448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8c7ea-3bda-4194-a543-be009af7a0e5 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:47.182928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 118/240] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:47.188081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8c7ea-3bda-4194-a543-be009af7a0e5 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:47.237981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a11f89-c175-40a3-910f-9ad6eb75cc9e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:47.277413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65d83d-d968-4fc3-8766-19503b00fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:47.278076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65d83d-d968-4fc3-8766-19503b00fb70 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:47.278373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65d83d-d968-4fc3-8766-19503b00fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:47.278649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65d83d-d968-4fc3-8766-19503b00fb70 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:47.279400 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65d83d-d968-4fc3-8766-19503b00fb70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:47.279703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65d83d-d968-4fc3-8766-19503b00fb70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:47.281089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65d83d-d968-4fc3-8766-19503b00fb70 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:47.300523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 123/241] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:47.301680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65d83d-d968-4fc3-8766-19503b00fb70 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:47.391375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8c7ea-3bda-4194-a543-be009af7a0e5 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:47.421321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65d83d-d968-4fc3-8766-19503b00fb70 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:47.439930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979e480-1d6c-482e-b09d-be03f5ea1624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:47.441046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979e480-1d6c-482e-b09d-be03f5ea1624 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:47.441528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979e480-1d6c-482e-b09d-be03f5ea1624 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:47.441995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979e480-1d6c-482e-b09d-be03f5ea1624 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:47.442933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979e480-1d6c-482e-b09d-be03f5ea1624 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:47.444574 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979e480-1d6c-482e-b09d-be03f5ea1624 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:47.456339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d07376-22b8-4187-876b-ae4ec8ac4131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:47.457393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d07376-22b8-4187-876b-ae4ec8ac4131 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:47.457503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d07376-22b8-4187-876b-ae4ec8ac4131 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:47.457740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d07376-22b8-4187-876b-ae4ec8ac4131 None admin] PATH_INFO: `/v3/users/114966fd28c248baa268dc7418521da2` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:47.471415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d07376-22b8-4187-876b-ae4ec8ac4131 None admin] RBAC: Authorizing `identity:get_user(user_id=114966fd28c248baa268dc7418521da2)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:47.472931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d07376-22b8-4187-876b-ae4ec8ac4131 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:47.474978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 124/242] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:47 2022] GET /identity/v3/users/114966fd28c248baa268dc7418521da2 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:47.486334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d07376-22b8-4187-876b-ae4ec8ac4131 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:47.489106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 119/243] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:32:47 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:32:47.587124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d07376-22b8-4187-876b-ae4ec8ac4131 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:47.624179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b15f7-2b54-4a8a-baab-28c6ff2e772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:47.624830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b15f7-2b54-4a8a-baab-28c6ff2e772a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:47.625107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b15f7-2b54-4a8a-baab-28c6ff2e772a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:47.625378 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b15f7-2b54-4a8a-baab-28c6ff2e772a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:47.695959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b15f7-2b54-4a8a-baab-28c6ff2e772a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:47.697489 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b15f7-2b54-4a8a-baab-28c6ff2e772a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:47.801089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 125/244] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:47.807336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979e480-1d6c-482e-b09d-be03f5ea1624 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:47.929266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979e480-1d6c-482e-b09d-be03f5ea1624 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:47.968998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4e91d-fd52-494d-90ee-c8aba00c7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:47.969790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e91d-fd52-494d-90ee-c8aba00c7b28 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:47.970063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e91d-fd52-494d-90ee-c8aba00c7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:47.970350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4e91d-fd52-494d-90ee-c8aba00c7b28 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:47.971587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4e91d-fd52-494d-90ee-c8aba00c7b28 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:47.973072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4e91d-fd52-494d-90ee-c8aba00c7b28 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:47.975230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 120/245] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:47 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:47.981687 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b15f7-2b54-4a8a-baab-28c6ff2e772a None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:48.084794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b15f7-2b54-4a8a-baab-28c6ff2e772a None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:48.121641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b2fcd-9333-4f85-a692-56f730280610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:48.122295 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2fcd-9333-4f85-a692-56f730280610 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:48.122601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2fcd-9333-4f85-a692-56f730280610 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:48.122869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b2fcd-9333-4f85-a692-56f730280610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:48.123704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2fcd-9333-4f85-a692-56f730280610 None admin] RBAC: Adding query filter params (role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be, scope.project.id=c596122d9ed84658a8bf43ea14abeec6, user.id=114966fd28c248baa268dc7418521da2) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:48.124007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2fcd-9333-4f85-a692-56f730280610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:48.125571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b2fcd-9333-4f85-a692-56f730280610 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:48.131666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 126/246] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:47 2022] GET /identity/v3/role_assignments?user.id=114966fd28c248baa268dc7418521da2&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:48.154336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509ff1e-2ae9-4924-a9d4-2f3947defb89 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:48.154627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509ff1e-2ae9-4924-a9d4-2f3947defb89 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:48.154876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509ff1e-2ae9-4924-a9d4-2f3947defb89 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:48.156253 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 121/247] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:48.162114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6877c-5ee2-4c01-95a6-a5f59daedd30 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:48.162429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6877c-5ee2-4c01-95a6-a5f59daedd30 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:48.162694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6877c-5ee2-4c01-95a6-a5f59daedd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:48.183539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-bfa6877c-5ee2-4c01-95a6-a5f59daedd30 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:48.184756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-bfa6877c-5ee2-4c01-95a6-a5f59daedd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:48.267518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 127/248] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:48.285429 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6dcaa-8353-47f0-9c34-c36f9ed4163c None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:48.285735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6dcaa-8353-47f0-9c34-c36f9ed4163c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:48.286005 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6dcaa-8353-47f0-9c34-c36f9ed4163c None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:48.287428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 122/249] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:48.293884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f270-0738-4a14-b2eb-cf54d355374f None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:48.294192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f270-0738-4a14-b2eb-cf54d355374f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:48.294476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244f270-0738-4a14-b2eb-cf54d355374f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:48.298030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6dcaa-8353-47f0-9c34-c36f9ed4163c None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:48.312750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2244f270-0738-4a14-b2eb-cf54d355374f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:48.313257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2244f270-0738-4a14-b2eb-cf54d355374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:48.416218 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 128/250] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:48.432006 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6dcaa-8353-47f0-9c34-c36f9ed4163c None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:48.439041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244f270-0738-4a14-b2eb-cf54d355374f None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:48.500003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b059e-f0e8-4061-901d-8a1575453837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:48.501175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b059e-f0e8-4061-901d-8a1575453837 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:48.501654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b059e-f0e8-4061-901d-8a1575453837 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:48.502131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b059e-f0e8-4061-901d-8a1575453837 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:48.513763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b059e-f0e8-4061-901d-8a1575453837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-129b059e-f0e8-4061-901d-8a1575453837 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:48.522094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:48.522992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:48.523797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:48.527133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 123/251] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:32:48.533002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b059e-f0e8-4061-901d-8a1575453837 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:48.604857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244f270-0738-4a14-b2eb-cf54d355374f None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:48.639953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d219f34-28a1-47a9-bc04-5a3a7f9915fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:48.641156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219f34-28a1-47a9-bc04-5a3a7f9915fc None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:48.643606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219f34-28a1-47a9-bc04-5a3a7f9915fc None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:48.644180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219f34-28a1-47a9-bc04-5a3a7f9915fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:48.656136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d219f34-28a1-47a9-bc04-5a3a7f9915fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-7d219f34-28a1-47a9-bc04-5a3a7f9915fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:48.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:48.665520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:32:48.666343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:48.669092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 129/252] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:32:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:32:48.676547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d219f34-28a1-47a9-bc04-5a3a7f9915fc None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:48.684704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b059e-f0e8-4061-901d-8a1575453837 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:48.748921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4d242-5c93-4789-8eb5-058c183ee227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:48.749631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4d242-5c93-4789-8eb5-058c183ee227 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:48.749910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4d242-5c93-4789-8eb5-058c183ee227 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:48.750180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4d242-5c93-4789-8eb5-058c183ee227 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:48.750954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4d242-5c93-4789-8eb5-058c183ee227 None admin] RBAC: Adding query filter params (name=member) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:48.751436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4d242-5c93-4789-8eb5-058c183ee227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:48.752959 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4d242-5c93-4789-8eb5-058c183ee227 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:48.769832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 124/253] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:48.790113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4d242-5c93-4789-8eb5-058c183ee227 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:48.791259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d219f34-28a1-47a9-bc04-5a3a7f9915fc None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:48.828327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04941c79-4729-45a0-b2fe-7364edcdc59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:48.829788 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04941c79-4729-45a0-b2fe-7364edcdc59b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:48.837708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04941c79-4729-45a0-b2fe-7364edcdc59b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:48.838073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04941c79-4729-45a0-b2fe-7364edcdc59b None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:48.838921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04941c79-4729-45a0-b2fe-7364edcdc59b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:48.839389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04941c79-4729-45a0-b2fe-7364edcdc59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:48.840957 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04941c79-4729-45a0-b2fe-7364edcdc59b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:48.854431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 130/254] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:48.857365 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04941c79-4729-45a0-b2fe-7364edcdc59b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:48.968666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04941c79-4729-45a0-b2fe-7364edcdc59b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:49.006302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97bd9-f174-43b8-bf18-8c5e341d4c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:49.007459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97bd9-f174-43b8-bf18-8c5e341d4c0b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:49.008364 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97bd9-f174-43b8-bf18-8c5e341d4c0b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:49.008824 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97bd9-f174-43b8-bf18-8c5e341d4c0b None admin] PATH_INFO: `/v3/users/d2dd55eb9ee541799b3845e38eb6e2db` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:49.011168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97bd9-f174-43b8-bf18-8c5e341d4c0b None admin] RBAC: Authorizing `identity:get_user(user_id=d2dd55eb9ee541799b3845e38eb6e2db)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:49.012985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97bd9-f174-43b8-bf18-8c5e341d4c0b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:49.015820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 131/255] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:48 2022] GET /identity/v3/users/d2dd55eb9ee541799b3845e38eb6e2db => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:49.021808 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97bd9-f174-43b8-bf18-8c5e341d4c0b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:49.038182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4d242-5c93-4789-8eb5-058c183ee227 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:49.072798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d829288-3a11-4660-89c2-c396fb10c0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:49.074028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d829288-3a11-4660-89c2-c396fb10c0b9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:49.074568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d829288-3a11-4660-89c2-c396fb10c0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:49.075032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d829288-3a11-4660-89c2-c396fb10c0b9 None admin] PATH_INFO: `/v3/users/2b0f84ed3c8742c7bb1b950dc37dc52e` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:49.076551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d829288-3a11-4660-89c2-c396fb10c0b9 None admin] RBAC: Authorizing `identity:get_user(user_id=2b0f84ed3c8742c7bb1b950dc37dc52e)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:49.078273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d829288-3a11-4660-89c2-c396fb10c0b9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:49.080488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 125/256] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:48 2022] GET /identity/v3/users/2b0f84ed3c8742c7bb1b950dc37dc52e => generated 297 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:49.086178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf0d52-fa21-4674-a05e-b48ab25b1557 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:49.086815 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf0d52-fa21-4674-a05e-b48ab25b1557 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:49.087350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf0d52-fa21-4674-a05e-b48ab25b1557 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:49.088935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 126/257] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:49.089936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf0d52-fa21-4674-a05e-b48ab25b1557 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:49.143531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97bd9-f174-43b8-bf18-8c5e341d4c0b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:49.194069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a45a80-9567-4e61-a5bb-d1bab581b7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:49.195087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45a80-9567-4e61-a5bb-d1bab581b7e6 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:49.195747 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45a80-9567-4e61-a5bb-d1bab581b7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:49.197455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a45a80-9567-4e61-a5bb-d1bab581b7e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:49.225818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf0d52-fa21-4674-a05e-b48ab25b1557 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:49.288154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e92436-cbac-487f-9913-385b0c2f1a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:49.289379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92436-cbac-487f-9913-385b0c2f1a7e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:49.290445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92436-cbac-487f-9913-385b0c2f1a7e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:49.291158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92436-cbac-487f-9913-385b0c2f1a7e None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:49.293692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e92436-cbac-487f-9913-385b0c2f1a7e None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:49.296532 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e92436-cbac-487f-9913-385b0c2f1a7e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:49.299591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 127/258] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:49 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:49.302050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c800d-4d68-4ffc-8dd7-c7dfe6bd6130 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:49.303194 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c800d-4d68-4ffc-8dd7-c7dfe6bd6130 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:49.304461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c800d-4d68-4ffc-8dd7-c7dfe6bd6130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:49.325245 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a45a80-9567-4e61-a5bb-d1bab581b7e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:49.327242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a45a80-9567-4e61-a5bb-d1bab581b7e6 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:49.335292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-920c800d-4d68-4ffc-8dd7-c7dfe6bd6130 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:49.341770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-920c800d-4d68-4ffc-8dd7-c7dfe6bd6130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:49.442486 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 128/259] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:49.443707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c800d-4d68-4ffc-8dd7-c7dfe6bd6130 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:49.521646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 132/260] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 14 15:32:49.522889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a45a80-9567-4e61-a5bb-d1bab581b7e6 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:49.604467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c800d-4d68-4ffc-8dd7-c7dfe6bd6130 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:49.651001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea53e-9e77-44f9-a0b6-7bc57fed9bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:49.652279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea53e-9e77-44f9-a0b6-7bc57fed9bdb None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:49.654118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea53e-9e77-44f9-a0b6-7bc57fed9bdb None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:49.654651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ea53e-9e77-44f9-a0b6-7bc57fed9bdb None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6/users/2b0f84ed3c8742c7bb1b950dc37dc52e/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:49.661651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea53e-9e77-44f9-a0b6-7bc57fed9bdb None admin] RBAC: Authorizing `identity:create_grant(project_id=c596122d9ed84658a8bf43ea14abeec6, user_id=2b0f84ed3c8742c7bb1b950dc37dc52e, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:49.663418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ea53e-9e77-44f9-a0b6-7bc57fed9bdb None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:49.689131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 129/261] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:32:49 2022] PUT /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6/users/2b0f84ed3c8742c7bb1b950dc37dc52e/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:32:49.690298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea53e-9e77-44f9-a0b6-7bc57fed9bdb None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:49.733646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a45a80-9567-4e61-a5bb-d1bab581b7e6 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:49.780464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5577a9-82ec-468a-b7a7-4e004cdcba1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:49.782962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5577a9-82ec-468a-b7a7-4e004cdcba1b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:49.783970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5577a9-82ec-468a-b7a7-4e004cdcba1b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:49.784463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5577a9-82ec-468a-b7a7-4e004cdcba1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:49.807749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5577a9-82ec-468a-b7a7-4e004cdcba1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-ec5577a9-82ec-468a-b7a7-4e004cdcba1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:49.826820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:49.827811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:32:49.829024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:49.833425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 133/262] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:32:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:49.851599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5577a9-82ec-468a-b7a7-4e004cdcba1b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:49.875964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ea53e-9e77-44f9-a0b6-7bc57fed9bdb None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:49.950006 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5588a4a-c05b-414c-9ec3-97da01be4a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:49.951325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5588a4a-c05b-414c-9ec3-97da01be4a10 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:49.951847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5588a4a-c05b-414c-9ec3-97da01be4a10 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:49.952329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5588a4a-c05b-414c-9ec3-97da01be4a10 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:49.959297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5588a4a-c05b-414c-9ec3-97da01be4a10 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:49.960848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5588a4a-c05b-414c-9ec3-97da01be4a10 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:49.964150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 130/263] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:49 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:49.970132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5588a4a-c05b-414c-9ec3-97da01be4a10 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:50.006700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5577a9-82ec-468a-b7a7-4e004cdcba1b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:50.043618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaea0f8-f4ea-4df1-ab87-32c130ab38cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:50.044706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaea0f8-f4ea-4df1-ab87-32c130ab38cc None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:50.045197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaea0f8-f4ea-4df1-ab87-32c130ab38cc None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:50.045696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaea0f8-f4ea-4df1-ab87-32c130ab38cc None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:50.046767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaea0f8-f4ea-4df1-ab87-32c130ab38cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:50.047284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaea0f8-f4ea-4df1-ab87-32c130ab38cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:50.048911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaea0f8-f4ea-4df1-ab87-32c130ab38cc None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:50.058454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 134/264] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:32:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:50.066964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaea0f8-f4ea-4df1-ab87-32c130ab38cc None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:50.193189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5588a4a-c05b-414c-9ec3-97da01be4a10 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:50.262618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d9ec8-4bdf-4879-abd6-536d20d05572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:50.263282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9ec8-4bdf-4879-abd6-536d20d05572 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:50.263565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9ec8-4bdf-4879-abd6-536d20d05572 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:50.263897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9ec8-4bdf-4879-abd6-536d20d05572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:50.264744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d9ec8-4bdf-4879-abd6-536d20d05572 None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=c596122d9ed84658a8bf43ea14abeec6, user.id=d2dd55eb9ee541799b3845e38eb6e2db) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:50.265274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d9ec8-4bdf-4879-abd6-536d20d05572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:50.266766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d9ec8-4bdf-4879-abd6-536d20d05572 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:50.275579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaea0f8-f4ea-4df1-ab87-32c130ab38cc None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:50.280383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 131/265] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:49 2022] GET /identity/v3/role_assignments?user.id=d2dd55eb9ee541799b3845e38eb6e2db&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:50.327325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293c509-3be1-4cd1-bdca-a6e4ede3bec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:50.328253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c509-3be1-4cd1-bdca-a6e4ede3bec1 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:50.328538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c509-3be1-4cd1-bdca-a6e4ede3bec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:50.328808 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c509-3be1-4cd1-bdca-a6e4ede3bec1 None admin] PATH_INFO: `/v3/users/d2dd55eb9ee541799b3845e38eb6e2db` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:50.335328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293c509-3be1-4cd1-bdca-a6e4ede3bec1 None admin] RBAC: Authorizing `identity:get_user(user_id=d2dd55eb9ee541799b3845e38eb6e2db)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:50.336840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293c509-3be1-4cd1-bdca-a6e4ede3bec1 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:50.339441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 135/266] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:50 2022] GET /identity/v3/users/d2dd55eb9ee541799b3845e38eb6e2db => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:50.345196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d9ec8-4bdf-4879-abd6-536d20d05572 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:50.484716 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d9ec8-4bdf-4879-abd6-536d20d05572 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:50.526670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5c2da-c2b3-4868-9e59-3ecbccea9373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:50.527335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5c2da-c2b3-4868-9e59-3ecbccea9373 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:50.527618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5c2da-c2b3-4868-9e59-3ecbccea9373 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:50.527892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5c2da-c2b3-4868-9e59-3ecbccea9373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:50.610597 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5c2da-c2b3-4868-9e59-3ecbccea9373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:50.612076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5c2da-c2b3-4868-9e59-3ecbccea9373 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:50.723529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 132/267] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:50.730058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293c509-3be1-4cd1-bdca-a6e4ede3bec1 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:50.906785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293c509-3be1-4cd1-bdca-a6e4ede3bec1 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:50.959642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d383e3-0f94-4e67-8e1d-e3c8eecdd28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:50.960528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d383e3-0f94-4e67-8e1d-e3c8eecdd28d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:50.960811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d383e3-0f94-4e67-8e1d-e3c8eecdd28d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:50.961088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d383e3-0f94-4e67-8e1d-e3c8eecdd28d None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:50.962526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d383e3-0f94-4e67-8e1d-e3c8eecdd28d None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:50.964199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d383e3-0f94-4e67-8e1d-e3c8eecdd28d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:50.966240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 136/268] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:50 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:50.972069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5c2da-c2b3-4868-9e59-3ecbccea9373 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:51.073204 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2fc1-16a7-4806-badc-82394a73cc83 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.073524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2fc1-16a7-4806-badc-82394a73cc83 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.073794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2fc1-16a7-4806-badc-82394a73cc83 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.075469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 137/269] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:51.080840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c3d7a-5dcd-4faf-b544-09d00cb9dd0d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.081135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c3d7a-5dcd-4faf-b544-09d00cb9dd0d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.081414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c3d7a-5dcd-4faf-b544-09d00cb9dd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.110946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-5b8c3d7a-5dcd-4faf-b544-09d00cb9dd0d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:51.112441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-5b8c3d7a-5dcd-4faf-b544-09d00cb9dd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:51.115989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5c2da-c2b3-4868-9e59-3ecbccea9373 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:51.150840 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d62045-863f-4a31-819d-7bbb7915ddc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:51.151655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d62045-863f-4a31-819d-7bbb7915ddc5 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.151937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d62045-863f-4a31-819d-7bbb7915ddc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.152210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d62045-863f-4a31-819d-7bbb7915ddc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.153047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d62045-863f-4a31-819d-7bbb7915ddc5 None admin] RBAC: Adding query filter params (role.id=97f5bd452f314fa093a222f49facdac7, scope.project.id=c596122d9ed84658a8bf43ea14abeec6, user.id=d2dd55eb9ee541799b3845e38eb6e2db) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:51.153358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d62045-863f-4a31-819d-7bbb7915ddc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:51.154840 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d62045-863f-4a31-819d-7bbb7915ddc5 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:51.161279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 133/270] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:50 2022] GET /identity/v3/role_assignments?user.id=d2dd55eb9ee541799b3845e38eb6e2db&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=97f5bd452f314fa093a222f49facdac7 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:51.162705 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa88c7a-1997-47b1-b898-c6fdb7e6e36c None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.162989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa88c7a-1997-47b1-b898-c6fdb7e6e36c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.163265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa88c7a-1997-47b1-b898-c6fdb7e6e36c None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.164664 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 134/271] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:51.173189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a61bb6-442a-4068-8232-e73adc8520cb None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.173189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a61bb6-442a-4068-8232-e73adc8520cb None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.173189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a61bb6-442a-4068-8232-e73adc8520cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.189321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-36a61bb6-442a-4068-8232-e73adc8520cb None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:51.189681 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 138/272] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:51.190628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-36a61bb6-442a-4068-8232-e73adc8520cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:51.226289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c3d7a-5dcd-4faf-b544-09d00cb9dd0d None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:51.263406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 135/273] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:51.287043 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a61bb6-442a-4068-8232-e73adc8520cb None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:51.435250 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c3d7a-5dcd-4faf-b544-09d00cb9dd0d None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:51.466706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a61bb6-442a-4068-8232-e73adc8520cb None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:51.479176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d4683-dfb8-44ee-a445-d4a99f26c11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:51.480583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d4683-dfb8-44ee-a445-d4a99f26c11a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.480871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d4683-dfb8-44ee-a445-d4a99f26c11a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.481144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d4683-dfb8-44ee-a445-d4a99f26c11a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.495060 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d4683-dfb8-44ee-a445-d4a99f26c11a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-df7d4683-dfb8-44ee-a445-d4a99f26c11a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:51.508956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:51.510023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:51.510857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 139/274] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:51.511945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0706df-3857-44cd-bb48-fb8ce0e696a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:51.512047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0706df-3857-44cd-bb48-fb8ce0e696a1 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.512249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0706df-3857-44cd-bb48-fb8ce0e696a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.512521 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0706df-3857-44cd-bb48-fb8ce0e696a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.516435 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d4683-dfb8-44ee-a445-d4a99f26c11a None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:51.530560 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0706df-3857-44cd-bb48-fb8ce0e696a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-0a0706df-3857-44cd-bb48-fb8ce0e696a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:51.538728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:51.539598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 136/275] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:32:51.542993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13521d3b-def4-4026-93d9-e8cb663e2f40 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.543691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13521d3b-def4-4026-93d9-e8cb663e2f40 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.543691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13521d3b-def4-4026-93d9-e8cb663e2f40 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.544107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 137/276] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:51.551025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13521d3b-def4-4026-93d9-e8cb663e2f40 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:51.642655 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d4683-dfb8-44ee-a445-d4a99f26c11a None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:51.662979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13521d3b-def4-4026-93d9-e8cb663e2f40 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:51.679385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa210553-3c16-4080-aef8-b900234e4964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:51.680057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa210553-3c16-4080-aef8-b900234e4964 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.680342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa210553-3c16-4080-aef8-b900234e4964 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.680628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa210553-3c16-4080-aef8-b900234e4964 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.681927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa210553-3c16-4080-aef8-b900234e4964 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:51.682236 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa210553-3c16-4080-aef8-b900234e4964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:51.683667 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa210553-3c16-4080-aef8-b900234e4964 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:51.696223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 140/277] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:51.696223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1effc-19e4-433c-97e5-25fc454cffa4 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.696223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1effc-19e4-433c-97e5-25fc454cffa4 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.696223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1effc-19e4-433c-97e5-25fc454cffa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.701573 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804a47a-04e4-418c-babb-5ca4f39ce3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:51.702240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804a47a-04e4-418c-babb-5ca4f39ce3a3 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.702552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804a47a-04e4-418c-babb-5ca4f39ce3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.702827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804a47a-04e4-418c-babb-5ca4f39ce3a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.703568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804a47a-04e4-418c-babb-5ca4f39ce3a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:51.703873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804a47a-04e4-418c-babb-5ca4f39ce3a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:51.705366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f804a47a-04e4-418c-babb-5ca4f39ce3a3 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:51.710124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2ab1effc-19e4-433c-97e5-25fc454cffa4 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:51.711327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2ab1effc-19e4-433c-97e5-25fc454cffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:51.714368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 138/278] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:51.715019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804a47a-04e4-418c-babb-5ca4f39ce3a3 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:51.779784 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 141/279] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:51.780633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1effc-19e4-433c-97e5-25fc454cffa4 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:51.824622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804a47a-04e4-418c-babb-5ca4f39ce3a3 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:51.861710 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0347-cbc7-466d-b390-958d16178adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:51.862610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0347-cbc7-466d-b390-958d16178adc None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.862892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0347-cbc7-466d-b390-958d16178adc None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.863169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0347-cbc7-466d-b390-958d16178adc None admin] PATH_INFO: `/v3/users/114966fd28c248baa268dc7418521da2` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.864337 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc0347-cbc7-466d-b390-958d16178adc None admin] RBAC: Authorizing `identity:get_user(user_id=114966fd28c248baa268dc7418521da2)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:51.865766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc0347-cbc7-466d-b390-958d16178adc None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:51.872186 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 139/280] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:51 2022] GET /identity/v3/users/114966fd28c248baa268dc7418521da2 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:51.872186 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0347-cbc7-466d-b390-958d16178adc None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:51.877498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1effc-19e4-433c-97e5-25fc454cffa4 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:51.911442 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc92d9-c868-42ee-b679-6d88dd4dec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:51.912306 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc92d9-c868-42ee-b679-6d88dd4dec4e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:51.912580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc92d9-c868-42ee-b679-6d88dd4dec4e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:51.912847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc92d9-c868-42ee-b679-6d88dd4dec4e None admin] PATH_INFO: `/v3/users/561e41e447244965bb3cdaf106b9609d` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:51.926094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc92d9-c868-42ee-b679-6d88dd4dec4e None admin] RBAC: Authorizing `identity:get_user(user_id=561e41e447244965bb3cdaf106b9609d)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:51.927666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc92d9-c868-42ee-b679-6d88dd4dec4e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:51.929349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 142/281] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:51 2022] GET /identity/v3/users/561e41e447244965bb3cdaf106b9609d => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:51.934946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc92d9-c868-42ee-b679-6d88dd4dec4e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:51.971258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0347-cbc7-466d-b390-958d16178adc None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:52.004048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c7c41-f1f1-426d-8a2d-72c130106bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:52.004849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c7c41-f1f1-426d-8a2d-72c130106bff None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:52.005129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c7c41-f1f1-426d-8a2d-72c130106bff None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:52.005406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c7c41-f1f1-426d-8a2d-72c130106bff None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:52.006600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c7c41-f1f1-426d-8a2d-72c130106bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:52.008032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c7c41-f1f1-426d-8a2d-72c130106bff None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:52.010299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 140/282] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:52.013327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c7c41-f1f1-426d-8a2d-72c130106bff None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:52.035674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc92d9-c868-42ee-b679-6d88dd4dec4e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:52.075549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cd1b9-5635-4d3d-b8d9-11fa00928af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:52.076408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cd1b9-5635-4d3d-b8d9-11fa00928af2 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:52.076714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cd1b9-5635-4d3d-b8d9-11fa00928af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:52.076956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cd1b9-5635-4d3d-b8d9-11fa00928af2 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:52.078135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cd1b9-5635-4d3d-b8d9-11fa00928af2 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:52.079606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cd1b9-5635-4d3d-b8d9-11fa00928af2 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:52.081813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 143/283] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:51 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:52.082027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cd1b9-5635-4d3d-b8d9-11fa00928af2 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:52.114955 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c7c41-f1f1-426d-8a2d-72c130106bff None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:52.148569 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e348b7-38ec-42be-beda-1971193a86df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:52.149232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e348b7-38ec-42be-beda-1971193a86df None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:52.149514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e348b7-38ec-42be-beda-1971193a86df None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:52.149894 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e348b7-38ec-42be-beda-1971193a86df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:52.150760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e348b7-38ec-42be-beda-1971193a86df None admin] RBAC: Adding query filter params (role.id=15a2a347c19845c9ac397da513eb944a, user.id=561e41e447244965bb3cdaf106b9609d, scope.system=all) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:52.151074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e348b7-38ec-42be-beda-1971193a86df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:52.152512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e348b7-38ec-42be-beda-1971193a86df None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:52.166990 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 141/284] 10.222.0.61 () {56 vars in 1308 bytes} [Sat May 14 15:32:52 2022] GET /identity/v3/role_assignments?user.id=561e41e447244965bb3cdaf106b9609d&scope.system=all&role.id=15a2a347c19845c9ac397da513eb944a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:52.167994 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e348b7-38ec-42be-beda-1971193a86df None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:52.184670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cd1b9-5635-4d3d-b8d9-11fa00928af2 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:52.229876 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63033816-e25b-404f-bc9d-4973c426dd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:52.230926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63033816-e25b-404f-bc9d-4973c426dd68 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:52.231225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63033816-e25b-404f-bc9d-4973c426dd68 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:52.231755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63033816-e25b-404f-bc9d-4973c426dd68 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:52.232492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63033816-e25b-404f-bc9d-4973c426dd68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:52.234473 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63033816-e25b-404f-bc9d-4973c426dd68 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:52.261774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 144/285] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:32:52 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:52.303478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e348b7-38ec-42be-beda-1971193a86df None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:52.345021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c93e2f-f86c-46ff-8976-df64050e65a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:52.346008 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c93e2f-f86c-46ff-8976-df64050e65a7 None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:52.346293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c93e2f-f86c-46ff-8976-df64050e65a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:52.346607 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c93e2f-f86c-46ff-8976-df64050e65a7 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6/users/114966fd28c248baa268dc7418521da2/roles/ff4f4562c9e74c8aa9b5c5b9739ee3be` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:52.348958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c93e2f-f86c-46ff-8976-df64050e65a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c596122d9ed84658a8bf43ea14abeec6, user_id=114966fd28c248baa268dc7418521da2, role_id=ff4f4562c9e74c8aa9b5c5b9739ee3be)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:52.350542 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c93e2f-f86c-46ff-8976-df64050e65a7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:52.365743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 142/286] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:32:52 2022] PUT /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6/users/114966fd28c248baa268dc7418521da2/roles/ff4f4562c9e74c8aa9b5c5b9739ee3be => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:32:52.709768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56294-59de-4e92-83cc-c03369f3fff8 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:52.710529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56294-59de-4e92-83cc-c03369f3fff8 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:52.711036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf56294-59de-4e92-83cc-c03369f3fff8 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:52.713127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 145/287] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:52.718324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a038127-e6ec-476f-aa42-e475c38019be None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:52.718643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a038127-e6ec-476f-aa42-e475c38019be None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:52.718928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a038127-e6ec-476f-aa42-e475c38019be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:52.743332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-9a038127-e6ec-476f-aa42-e475c38019be None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:52.744565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9a038127-e6ec-476f-aa42-e475c38019be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:52.828756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 143/288] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:52.864262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf56294-59de-4e92-83cc-c03369f3fff8 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:53.003793 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf56294-59de-4e92-83cc-c03369f3fff8 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:53.042112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84486f5-a880-40e6-a7e0-3d77cf5d509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:53.042959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84486f5-a880-40e6-a7e0-3d77cf5d509b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:53.043244 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84486f5-a880-40e6-a7e0-3d77cf5d509b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:53.043520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84486f5-a880-40e6-a7e0-3d77cf5d509b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:53.060027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84486f5-a880-40e6-a7e0-3d77cf5d509b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f84486f5-a880-40e6-a7e0-3d77cf5d509b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:53.067781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:53.068666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:53.069864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 146/289] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:53.075438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a038127-e6ec-476f-aa42-e475c38019be None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:53.203013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a038127-e6ec-476f-aa42-e475c38019be None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:53.245369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f9d11-5481-451a-b766-300114bf04d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:53.246049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f9d11-5481-451a-b766-300114bf04d7 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:53.246419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f9d11-5481-451a-b766-300114bf04d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:53.246701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f9d11-5481-451a-b766-300114bf04d7 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:53.247458 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f9d11-5481-451a-b766-300114bf04d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:53.247764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f9d11-5481-451a-b766-300114bf04d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:53.249157 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f9d11-5481-451a-b766-300114bf04d7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:53.257988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 144/290] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:53.271413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84486f5-a880-40e6-a7e0-3d77cf5d509b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:53.411930 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84486f5-a880-40e6-a7e0-3d77cf5d509b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:53.453342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd64e3-3f18-4a9a-9ce9-a0eb91581ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:53.454254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd64e3-3f18-4a9a-9ce9-a0eb91581ea3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:53.454519 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd64e3-3f18-4a9a-9ce9-a0eb91581ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:53.454795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd64e3-3f18-4a9a-9ce9-a0eb91581ea3 None admin] PATH_INFO: `/v3/users/2b0f84ed3c8742c7bb1b950dc37dc52e` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:53.456013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd64e3-3f18-4a9a-9ce9-a0eb91581ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=2b0f84ed3c8742c7bb1b950dc37dc52e)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:53.457454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd64e3-3f18-4a9a-9ce9-a0eb91581ea3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:53.459098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 147/291] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:53 2022] GET /identity/v3/users/2b0f84ed3c8742c7bb1b950dc37dc52e => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:53.467406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f9d11-5481-451a-b766-300114bf04d7 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:53.617707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f9d11-5481-451a-b766-300114bf04d7 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:53.659802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6073268-327d-4dd2-a1f3-e129b95b176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:53.660451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073268-327d-4dd2-a1f3-e129b95b176e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:53.660732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073268-327d-4dd2-a1f3-e129b95b176e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:53.661002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6073268-327d-4dd2-a1f3-e129b95b176e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:53.753563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6073268-327d-4dd2-a1f3-e129b95b176e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:53.755039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6073268-327d-4dd2-a1f3-e129b95b176e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:53.877812 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 145/292] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:53.883554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd64e3-3f18-4a9a-9ce9-a0eb91581ea3 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:54.036580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd64e3-3f18-4a9a-9ce9-a0eb91581ea3 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:54.078895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f154ef-e2f4-47b4-9ba7-6eb9aa7b2c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:54.080110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f154ef-e2f4-47b4-9ba7-6eb9aa7b2c0e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:54.080610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f154ef-e2f4-47b4-9ba7-6eb9aa7b2c0e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:54.081286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f154ef-e2f4-47b4-9ba7-6eb9aa7b2c0e None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:54.082705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f154ef-e2f4-47b4-9ba7-6eb9aa7b2c0e None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:54.084381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f154ef-e2f4-47b4-9ba7-6eb9aa7b2c0e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:54.086638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 148/293] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:53 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:54.092166 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6073268-327d-4dd2-a1f3-e129b95b176e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:54.192462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6073268-327d-4dd2-a1f3-e129b95b176e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:54.231161 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3d5a4-4917-4fcf-ba86-0ad89adb8b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:54.231832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3d5a4-4917-4fcf-ba86-0ad89adb8b96 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:54.232121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3d5a4-4917-4fcf-ba86-0ad89adb8b96 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:54.232405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3d5a4-4917-4fcf-ba86-0ad89adb8b96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:54.233258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3d5a4-4917-4fcf-ba86-0ad89adb8b96 None admin] RBAC: Adding query filter params (role.id=15a2a347c19845c9ac397da513eb944a, scope.project.id=c596122d9ed84658a8bf43ea14abeec6, user.id=2b0f84ed3c8742c7bb1b950dc37dc52e) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:54.233572 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3d5a4-4917-4fcf-ba86-0ad89adb8b96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:54.235042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3d5a4-4917-4fcf-ba86-0ad89adb8b96 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:54.247014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 146/294] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:54 2022] GET /identity/v3/role_assignments?user.id=2b0f84ed3c8742c7bb1b950dc37dc52e&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=15a2a347c19845c9ac397da513eb944a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:54.866885 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3ff7f-8781-4387-9166-69a563a5d571 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:54.867548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3ff7f-8781-4387-9166-69a563a5d571 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:54.868058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3ff7f-8781-4387-9166-69a563a5d571 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:54.870359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 149/295] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:54.875849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b24f55-0622-44ab-a5eb-6f4701be7a1b None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:54.876794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b24f55-0622-44ab-a5eb-6f4701be7a1b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:54.877262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b24f55-0622-44ab-a5eb-6f4701be7a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:54.899318 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-33b24f55-0622-44ab-a5eb-6f4701be7a1b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:54.900971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-33b24f55-0622-44ab-a5eb-6f4701be7a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:54.986733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 147/296] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:55.008419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3ff7f-8781-4387-9166-69a563a5d571 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.057272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99f0ac-88c7-449c-b2ca-8dc169eff32e None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.057641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99f0ac-88c7-449c-b2ca-8dc169eff32e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.057822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99f0ac-88c7-449c-b2ca-8dc169eff32e None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.059498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 148/297] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:55.064918 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe26032-0caa-46e9-a202-a8c397509f2f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.065433 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe26032-0caa-46e9-a202-a8c397509f2f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.065904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe26032-0caa-46e9-a202-a8c397509f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.083522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-dbe26032-0caa-46e9-a202-a8c397509f2f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:55.085001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-dbe26032-0caa-46e9-a202-a8c397509f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:55.120595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3ff7f-8781-4387-9166-69a563a5d571 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:55.155304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9214ac5-1dd9-4ea8-b862-3b0abf65c586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:55.156463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214ac5-1dd9-4ea8-b862-3b0abf65c586 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.156891 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214ac5-1dd9-4ea8-b862-3b0abf65c586 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.156995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 149/298] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:55.164358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63ee64-9cb2-458d-8ae5-e171221a1d07 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.164358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63ee64-9cb2-458d-8ae5-e171221a1d07 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.164358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63ee64-9cb2-458d-8ae5-e171221a1d07 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.164358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 150/299] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:55.164652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9214ac5-1dd9-4ea8-b862-3b0abf65c586 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.165887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2d34b-1fcf-4975-a627-c38c834e28ac None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.166183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2d34b-1fcf-4975-a627-c38c834e28ac None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.166487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2d34b-1fcf-4975-a627-c38c834e28ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.172235 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9214ac5-1dd9-4ea8-b862-3b0abf65c586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-c9214ac5-1dd9-4ea8-b862-3b0abf65c586 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:55.180156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:55.181181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:55.181960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 150/300] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:55.184814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a1a2d34b-1fcf-4975-a627-c38c834e28ac None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:55.185017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a1a2d34b-1fcf-4975-a627-c38c834e28ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:55.187100 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9214ac5-1dd9-4ea8-b862-3b0abf65c586 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.251895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 151/301] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:55.252816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2d34b-1fcf-4975-a627-c38c834e28ac None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.283091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9214ac5-1dd9-4ea8-b862-3b0abf65c586 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:55.314767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b37ca-ac95-4008-8a91-930085e76b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:55.315425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b37ca-ac95-4008-8a91-930085e76b1c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.315710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b37ca-ac95-4008-8a91-930085e76b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.315985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b37ca-ac95-4008-8a91-930085e76b1c None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.316733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b37ca-ac95-4008-8a91-930085e76b1c None admin] RBAC: Adding query filter params (name=member) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:55.317036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b37ca-ac95-4008-8a91-930085e76b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:55.318454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b37ca-ac95-4008-8a91-930085e76b1c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:55.326480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 151/302] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:55.327486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297fac0-3856-40f0-91b0-0f1a85613d86 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.327776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297fac0-3856-40f0-91b0-0f1a85613d86 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.328058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297fac0-3856-40f0-91b0-0f1a85613d86 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.329430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 152/303] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:55.329983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297fac0-3856-40f0-91b0-0f1a85613d86 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.348449 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2d34b-1fcf-4975-a627-c38c834e28ac None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:55.380696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4149-0176-45fe-b577-f6c2de106e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:55.381407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4149-0176-45fe-b577-f6c2de106e2e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.381684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4149-0176-45fe-b577-f6c2de106e2e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.381949 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4149-0176-45fe-b577-f6c2de106e2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.392017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e4149-0176-45fe-b577-f6c2de106e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-b03e4149-0176-45fe-b577-f6c2de106e2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:55.399830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:55.400709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:55.401487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 152/304] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:55.402118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4149-0176-45fe-b577-f6c2de106e2e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.426904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297fac0-3856-40f0-91b0-0f1a85613d86 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:55.458678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43e950-5b84-4b4b-8c58-b0a362bdbf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:55.459462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43e950-5b84-4b4b-8c58-b0a362bdbf73 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.459747 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43e950-5b84-4b4b-8c58-b0a362bdbf73 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.460020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43e950-5b84-4b4b-8c58-b0a362bdbf73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.470289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43e950-5b84-4b4b-8c58-b0a362bdbf73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-2c43e950-5b84-4b4b-8c58-b0a362bdbf73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:55.478815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:55.479682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:55.480463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 153/305] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:55.481639 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1b600-7a00-430f-b4a9-13118fb8c19d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.481928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1b600-7a00-430f-b4a9-13118fb8c19d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.482207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1b600-7a00-430f-b4a9-13118fb8c19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.497697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-3ac1b600-7a00-430f-b4a9-13118fb8c19d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:55.498884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-3ac1b600-7a00-430f-b4a9-13118fb8c19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:55.502877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4149-0176-45fe-b577-f6c2de106e2e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:55.534237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a65702-9795-4949-82ce-7d9600594f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:55.535136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a65702-9795-4949-82ce-7d9600594f29 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.535420 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a65702-9795-4949-82ce-7d9600594f29 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.535697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a65702-9795-4949-82ce-7d9600594f29 None admin] PATH_INFO: `/v3/users/561e41e447244965bb3cdaf106b9609d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.536878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a65702-9795-4949-82ce-7d9600594f29 None admin] RBAC: Authorizing `identity:get_user(user_id=561e41e447244965bb3cdaf106b9609d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:55.538342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a65702-9795-4949-82ce-7d9600594f29 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:55.539956 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 153/306] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:55 2022] GET /identity/v3/users/561e41e447244965bb3cdaf106b9609d => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:55.541330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a65702-9795-4949-82ce-7d9600594f29 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.561300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 154/307] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:55.562136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1b600-7a00-430f-b4a9-13118fb8c19d None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.636014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a65702-9795-4949-82ce-7d9600594f29 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:55.654448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1b600-7a00-430f-b4a9-13118fb8c19d None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:55.667833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011348c-9032-49c6-9d9b-8a5d9c5dd9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:55.668488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011348c-9032-49c6-9d9b-8a5d9c5dd9a2 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.668771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011348c-9032-49c6-9d9b-8a5d9c5dd9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.669048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011348c-9032-49c6-9d9b-8a5d9c5dd9a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.669788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011348c-9032-49c6-9d9b-8a5d9c5dd9a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:55.670089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011348c-9032-49c6-9d9b-8a5d9c5dd9a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:55.671529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011348c-9032-49c6-9d9b-8a5d9c5dd9a2 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:55.679253 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 154/308] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:55.680013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011348c-9032-49c6-9d9b-8a5d9c5dd9a2 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.688149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda51505-1547-4643-9a22-4d56b4d595cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:55.688817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda51505-1547-4643-9a22-4d56b4d595cf None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.689097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda51505-1547-4643-9a22-4d56b4d595cf None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.689371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda51505-1547-4643-9a22-4d56b4d595cf None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.690153 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda51505-1547-4643-9a22-4d56b4d595cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:55.690496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda51505-1547-4643-9a22-4d56b4d595cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:55.691867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda51505-1547-4643-9a22-4d56b4d595cf None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:55.700804 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 155/309] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:55.701587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda51505-1547-4643-9a22-4d56b4d595cf None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.776685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011348c-9032-49c6-9d9b-8a5d9c5dd9a2 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:55.796310 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda51505-1547-4643-9a22-4d56b4d595cf None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:55.808115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89bf98-c80d-4fdd-8740-e4fa1936badd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:55.808976 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89bf98-c80d-4fdd-8740-e4fa1936badd None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.809262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89bf98-c80d-4fdd-8740-e4fa1936badd None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.809537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89bf98-c80d-4fdd-8740-e4fa1936badd None admin] PATH_INFO: `/v3/system/users/561e41e447244965bb3cdaf106b9609d/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.811035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89bf98-c80d-4fdd-8740-e4fa1936badd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=561e41e447244965bb3cdaf106b9609d, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:55.812404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89bf98-c80d-4fdd-8740-e4fa1936badd None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:55.821936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 155/310] 10.222.0.61 () {58 vars in 1334 bytes} [Sat May 14 15:32:55 2022] PUT /identity/v3/system/users/561e41e447244965bb3cdaf106b9609d/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:32:55.822934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89bf98-c80d-4fdd-8740-e4fa1936badd None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.831449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaad5e6-2b56-4857-80e6-47a179a11b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:55.832274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad5e6-2b56-4857-80e6-47a179a11b7f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.832564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad5e6-2b56-4857-80e6-47a179a11b7f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.832844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaad5e6-2b56-4857-80e6-47a179a11b7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.834171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaad5e6-2b56-4857-80e6-47a179a11b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:55.835843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaad5e6-2b56-4857-80e6-47a179a11b7f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:55.839315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 156/311] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:55.840592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaad5e6-2b56-4857-80e6-47a179a11b7f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.944449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaad5e6-2b56-4857-80e6-47a179a11b7f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:55.951777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89bf98-c80d-4fdd-8740-e4fa1936badd None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:55.981121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314bea4-74be-4a6f-9629-da0940bd4a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:55.982008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314bea4-74be-4a6f-9629-da0940bd4a4e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.982296 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314bea4-74be-4a6f-9629-da0940bd4a4e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.982607 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314bea4-74be-4a6f-9629-da0940bd4a4e None admin] PATH_INFO: `/v3/users/114966fd28c248baa268dc7418521da2` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:55.983865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314bea4-74be-4a6f-9629-da0940bd4a4e None admin] RBAC: Authorizing `identity:get_user(user_id=114966fd28c248baa268dc7418521da2)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:55.985348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314bea4-74be-4a6f-9629-da0940bd4a4e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:55.991973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b7920-ee63-4707-b27a-4ee6a724d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:55.992160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 157/312] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:55 2022] GET /identity/v3/users/114966fd28c248baa268dc7418521da2 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:55.992160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314bea4-74be-4a6f-9629-da0940bd4a4e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:55.992292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b7920-ee63-4707-b27a-4ee6a724d329 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:55.992292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b7920-ee63-4707-b27a-4ee6a724d329 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:55.992292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b7920-ee63-4707-b27a-4ee6a724d329 None admin] PATH_INFO: `/v3/users/1022a8b2b5184eb4940dd96e9fa7aa99` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:56.006956 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b7920-ee63-4707-b27a-4ee6a724d329 None admin] RBAC: Authorizing `identity:get_user(user_id=1022a8b2b5184eb4940dd96e9fa7aa99)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:56.008428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b7920-ee63-4707-b27a-4ee6a724d329 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:56.010746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 156/313] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:55 2022] GET /identity/v3/users/1022a8b2b5184eb4940dd96e9fa7aa99 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:56.011519 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b7920-ee63-4707-b27a-4ee6a724d329 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:56.094329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314bea4-74be-4a6f-9629-da0940bd4a4e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:56.110986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b7920-ee63-4707-b27a-4ee6a724d329 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:56.127965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52329014-b44e-4cbb-b97a-a9facc22c565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:56.129176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52329014-b44e-4cbb-b97a-a9facc22c565 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:56.129629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52329014-b44e-4cbb-b97a-a9facc22c565 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:56.130049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52329014-b44e-4cbb-b97a-a9facc22c565 None admin] PATH_INFO: `/v3/groups` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:56.130918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52329014-b44e-4cbb-b97a-a9facc22c565 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:56.132500 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52329014-b44e-4cbb-b97a-a9facc22c565 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:56.143828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c92970-72c1-44b6-b8c6-519b805eca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:56.144476 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c92970-72c1-44b6-b8c6-519b805eca40 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:56.144757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c92970-72c1-44b6-b8c6-519b805eca40 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:56.145032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c92970-72c1-44b6-b8c6-519b805eca40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:56.150335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 158/314] 10.222.0.61 () {60 vars in 1134 bytes} [Sat May 14 15:32:55 2022] POST /identity/v3/groups => generated 229 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:56.151474 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52329014-b44e-4cbb-b97a-a9facc22c565 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:56.234929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c92970-72c1-44b6-b8c6-519b805eca40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:56.236318 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c92970-72c1-44b6-b8c6-519b805eca40 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:56.278492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52329014-b44e-4cbb-b97a-a9facc22c565 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:56.314976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325cfe1-db14-4fc0-aa5f-643f867ec394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:56.315642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325cfe1-db14-4fc0-aa5f-643f867ec394 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:56.315922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325cfe1-db14-4fc0-aa5f-643f867ec394 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:56.316245 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325cfe1-db14-4fc0-aa5f-643f867ec394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:56.317092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325cfe1-db14-4fc0-aa5f-643f867ec394 None admin] RBAC: Adding query filter params (role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be, user.id=1022a8b2b5184eb4940dd96e9fa7aa99, scope.system=all) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:56.317401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325cfe1-db14-4fc0-aa5f-643f867ec394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:56.318921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325cfe1-db14-4fc0-aa5f-643f867ec394 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:56.330792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 159/315] 10.222.0.61 () {56 vars in 1308 bytes} [Sat May 14 15:32:56 2022] GET /identity/v3/role_assignments?user.id=1022a8b2b5184eb4940dd96e9fa7aa99&scope.system=all&role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:56.350197 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 157/316] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:32:56.358639 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325cfe1-db14-4fc0-aa5f-643f867ec394 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:56.467331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325cfe1-db14-4fc0-aa5f-643f867ec394 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:56.503943 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b26f4-a974-4d95-8214-ae0922746132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:56.504735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b26f4-a974-4d95-8214-ae0922746132 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:56.505016 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b26f4-a974-4d95-8214-ae0922746132 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:56.505288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b26f4-a974-4d95-8214-ae0922746132 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:56.506574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b26f4-a974-4d95-8214-ae0922746132 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:56.508023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b26f4-a974-4d95-8214-ae0922746132 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:56.510855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 160/317] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:32:56 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:56.517271 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c92970-72c1-44b6-b8c6-519b805eca40 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:56.620205 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c92970-72c1-44b6-b8c6-519b805eca40 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:56.654846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9547a56-c191-4820-ab79-f50f86ea976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:56.655506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547a56-c191-4820-ab79-f50f86ea976b None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:56.655791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547a56-c191-4820-ab79-f50f86ea976b None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:56.656070 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9547a56-c191-4820-ab79-f50f86ea976b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:56.656915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9547a56-c191-4820-ab79-f50f86ea976b None admin] RBAC: Adding query filter params (role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be, scope.project.id=c596122d9ed84658a8bf43ea14abeec6, user.id=114966fd28c248baa268dc7418521da2) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:56.657225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9547a56-c191-4820-ab79-f50f86ea976b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:56.658683 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9547a56-c191-4820-ab79-f50f86ea976b None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:56.665770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 158/318] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:32:56 2022] GET /identity/v3/role_assignments?user.id=114966fd28c248baa268dc7418521da2&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:58.063826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499536c4-e17d-4aa2-b33d-93dfa1e3b8fc None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.064370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499536c4-e17d-4aa2-b33d-93dfa1e3b8fc None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.064370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499536c4-e17d-4aa2-b33d-93dfa1e3b8fc None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.065772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 161/319] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:58.071062 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70e5d-da60-46ea-b198-95b8026f5762 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.072238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70e5d-da60-46ea-b198-95b8026f5762 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.072238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70e5d-da60-46ea-b198-95b8026f5762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.088832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-bdf70e5d-da60-46ea-b198-95b8026f5762 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:58.089947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-bdf70e5d-da60-46ea-b198-95b8026f5762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:58.155575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 159/320] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:58.179000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499536c4-e17d-4aa2-b33d-93dfa1e3b8fc None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:58.281462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499536c4-e17d-4aa2-b33d-93dfa1e3b8fc None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:58.313938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d5ba7-aedc-42be-94a9-87301776d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:58.314753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d5ba7-aedc-42be-94a9-87301776d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.315036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d5ba7-aedc-42be-94a9-87301776d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.315311 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d5ba7-aedc-42be-94a9-87301776d2b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.325031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d5ba7-aedc-42be-94a9-87301776d2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-be3d5ba7-aedc-42be-94a9-87301776d2b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:58.332605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:58.333434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:32:58.334234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:32:58.338653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 162/321] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:32:58.340340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf70e5d-da60-46ea-b198-95b8026f5762 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:58.435833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c27c6-faf4-4453-8d5c-6378e68c0b1b None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.436182 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c27c6-faf4-4453-8d5c-6378e68c0b1b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.436393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c27c6-faf4-4453-8d5c-6378e68c0b1b None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.437757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 163/322] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:32:58.439456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf70e5d-da60-46ea-b198-95b8026f5762 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:58.442723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57725104-407a-401d-964f-a8d4cb2e18b7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.443007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57725104-407a-401d-964f-a8d4cb2e18b7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.443279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57725104-407a-401d-964f-a8d4cb2e18b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.459435 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-57725104-407a-401d-964f-a8d4cb2e18b7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:58.460991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-57725104-407a-401d-964f-a8d4cb2e18b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:58.475430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb8c5-45db-4671-81e9-5d97493d9bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:58.476096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb8c5-45db-4671-81e9-5d97493d9bbb None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.476376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb8c5-45db-4671-81e9-5d97493d9bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.476653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bb8c5-45db-4671-81e9-5d97493d9bbb None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.478289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bb8c5-45db-4671-81e9-5d97493d9bbb None admin] RBAC: Adding query filter params (name=member) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:58.478611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bb8c5-45db-4671-81e9-5d97493d9bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:58.479993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bb8c5-45db-4671-81e9-5d97493d9bbb None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:58.488327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 160/323] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:58.493440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb8c5-45db-4671-81e9-5d97493d9bbb None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:58.530354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 164/324] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:32:58.550334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57725104-407a-401d-964f-a8d4cb2e18b7 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:58.590170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bb8c5-45db-4671-81e9-5d97493d9bbb None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:58.622881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c72e2-6f2c-4352-8d07-9b6d11788c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:58.623669 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c72e2-6f2c-4352-8d07-9b6d11788c78 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.623945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c72e2-6f2c-4352-8d07-9b6d11788c78 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.624211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c72e2-6f2c-4352-8d07-9b6d11788c78 None admin] PATH_INFO: `/v3/users/561e41e447244965bb3cdaf106b9609d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.625419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c72e2-6f2c-4352-8d07-9b6d11788c78 None admin] RBAC: Authorizing `identity:get_user(user_id=561e41e447244965bb3cdaf106b9609d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:58.626880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c72e2-6f2c-4352-8d07-9b6d11788c78 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:58.628640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 161/325] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:58 2022] GET /identity/v3/users/561e41e447244965bb3cdaf106b9609d => generated 293 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:58.629773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1429-4aba-4138-92e1-2d8ba797e089 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.630056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1429-4aba-4138-92e1-2d8ba797e089 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.630352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1429-4aba-4138-92e1-2d8ba797e089 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.631558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 162/326] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:32:58.635393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1429-4aba-4138-92e1-2d8ba797e089 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:58.645649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57725104-407a-401d-964f-a8d4cb2e18b7 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:58.678554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e76ee3-0b21-43c3-943e-8e0b57d240e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:58.679341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76ee3-0b21-43c3-943e-8e0b57d240e4 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.679620 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76ee3-0b21-43c3-943e-8e0b57d240e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.679892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76ee3-0b21-43c3-943e-8e0b57d240e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.681087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e76ee3-0b21-43c3-943e-8e0b57d240e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:58.682571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e76ee3-0b21-43c3-943e-8e0b57d240e4 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:58.684173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 165/327] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:32:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:58.685302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e2352-ff94-4f20-9f5d-320c95c63af3 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.685585 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e2352-ff94-4f20-9f5d-320c95c63af3 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.685868 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e2352-ff94-4f20-9f5d-320c95c63af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.702136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-e32e2352-ff94-4f20-9f5d-320c95c63af3 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:32:58.703344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e32e2352-ff94-4f20-9f5d-320c95c63af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:32:58.731555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1429-4aba-4138-92e1-2d8ba797e089 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:58.764067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427441c-68b4-424c-8838-a6ddd1d08e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:58.764708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427441c-68b4-424c-8838-a6ddd1d08e64 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.764988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427441c-68b4-424c-8838-a6ddd1d08e64 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.765257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427441c-68b4-424c-8838-a6ddd1d08e64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.765514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 166/328] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:32:58.774442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427441c-68b4-424c-8838-a6ddd1d08e64 None admin] RBAC: Adding query filter params (role.id=15a2a347c19845c9ac397da513eb944a, user.id=561e41e447244965bb3cdaf106b9609d, scope.system=all) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:58.775117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e2352-ff94-4f20-9f5d-320c95c63af3 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:58.775198 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427441c-68b4-424c-8838-a6ddd1d08e64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:58.775198 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427441c-68b4-424c-8838-a6ddd1d08e64 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:58.779828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 163/329] 10.222.0.61 () {56 vars in 1308 bytes} [Sat May 14 15:32:58 2022] GET /identity/v3/role_assignments?user.id=561e41e447244965bb3cdaf106b9609d&scope.system=all&role.id=15a2a347c19845c9ac397da513eb944a => generated 510 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:58.788581 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427441c-68b4-424c-8838-a6ddd1d08e64 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:58.888327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e2352-ff94-4f20-9f5d-320c95c63af3 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:58.897545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427441c-68b4-424c-8838-a6ddd1d08e64 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:58.926518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa86fa-275c-4035-98d4-8b8bca4be560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:58.927654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa86fa-275c-4035-98d4-8b8bca4be560 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.927949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa86fa-275c-4035-98d4-8b8bca4be560 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.928379 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa86fa-275c-4035-98d4-8b8bca4be560 None admin] PATH_INFO: `/v3/groups` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.929096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa86fa-275c-4035-98d4-8b8bca4be560 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:58.930612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa86fa-275c-4035-98d4-8b8bca4be560 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:58.933393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17c5b6-6d91-4649-8394-a96a5209438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:58.934628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17c5b6-6d91-4649-8394-a96a5209438c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:58.935512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17c5b6-6d91-4649-8394-a96a5209438c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:58.936063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17c5b6-6d91-4649-8394-a96a5209438c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:58.945799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 167/330] 10.222.0.61 () {60 vars in 1134 bytes} [Sat May 14 15:32:58 2022] POST /identity/v3/groups => generated 226 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:32:58.959462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17c5b6-6d91-4649-8394-a96a5209438c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-2b17c5b6-6d91-4649-8394-a96a5209438c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:32:58.969183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:32:58.970199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:32:58.971019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:32:58.974393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 164/331] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:32:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:32:58.977331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa86fa-275c-4035-98d4-8b8bca4be560 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:59.091971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa86fa-275c-4035-98d4-8b8bca4be560 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:59.127381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d6e71-b58a-4b31-9e7d-b83c89034f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:59.128067 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6e71-b58a-4b31-9e7d-b83c89034f6d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:59.128348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6e71-b58a-4b31-9e7d-b83c89034f6d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:59.128627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d6e71-b58a-4b31-9e7d-b83c89034f6d None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:59.129394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d6e71-b58a-4b31-9e7d-b83c89034f6d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:32:59.129703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d6e71-b58a-4b31-9e7d-b83c89034f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:59.131115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d6e71-b58a-4b31-9e7d-b83c89034f6d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:59.140622 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 168/332] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:32:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:32:59.146387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17c5b6-6d91-4649-8394-a96a5209438c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:59.249076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17c5b6-6d91-4649-8394-a96a5209438c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:59.287186 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02422783-39f1-4b1f-9220-659c5eb08337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:59.288069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02422783-39f1-4b1f-9220-659c5eb08337 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:59.288354 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02422783-39f1-4b1f-9220-659c5eb08337 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:59.288629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02422783-39f1-4b1f-9220-659c5eb08337 None admin] PATH_INFO: `/v3/users/1022a8b2b5184eb4940dd96e9fa7aa99` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:59.290967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02422783-39f1-4b1f-9220-659c5eb08337 None admin] RBAC: Authorizing `identity:get_user(user_id=1022a8b2b5184eb4940dd96e9fa7aa99)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:59.292845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02422783-39f1-4b1f-9220-659c5eb08337 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:59.294517 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 165/333] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:32:59 2022] GET /identity/v3/users/1022a8b2b5184eb4940dd96e9fa7aa99 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:32:59.300187 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d6e71-b58a-4b31-9e7d-b83c89034f6d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:32:59.403317 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d6e71-b58a-4b31-9e7d-b83c89034f6d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:32:59.439283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccef2b-d1aa-4a66-8361-90ba27c29d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:32:59.440457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccef2b-d1aa-4a66-8361-90ba27c29d09 None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:32:59.440738 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccef2b-d1aa-4a66-8361-90ba27c29d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:32:59.441068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccef2b-d1aa-4a66-8361-90ba27c29d09 None admin] PATH_INFO: `/v3/system/users/1022a8b2b5184eb4940dd96e9fa7aa99/roles/ff4f4562c9e74c8aa9b5c5b9739ee3be` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:32:59.442609 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccef2b-d1aa-4a66-8361-90ba27c29d09 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1022a8b2b5184eb4940dd96e9fa7aa99, role_id=ff4f4562c9e74c8aa9b5c5b9739ee3be)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:32:59.443986 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccef2b-d1aa-4a66-8361-90ba27c29d09 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:32:59.452989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 169/334] 10.222.0.61 () {58 vars in 1334 bytes} [Sat May 14 15:32:59 2022] PUT /identity/v3/system/users/1022a8b2b5184eb4940dd96e9fa7aa99/roles/ff4f4562c9e74c8aa9b5c5b9739ee3be => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:01.404812 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f579ec-9943-49a5-b9cf-4be4075e2bf7 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:01.405385 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f579ec-9943-49a5-b9cf-4be4075e2bf7 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:01.405385 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f579ec-9943-49a5-b9cf-4be4075e2bf7 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:01.407038 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 166/335] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:01.412333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589c1c8-fa29-4cf7-8a41-bdb04b7b98a4 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:01.412802 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589c1c8-fa29-4cf7-8a41-bdb04b7b98a4 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:01.412883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589c1c8-fa29-4cf7-8a41-bdb04b7b98a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:01.436332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4589c1c8-fa29-4cf7-8a41-bdb04b7b98a4 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:01.437528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4589c1c8-fa29-4cf7-8a41-bdb04b7b98a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:01.525500 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 170/336] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:01.568457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f579ec-9943-49a5-b9cf-4be4075e2bf7 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:01.687727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f579ec-9943-49a5-b9cf-4be4075e2bf7 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:01.730093 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5333f-0b2f-4684-98c9-39c51e7c6fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:01.730925 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5333f-0b2f-4684-98c9-39c51e7c6fed None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:01.731210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5333f-0b2f-4684-98c9-39c51e7c6fed None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:01.731485 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5333f-0b2f-4684-98c9-39c51e7c6fed None admin] PATH_INFO: `/v3/roles/member` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:01.751187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5333f-0b2f-4684-98c9-39c51e7c6fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-fdc5333f-0b2f-4684-98c9-39c51e7c6fed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:01.759367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:01.760368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:01.761191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 167/337] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:01.766528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589c1c8-fa29-4cf7-8a41-bdb04b7b98a4 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:01.893062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589c1c8-fa29-4cf7-8a41-bdb04b7b98a4 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:01.933889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491cef0-bafc-4252-bc88-1a1c82bbb902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:01.935035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491cef0-bafc-4252-bc88-1a1c82bbb902 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:01.935524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491cef0-bafc-4252-bc88-1a1c82bbb902 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:01.936004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491cef0-bafc-4252-bc88-1a1c82bbb902 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:01.936965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491cef0-bafc-4252-bc88-1a1c82bbb902 None admin] RBAC: Adding query filter params (name=member) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:01.937471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491cef0-bafc-4252-bc88-1a1c82bbb902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:01.943341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491cef0-bafc-4252-bc88-1a1c82bbb902 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:01.944296 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12e69-14f1-4d32-8950-48f206cbaaec None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:01.944826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12e69-14f1-4d32-8950-48f206cbaaec None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:01.945553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c12e69-14f1-4d32-8950-48f206cbaaec None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:01.948082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 168/338] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:01.954103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4927b47-f611-4d94-84af-fe855e3f62b1 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:01.954653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4927b47-f611-4d94-84af-fe855e3f62b1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:01.955143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4927b47-f611-4d94-84af-fe855e3f62b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:01.956179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 171/339] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:33:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:01.962814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491cef0-bafc-4252-bc88-1a1c82bbb902 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:01.991857 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b4927b47-f611-4d94-84af-fe855e3f62b1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:01.994204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b4927b47-f611-4d94-84af-fe855e3f62b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:02.100112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 169/340] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:02.140750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4927b47-f611-4d94-84af-fe855e3f62b1 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:02.150872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491cef0-bafc-4252-bc88-1a1c82bbb902 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:02.193874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e8deb-1ca1-4e5f-a373-5026beaa8639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:02.194880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e8deb-1ca1-4e5f-a373-5026beaa8639 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:02.195387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e8deb-1ca1-4e5f-a373-5026beaa8639 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:02.195866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e8deb-1ca1-4e5f-a373-5026beaa8639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:02.284179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e8deb-1ca1-4e5f-a373-5026beaa8639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:02.286021 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e8deb-1ca1-4e5f-a373-5026beaa8639 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:02.371098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4927b47-f611-4d94-84af-fe855e3f62b1 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:02.396549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 172/341] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 14 15:33:02.398275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151483bd-5a2c-44ae-b916-73c5c1e852d6 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:02.402884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151483bd-5a2c-44ae-b916-73c5c1e852d6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:02.403386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151483bd-5a2c-44ae-b916-73c5c1e852d6 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:02.405291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 173/342] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:02.407488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151483bd-5a2c-44ae-b916-73c5c1e852d6 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:02.442520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72e91f-5fbf-41ab-ae82-f4cc569c05a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:02.443342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e91f-5fbf-41ab-ae82-f4cc569c05a9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:02.443624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e91f-5fbf-41ab-ae82-f4cc569c05a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:02.443945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e91f-5fbf-41ab-ae82-f4cc569c05a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:02.464143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72e91f-5fbf-41ab-ae82-f4cc569c05a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-ac72e91f-5fbf-41ab-ae82-f4cc569c05a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:02.472707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:02.473590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:02.474387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:02.479800 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 170/343] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:33:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:02.481134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54494864-4176-4d70-a2fd-edd652f0d2c8 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:02.481417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54494864-4176-4d70-a2fd-edd652f0d2c8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:02.481709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54494864-4176-4d70-a2fd-edd652f0d2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:02.511343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-54494864-4176-4d70-a2fd-edd652f0d2c8 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:02.512539 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-54494864-4176-4d70-a2fd-edd652f0d2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:02.523964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151483bd-5a2c-44ae-b916-73c5c1e852d6 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:02.576549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb5d24-e01c-4e25-adf3-a0866f5e1d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:02.577421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5d24-e01c-4e25-adf3-a0866f5e1d3b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:02.577705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5d24-e01c-4e25-adf3-a0866f5e1d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:02.577984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb5d24-e01c-4e25-adf3-a0866f5e1d3b None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:02.581211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb5d24-e01c-4e25-adf3-a0866f5e1d3b None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:02.582716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb5d24-e01c-4e25-adf3-a0866f5e1d3b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:02.584434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 174/344] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:02 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:02.585207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb5d24-e01c-4e25-adf3-a0866f5e1d3b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:02.618215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 171/345] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:02.619773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54494864-4176-4d70-a2fd-edd652f0d2c8 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:02.801232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb5d24-e01c-4e25-adf3-a0866f5e1d3b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:02.805266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54494864-4176-4d70-a2fd-edd652f0d2c8 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:02.855575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc662ca7-c367-4268-b6f0-58e923b05d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:02.856449 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc662ca7-c367-4268-b6f0-58e923b05d0d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:02.856734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc662ca7-c367-4268-b6f0-58e923b05d0d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:02.857012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc662ca7-c367-4268-b6f0-58e923b05d0d None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:02.869698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc662ca7-c367-4268-b6f0-58e923b05d0d None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:02.871204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc662ca7-c367-4268-b6f0-58e923b05d0d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:02.872922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 172/346] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:02 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:02.873699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc662ca7-c367-4268-b6f0-58e923b05d0d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:02.885112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d9e83-c517-4448-8523-a02cf38354e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:02.885808 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d9e83-c517-4448-8523-a02cf38354e3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:02.886071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d9e83-c517-4448-8523-a02cf38354e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:02.886380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d9e83-c517-4448-8523-a02cf38354e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:02.887158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d9e83-c517-4448-8523-a02cf38354e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:02.887463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d9e83-c517-4448-8523-a02cf38354e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:02.888853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d9e83-c517-4448-8523-a02cf38354e3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:02.909100 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 175/347] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:02.910877 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d9e83-c517-4448-8523-a02cf38354e3 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:03.029268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc662ca7-c367-4268-b6f0-58e923b05d0d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:03.065479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a4a00-ae8d-4e45-b779-931f5eb45232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:03.065999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d9e83-c517-4448-8523-a02cf38354e3 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:03.066664 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4a00-ae8d-4e45-b779-931f5eb45232 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.067087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4a00-ae8d-4e45-b779-931f5eb45232 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.067514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a4a00-ae8d-4e45-b779-931f5eb45232 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.084712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a4a00-ae8d-4e45-b779-931f5eb45232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-0f0a4a00-ae8d-4e45-b779-931f5eb45232 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:03.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:03.096416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:03.097430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:03.100539 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 173/348] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:03.101795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a4a00-ae8d-4e45-b779-931f5eb45232 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:03.106344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4609c4d-6c38-44ec-8042-25d0b89e7d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:03.107116 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4609c4d-6c38-44ec-8042-25d0b89e7d55 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.107621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4609c4d-6c38-44ec-8042-25d0b89e7d55 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.108092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4609c4d-6c38-44ec-8042-25d0b89e7d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.109179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4609c4d-6c38-44ec-8042-25d0b89e7d55 None admin] RBAC: Adding query filter params (group.id=104928c57da54145ae76c66d2253b1f5, role.id=15a2a347c19845c9ac397da513eb944a, scope.project.id=235c60e5703c440590e4c72e2d095f74) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:03.109735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4609c4d-6c38-44ec-8042-25d0b89e7d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:03.111407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4609c4d-6c38-44ec-8042-25d0b89e7d55 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:03.118774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 176/349] 10.222.0.61 () {56 vars in 1376 bytes} [Sat May 14 15:33:02 2022] GET /identity/v3/role_assignments?group.id=104928c57da54145ae76c66d2253b1f5&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=15a2a347c19845c9ac397da513eb944a => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:03.120492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dda9bd-0165-42ee-b426-2fcf148df550 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.121005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dda9bd-0165-42ee-b426-2fcf148df550 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.121484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dda9bd-0165-42ee-b426-2fcf148df550 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.123385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 177/350] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:03.124398 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dda9bd-0165-42ee-b426-2fcf148df550 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:03.232472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a4a00-ae8d-4e45-b779-931f5eb45232 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:03.242392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dda9bd-0165-42ee-b426-2fcf148df550 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:03.278708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd00be1-c55f-416f-9931-45a50b5fc6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:03.279972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd00be1-c55f-416f-9931-45a50b5fc6fe None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.280421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd00be1-c55f-416f-9931-45a50b5fc6fe None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.280854 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd00be1-c55f-416f-9931-45a50b5fc6fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.283952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297b48a-c78b-42ee-bc01-c706e75fbc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:03.284885 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b48a-c78b-42ee-bc01-c706e75fbc29 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.285395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b48a-c78b-42ee-bc01-c706e75fbc29 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.285868 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b48a-c78b-42ee-bc01-c706e75fbc29 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.286852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297b48a-c78b-42ee-bc01-c706e75fbc29 None admin] RBAC: Adding query filter params (name=member) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:03.287369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297b48a-c78b-42ee-bc01-c706e75fbc29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:03.289003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297b48a-c78b-42ee-bc01-c706e75fbc29 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:03.299627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 178/351] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:33:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:03.301334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba491131-48d5-4291-a8d4-48437a0fd669 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.301833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba491131-48d5-4291-a8d4-48437a0fd669 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.302349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba491131-48d5-4291-a8d4-48437a0fd669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.321883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-ba491131-48d5-4291-a8d4-48437a0fd669 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:03.323563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ba491131-48d5-4291-a8d4-48437a0fd669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:03.371524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd00be1-c55f-416f-9931-45a50b5fc6fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:03.373344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd00be1-c55f-416f-9931-45a50b5fc6fe None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:03.397250 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 179/352] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:03.398491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba491131-48d5-4291-a8d4-48437a0fd669 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:03.483407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 174/353] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:03.484103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd00be1-c55f-416f-9931-45a50b5fc6fe None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:03.506737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba491131-48d5-4291-a8d4-48437a0fd669 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:03.543778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f3859-7948-4478-8780-f91dcc51da69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:03.545309 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f3859-7948-4478-8780-f91dcc51da69 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.545791 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f3859-7948-4478-8780-f91dcc51da69 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.546275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f3859-7948-4478-8780-f91dcc51da69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.592817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd00be1-c55f-416f-9931-45a50b5fc6fe None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:03.618200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f3859-7948-4478-8780-f91dcc51da69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:03.620213 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f3859-7948-4478-8780-f91dcc51da69 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:03.630720 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09197ec0-0b61-4423-bdad-3cb792153053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:03.631509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09197ec0-0b61-4423-bdad-3cb792153053 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.631793 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09197ec0-0b61-4423-bdad-3cb792153053 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.632065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09197ec0-0b61-4423-bdad-3cb792153053 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.644092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09197ec0-0b61-4423-bdad-3cb792153053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-09197ec0-0b61-4423-bdad-3cb792153053 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:03.652967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:03.653860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:03.654654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 175/354] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:03.655311 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09197ec0-0b61-4423-bdad-3cb792153053 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:03.725889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 180/355] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:03.727365 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f3859-7948-4478-8780-f91dcc51da69 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:03.758734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09197ec0-0b61-4423-bdad-3cb792153053 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:03.794999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bb519-e774-4be7-ae34-1baafecc3d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:03.797459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bb519-e774-4be7-ae34-1baafecc3d1c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.797459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bb519-e774-4be7-ae34-1baafecc3d1c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.797459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707bb519-e774-4be7-ae34-1baafecc3d1c None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.800908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bb519-e774-4be7-ae34-1baafecc3d1c None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:03.800908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707bb519-e774-4be7-ae34-1baafecc3d1c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:03.802330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 176/356] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:03 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:03.802940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bb519-e774-4be7-ae34-1baafecc3d1c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:03.829827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f3859-7948-4478-8780-f91dcc51da69 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:03.877420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d00e07-2b4e-4236-bf6e-1d494f0f4e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:03.877763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d00e07-2b4e-4236-bf6e-1d494f0f4e11 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.877970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d00e07-2b4e-4236-bf6e-1d494f0f4e11 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.878246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d00e07-2b4e-4236-bf6e-1d494f0f4e11 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.879102 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d00e07-2b4e-4236-bf6e-1d494f0f4e11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:03.879334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d00e07-2b4e-4236-bf6e-1d494f0f4e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:03.880730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d00e07-2b4e-4236-bf6e-1d494f0f4e11 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:03.892953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 181/357] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:33:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:03.894377 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e0c7-e375-4ca6-9f6b-e16e83b289a0 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.894673 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e0c7-e375-4ca6-9f6b-e16e83b289a0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.894949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073e0c7-e375-4ca6-9f6b-e16e83b289a0 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.896439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 182/358] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:03.897147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073e0c7-e375-4ca6-9f6b-e16e83b289a0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:03.933460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707bb519-e774-4be7-ae34-1baafecc3d1c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:03.973143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f6a45-464c-40ee-b005-4888da27bd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:03.974016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6a45-464c-40ee-b005-4888da27bd45 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.975314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6a45-464c-40ee-b005-4888da27bd45 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.975314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f6a45-464c-40ee-b005-4888da27bd45 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.975787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f6a45-464c-40ee-b005-4888da27bd45 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:03.977530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f6a45-464c-40ee-b005-4888da27bd45 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:03.979624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 177/359] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:03 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:03.981256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7c82-1b85-4573-984b-94396ac0c831 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:03.981256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7c82-1b85-4573-984b-94396ac0c831 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:03.981438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7c82-1b85-4573-984b-94396ac0c831 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:03.982786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 178/360] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:03.983339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c7c82-1b85-4573-984b-94396ac0c831 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:04.016966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073e0c7-e375-4ca6-9f6b-e16e83b289a0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:04.059383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b7336-034c-46f1-869c-8dd6f483142b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:04.060497 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7336-034c-46f1-869c-8dd6f483142b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.060774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7336-034c-46f1-869c-8dd6f483142b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.061046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b7336-034c-46f1-869c-8dd6f483142b None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.062229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b7336-034c-46f1-869c-8dd6f483142b None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:04.063696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b7336-034c-46f1-869c-8dd6f483142b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:04.065469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 183/361] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:03 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:04.066475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b1d0b-33eb-40be-a5fa-191bcf7da620 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.066756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b1d0b-33eb-40be-a5fa-191bcf7da620 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.067026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b1d0b-33eb-40be-a5fa-191bcf7da620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.089414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d89b1d0b-33eb-40be-a5fa-191bcf7da620 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:04.091364 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d89b1d0b-33eb-40be-a5fa-191bcf7da620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:04.100679 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c7c82-1b85-4573-984b-94396ac0c831 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:04.144086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fb44a-38c6-4aea-8fb6-ca1c1470c266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:04.144884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb44a-38c6-4aea-8fb6-ca1c1470c266 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.145156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb44a-38c6-4aea-8fb6-ca1c1470c266 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.145420 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb44a-38c6-4aea-8fb6-ca1c1470c266 None admin] PATH_INFO: `/v3/users/1022a8b2b5184eb4940dd96e9fa7aa99` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.148284 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fb44a-38c6-4aea-8fb6-ca1c1470c266 None admin] RBAC: Authorizing `identity:get_user(user_id=1022a8b2b5184eb4940dd96e9fa7aa99)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:04.149849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fb44a-38c6-4aea-8fb6-ca1c1470c266 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:04.151737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 179/362] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:33:03 2022] GET /identity/v3/users/1022a8b2b5184eb4940dd96e9fa7aa99 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:04.152914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ceb35-e89c-419f-8423-2aebe56edcaf None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.153197 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ceb35-e89c-419f-8423-2aebe56edcaf None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.153517 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ceb35-e89c-419f-8423-2aebe56edcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.170722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-bd3ceb35-e89c-419f-8423-2aebe56edcaf None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:04.171965 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-bd3ceb35-e89c-419f-8423-2aebe56edcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:04.176228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 184/363] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:04.177174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b1d0b-33eb-40be-a5fa-191bcf7da620 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:04.261361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 180/364] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:04.264305 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ceb35-e89c-419f-8423-2aebe56edcaf None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:04.301342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b1d0b-33eb-40be-a5fa-191bcf7da620 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:04.343513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b75cd6-2c99-4b09-a6e8-3427f493b84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:04.344380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75cd6-2c99-4b09-a6e8-3427f493b84b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.344722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75cd6-2c99-4b09-a6e8-3427f493b84b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.344999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b75cd6-2c99-4b09-a6e8-3427f493b84b None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.346175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b75cd6-2c99-4b09-a6e8-3427f493b84b None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:04.347648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b75cd6-2c99-4b09-a6e8-3427f493b84b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:04.349548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 185/365] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:04 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:04.350275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b75cd6-2c99-4b09-a6e8-3427f493b84b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:04.392368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ceb35-e89c-419f-8423-2aebe56edcaf None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:04.440755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b0ede-6207-45be-94f2-e19055097dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:04.441320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0ede-6207-45be-94f2-e19055097dd2 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.441607 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0ede-6207-45be-94f2-e19055097dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.441885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0ede-6207-45be-94f2-e19055097dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.442878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b0ede-6207-45be-94f2-e19055097dd2 None admin] RBAC: Adding query filter params (group.id=104928c57da54145ae76c66d2253b1f5, role.id=97f5bd452f314fa093a222f49facdac7, scope.project.id=235c60e5703c440590e4c72e2d095f74) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:04.443121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b0ede-6207-45be-94f2-e19055097dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:04.444575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b0ede-6207-45be-94f2-e19055097dd2 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:04.451625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 181/366] 10.222.0.61 () {56 vars in 1376 bytes} [Sat May 14 15:33:04 2022] GET /identity/v3/role_assignments?group.id=104928c57da54145ae76c66d2253b1f5&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=97f5bd452f314fa093a222f49facdac7 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:04.452321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b0ede-6207-45be-94f2-e19055097dd2 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:04.476180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b75cd6-2c99-4b09-a6e8-3427f493b84b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:04.513075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7d237-be81-4e04-bc3e-a3cc9e75d30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:04.514227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7d237-be81-4e04-bc3e-a3cc9e75d30a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.514714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7d237-be81-4e04-bc3e-a3cc9e75d30a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.515189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7d237-be81-4e04-bc3e-a3cc9e75d30a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.516214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7d237-be81-4e04-bc3e-a3cc9e75d30a None admin] RBAC: Adding query filter params (role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be, user.id=1022a8b2b5184eb4940dd96e9fa7aa99, scope.system=all) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:04.516721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7d237-be81-4e04-bc3e-a3cc9e75d30a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:04.518531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7d237-be81-4e04-bc3e-a3cc9e75d30a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:04.533231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 186/367] 10.222.0.61 () {56 vars in 1308 bytes} [Sat May 14 15:33:04 2022] GET /identity/v3/role_assignments?user.id=1022a8b2b5184eb4940dd96e9fa7aa99&scope.system=all&role.id=ff4f4562c9e74c8aa9b5c5b9739ee3be => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:04.534573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7d237-be81-4e04-bc3e-a3cc9e75d30a None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:04.567870 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b0ede-6207-45be-94f2-e19055097dd2 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:04.608833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7990a81-5dc9-4ed4-ae49-e02e965f383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:04.609650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990a81-5dc9-4ed4-ae49-e02e965f383e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.609988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990a81-5dc9-4ed4-ae49-e02e965f383e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.610272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7990a81-5dc9-4ed4-ae49-e02e965f383e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.623212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7990a81-5dc9-4ed4-ae49-e02e965f383e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-b7990a81-5dc9-4ed4-ae49-e02e965f383e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:04.631547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:04.632514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 182/368] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:04.634191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7990a81-5dc9-4ed4-ae49-e02e965f383e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:04.671309 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7d237-be81-4e04-bc3e-a3cc9e75d30a None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:04.710168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eae00-bd0e-40fd-be9d-bce5d0f95401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:04.711335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eae00-bd0e-40fd-be9d-bce5d0f95401 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.711881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eae00-bd0e-40fd-be9d-bce5d0f95401 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.712383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69eae00-bd0e-40fd-be9d-bce5d0f95401 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.724122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69eae00-bd0e-40fd-be9d-bce5d0f95401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-a69eae00-bd0e-40fd-be9d-bce5d0f95401 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:04.733397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:04.734354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:04.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:04.737861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 187/369] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:33:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:04.738980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eae00-bd0e-40fd-be9d-bce5d0f95401 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:04.757264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7990a81-5dc9-4ed4-ae49-e02e965f383e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:04.795115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a7d65-b429-4cda-9a4b-acde2c56f3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:04.795789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a7d65-b429-4cda-9a4b-acde2c56f3d3 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.796075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a7d65-b429-4cda-9a4b-acde2c56f3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.796355 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a7d65-b429-4cda-9a4b-acde2c56f3d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.797211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a7d65-b429-4cda-9a4b-acde2c56f3d3 None admin] RBAC: Adding query filter params (group.id=104928c57da54145ae76c66d2253b1f5, role.id=15a2a347c19845c9ac397da513eb944a, scope.project.id=c596122d9ed84658a8bf43ea14abeec6) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:04.797528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a7d65-b429-4cda-9a4b-acde2c56f3d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:04.799080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a7d65-b429-4cda-9a4b-acde2c56f3d3 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:04.810641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 183/370] 10.222.0.61 () {56 vars in 1376 bytes} [Sat May 14 15:33:04 2022] GET /identity/v3/role_assignments?group.id=104928c57da54145ae76c66d2253b1f5&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=15a2a347c19845c9ac397da513eb944a => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:04.810641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a7d65-b429-4cda-9a4b-acde2c56f3d3 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:04.917274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69eae00-bd0e-40fd-be9d-bce5d0f95401 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:04.955994 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a7d65-b429-4cda-9a4b-acde2c56f3d3 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:04.977811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322d269-7308-45da-b3cd-dc23daeb07e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:04.978823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322d269-7308-45da-b3cd-dc23daeb07e1 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.979254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322d269-7308-45da-b3cd-dc23daeb07e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.979769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322d269-7308-45da-b3cd-dc23daeb07e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.980721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322d269-7308-45da-b3cd-dc23daeb07e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:04.981225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322d269-7308-45da-b3cd-dc23daeb07e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:04.982885 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322d269-7308-45da-b3cd-dc23daeb07e1 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:04.995265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236d443-891c-45a7-a845-007b76eec5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:04.995984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d443-891c-45a7-a845-007b76eec5c3 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:04.996211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d443-891c-45a7-a845-007b76eec5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:04.996530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236d443-891c-45a7-a845-007b76eec5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:04.996737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 188/371] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:04.997221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236d443-891c-45a7-a845-007b76eec5c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:04.997950 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236d443-891c-45a7-a845-007b76eec5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:04.998944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236d443-891c-45a7-a845-007b76eec5c3 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:05.009033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322d269-7308-45da-b3cd-dc23daeb07e1 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:05.014152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 184/372] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:05.025672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236d443-891c-45a7-a845-007b76eec5c3 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:05.171252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322d269-7308-45da-b3cd-dc23daeb07e1 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:05.196926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236d443-891c-45a7-a845-007b76eec5c3 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:05.211086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a8184-f029-4d3b-8f00-de5d44e4c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:05.212260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a8184-f029-4d3b-8f00-de5d44e4c624 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:05.212570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a8184-f029-4d3b-8f00-de5d44e4c624 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:05.212844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a8184-f029-4d3b-8f00-de5d44e4c624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:05.240309 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d7414-6ea2-423c-a797-e0ebd985e6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:05.241320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d7414-6ea2-423c-a797-e0ebd985e6bd None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:05.242235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d7414-6ea2-423c-a797-e0ebd985e6bd None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:05.242953 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d7414-6ea2-423c-a797-e0ebd985e6bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:05.319950 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d7414-6ea2-423c-a797-e0ebd985e6bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:05.322343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d7414-6ea2-423c-a797-e0ebd985e6bd None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:05.361644 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a8184-f029-4d3b-8f00-de5d44e4c624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:05.363137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a8184-f029-4d3b-8f00-de5d44e4c624 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:05.449383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 185/373] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:05.454966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d7414-6ea2-423c-a797-e0ebd985e6bd None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:05.548613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 189/374] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:05.571355 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a8184-f029-4d3b-8f00-de5d44e4c624 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:05.601624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d7414-6ea2-423c-a797-e0ebd985e6bd None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:05.640859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a7c2f-b7a9-496d-9111-55d4e4acfc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:05.641724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a7c2f-b7a9-496d-9111-55d4e4acfc03 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:05.642000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a7c2f-b7a9-496d-9111-55d4e4acfc03 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:05.642270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a7c2f-b7a9-496d-9111-55d4e4acfc03 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:05.644240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a7c2f-b7a9-496d-9111-55d4e4acfc03 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:05.647257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a7c2f-b7a9-496d-9111-55d4e4acfc03 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:05.649400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 186/375] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:05 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:05.654438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a7c2f-b7a9-496d-9111-55d4e4acfc03 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:05.768701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a7c2f-b7a9-496d-9111-55d4e4acfc03 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:05.777790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a8184-f029-4d3b-8f00-de5d44e4c624 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:05.809845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf15c7-9b4d-4882-9d76-7b33e5bc08de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:05.810947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf15c7-9b4d-4882-9d76-7b33e5bc08de None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:05.811231 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf15c7-9b4d-4882-9d76-7b33e5bc08de None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:05.811506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf15c7-9b4d-4882-9d76-7b33e5bc08de None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:05.812966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf15c7-9b4d-4882-9d76-7b33e5bc08de None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:05.817556 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf15c7-9b4d-4882-9d76-7b33e5bc08de None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:05.817556 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 187/376] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:05 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:05.819842 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d8170-8203-4aa2-8f42-11ba989a0606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:05.820793 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d8170-8203-4aa2-8f42-11ba989a0606 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:05.821431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d8170-8203-4aa2-8f42-11ba989a0606 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:05.821784 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d8170-8203-4aa2-8f42-11ba989a0606 None admin] PATH_INFO: `/v3/projects/562024bfc95645e098dcd57dfe3300a0` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:05.822496 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf15c7-9b4d-4882-9d76-7b33e5bc08de None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:05.824025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d8170-8203-4aa2-8f42-11ba989a0606 None admin] RBAC: Authorizing `identity:get_project(project_id=562024bfc95645e098dcd57dfe3300a0)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:05.826997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d8170-8203-4aa2-8f42-11ba989a0606 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:05.830094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 190/377] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:05 2022] GET /identity/v3/projects/562024bfc95645e098dcd57dfe3300a0 => generated 344 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:05.846367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d8170-8203-4aa2-8f42-11ba989a0606 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:05.944191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf15c7-9b4d-4882-9d76-7b33e5bc08de None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:05.968210 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d8170-8203-4aa2-8f42-11ba989a0606 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:05.980817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94566-ff99-4b8b-8fb6-d5324af17b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:05.981480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94566-ff99-4b8b-8fb6-d5324af17b91 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:05.981763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94566-ff99-4b8b-8fb6-d5324af17b91 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:05.982040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94566-ff99-4b8b-8fb6-d5324af17b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:05.982912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b94566-ff99-4b8b-8fb6-d5324af17b91 None admin] RBAC: Adding query filter params (group.id=104928c57da54145ae76c66d2253b1f5, role.id=97f5bd452f314fa093a222f49facdac7, scope.project.id=c596122d9ed84658a8bf43ea14abeec6) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:05.983229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b94566-ff99-4b8b-8fb6-d5324af17b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:05.984663 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b94566-ff99-4b8b-8fb6-d5324af17b91 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:05.991002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 188/378] 10.222.0.61 () {56 vars in 1376 bytes} [Sat May 14 15:33:05 2022] GET /identity/v3/role_assignments?group.id=104928c57da54145ae76c66d2253b1f5&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=97f5bd452f314fa093a222f49facdac7 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:06.047353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379b5b-8642-43de-b077-534d2675156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:06.048240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379b5b-8642-43de-b077-534d2675156b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:06.048517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379b5b-8642-43de-b077-534d2675156b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:06.048788 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379b5b-8642-43de-b077-534d2675156b None admin] PATH_INFO: `/v3/groups/3d3e9e391bc348a181b0f852d835c912` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:06.068197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d379b5b-8642-43de-b077-534d2675156b None admin] RBAC: Authorizing `identity:get_group(group_id=3d3e9e391bc348a181b0f852d835c912)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:06.069739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d379b5b-8642-43de-b077-534d2675156b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:06.072301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 191/379] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:05 2022] GET /identity/v3/groups/3d3e9e391bc348a181b0f852d835c912 => generated 229 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:06.078588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94566-ff99-4b8b-8fb6-d5324af17b91 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:06.257743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94566-ff99-4b8b-8fb6-d5324af17b91 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:06.309911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b81792-3bcd-4984-bbab-894a7cd4088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:06.314192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b81792-3bcd-4984-bbab-894a7cd4088c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:06.314813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b81792-3bcd-4984-bbab-894a7cd4088c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:06.315283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b81792-3bcd-4984-bbab-894a7cd4088c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:06.316471 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b81792-3bcd-4984-bbab-894a7cd4088c None admin] RBAC: Adding query filter params (group.id=3d3e9e391bc348a181b0f852d835c912, role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=562024bfc95645e098dcd57dfe3300a0) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:06.317306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b81792-3bcd-4984-bbab-894a7cd4088c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:06.319398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b81792-3bcd-4984-bbab-894a7cd4088c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:06.329406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 189/380] 10.222.0.61 () {56 vars in 1376 bytes} [Sat May 14 15:33:06 2022] GET /identity/v3/role_assignments?group.id=3d3e9e391bc348a181b0f852d835c912&scope.project.id=562024bfc95645e098dcd57dfe3300a0&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:06.364734 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18fe7-6370-4e83-a97e-f7a6f69a286e None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:06.365072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18fe7-6370-4e83-a97e-f7a6f69a286e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:06.365303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18fe7-6370-4e83-a97e-f7a6f69a286e None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:06.367106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 192/381] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:06.376432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad69e9-570e-4b64-a855-b7b246f793ba None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:06.376432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad69e9-570e-4b64-a855-b7b246f793ba None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:06.376432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad69e9-570e-4b64-a855-b7b246f793ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:06.396571 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-51ad69e9-570e-4b64-a855-b7b246f793ba None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:06.401925 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-51ad69e9-570e-4b64-a855-b7b246f793ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:06.540828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 190/382] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:06.591515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea18fe7-6370-4e83-a97e-f7a6f69a286e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:06.755967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea18fe7-6370-4e83-a97e-f7a6f69a286e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:06.795144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70d6e2-fb3d-4c44-a1a0-bb1e1dabf3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:06.795951 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70d6e2-fb3d-4c44-a1a0-bb1e1dabf3c6 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:06.796232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70d6e2-fb3d-4c44-a1a0-bb1e1dabf3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:06.796569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70d6e2-fb3d-4c44-a1a0-bb1e1dabf3c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:06.808094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70d6e2-fb3d-4c44-a1a0-bb1e1dabf3c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-9e70d6e2-fb3d-4c44-a1a0-bb1e1dabf3c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:06.816083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:06.817674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:06.818865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 193/383] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:06.826016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad69e9-570e-4b64-a855-b7b246f793ba None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:06.959233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad69e9-570e-4b64-a855-b7b246f793ba None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:07.002627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a158f4-1494-4dd6-b85f-3cc5dfeeae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:07.003305 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a158f4-1494-4dd6-b85f-3cc5dfeeae7d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:07.003583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a158f4-1494-4dd6-b85f-3cc5dfeeae7d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:07.003890 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a158f4-1494-4dd6-b85f-3cc5dfeeae7d None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:07.004647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a158f4-1494-4dd6-b85f-3cc5dfeeae7d None admin] RBAC: Adding query filter params (name=member) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:07.004952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a158f4-1494-4dd6-b85f-3cc5dfeeae7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:07.006341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a158f4-1494-4dd6-b85f-3cc5dfeeae7d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:07.016321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 191/384] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:33:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:07.022043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70d6e2-fb3d-4c44-a1a0-bb1e1dabf3c6 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:07.172095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70d6e2-fb3d-4c44-a1a0-bb1e1dabf3c6 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:07.217435 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f107593-dcf9-40d7-af03-c065d7b423f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:07.218230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107593-dcf9-40d7-af03-c065d7b423f6 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:07.218537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107593-dcf9-40d7-af03-c065d7b423f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:07.218810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107593-dcf9-40d7-af03-c065d7b423f6 None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:07.220059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f107593-dcf9-40d7-af03-c065d7b423f6 None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:07.221642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f107593-dcf9-40d7-af03-c065d7b423f6 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:07.223386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 194/385] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:07 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:07.235513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a158f4-1494-4dd6-b85f-3cc5dfeeae7d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:07.375018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a158f4-1494-4dd6-b85f-3cc5dfeeae7d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:07.413676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883a48d-4cd2-4606-9a4a-8765b59b9b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:07.414626 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883a48d-4cd2-4606-9a4a-8765b59b9b11 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:07.414974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883a48d-4cd2-4606-9a4a-8765b59b9b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:07.415252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883a48d-4cd2-4606-9a4a-8765b59b9b11 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:07.416497 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883a48d-4cd2-4606-9a4a-8765b59b9b11 None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:07.417923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883a48d-4cd2-4606-9a4a-8765b59b9b11 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:07.419964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 192/386] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:07 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:07.425301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f107593-dcf9-40d7-af03-c065d7b423f6 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:07.564634 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f107593-dcf9-40d7-af03-c065d7b423f6 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:07.610990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c9387-dc9d-47fb-be8a-209788a1bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:07.611886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9387-dc9d-47fb-be8a-209788a1bcdc None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:07.612167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9387-dc9d-47fb-be8a-209788a1bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:07.612440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9387-dc9d-47fb-be8a-209788a1bcdc None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74/groups/104928c57da54145ae76c66d2253b1f5/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:07.614606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c9387-dc9d-47fb-be8a-209788a1bcdc None admin] RBAC: Authorizing `identity:create_grant(project_id=235c60e5703c440590e4c72e2d095f74, group_id=104928c57da54145ae76c66d2253b1f5, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:07.616042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c9387-dc9d-47fb-be8a-209788a1bcdc None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:07.635246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 195/387] 10.222.0.61 () {58 vars in 1442 bytes} [Sat May 14 15:33:07 2022] PUT /identity/v3/projects/235c60e5703c440590e4c72e2d095f74/groups/104928c57da54145ae76c66d2253b1f5/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:07.949685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3624-da0a-4c0e-8878-14cc477f0fe5 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:07.950204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3624-da0a-4c0e-8878-14cc477f0fe5 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:07.950360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3624-da0a-4c0e-8878-14cc477f0fe5 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:07.952048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 193/388] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:07.957937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a3d9c-9574-43d4-93e3-24c246fb4bd7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:07.958479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a3d9c-9574-43d4-93e3-24c246fb4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:07.958558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a3d9c-9574-43d4-93e3-24c246fb4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:07.975990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-717a3d9c-9574-43d4-93e3-24c246fb4bd7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:07.977489 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-717a3d9c-9574-43d4-93e3-24c246fb4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:08.051336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 196/389] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:08.076529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3624-da0a-4c0e-8878-14cc477f0fe5 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:08.158488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830fccf-0631-41d9-9aca-1da33c692dd1 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:08.159087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830fccf-0631-41d9-9aca-1da33c692dd1 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:08.159563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830fccf-0631-41d9-9aca-1da33c692dd1 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:08.161340 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 197/390] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:33:08.168903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298ab0-9a88-4e09-a457-769dfb0bd62b None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:08.169489 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298ab0-9a88-4e09-a457-769dfb0bd62b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:08.169966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1298ab0-9a88-4e09-a457-769dfb0bd62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:08.207133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c1298ab0-9a88-4e09-a457-769dfb0bd62b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:08.208310 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c1298ab0-9a88-4e09-a457-769dfb0bd62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:08.212360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3624-da0a-4c0e-8878-14cc477f0fe5 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:08.255586 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ccf5-c8e5-4004-a8fc-0beeafa7cebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:08.256391 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ccf5-c8e5-4004-a8fc-0beeafa7cebd None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:08.256668 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ccf5-c8e5-4004-a8fc-0beeafa7cebd None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:08.256935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ccf5-c8e5-4004-a8fc-0beeafa7cebd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:08.274002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ccf5-c8e5-4004-a8fc-0beeafa7cebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-1809ccf5-c8e5-4004-a8fc-0beeafa7cebd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:08.283460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:08.284399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:08.285193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:08.296605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 194/391] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:08.303330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ccf5-c8e5-4004-a8fc-0beeafa7cebd None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:08.342445 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 198/392] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:08.382155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1298ab0-9a88-4e09-a457-769dfb0bd62b None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:08.407793 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ccf5-c8e5-4004-a8fc-0beeafa7cebd None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:08.445536 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ba1ae-d97a-4182-b976-2c5bcfb705e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:08.446736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba1ae-d97a-4182-b976-2c5bcfb705e2 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:08.447079 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba1ae-d97a-4182-b976-2c5bcfb705e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:08.447395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ba1ae-d97a-4182-b976-2c5bcfb705e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:08.448145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ba1ae-d97a-4182-b976-2c5bcfb705e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:08.448449 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ba1ae-d97a-4182-b976-2c5bcfb705e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:08.449825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ba1ae-d97a-4182-b976-2c5bcfb705e2 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:08.468097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 195/393] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:33:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:08.474613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ba1ae-d97a-4182-b976-2c5bcfb705e2 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:08.580931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ba1ae-d97a-4182-b976-2c5bcfb705e2 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:08.585988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1298ab0-9a88-4e09-a457-769dfb0bd62b None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:08.615459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9057c-d8da-4ad3-aec3-6fb6ad2d4173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:08.616313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9057c-d8da-4ad3-aec3-6fb6ad2d4173 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:08.616595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9057c-d8da-4ad3-aec3-6fb6ad2d4173 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:08.616863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9057c-d8da-4ad3-aec3-6fb6ad2d4173 None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:08.618124 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9057c-d8da-4ad3-aec3-6fb6ad2d4173 None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:08.619599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d9057c-d8da-4ad3-aec3-6fb6ad2d4173 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:08.621508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 196/394] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:08 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:08.634080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9057c-d8da-4ad3-aec3-6fb6ad2d4173 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:08.667662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ec789-9896-46ad-b8a3-3894ad8988a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:08.668589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec789-9896-46ad-b8a3-3894ad8988a6 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:08.668872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec789-9896-46ad-b8a3-3894ad8988a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:08.669148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ec789-9896-46ad-b8a3-3894ad8988a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:08.697648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ec789-9896-46ad-b8a3-3894ad8988a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-3e8ec789-9896-46ad-b8a3-3894ad8988a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:08.705741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:08.706694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:08.707820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:08.715434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 199/395] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:33:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:08.721089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ec789-9896-46ad-b8a3-3894ad8988a6 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:08.734662 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9057c-d8da-4ad3-aec3-6fb6ad2d4173 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:08.773433 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e3b46-591a-4ba4-82e2-a91ad79b0ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:08.774846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3b46-591a-4ba4-82e2-a91ad79b0ea7 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:08.775121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3b46-591a-4ba4-82e2-a91ad79b0ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:08.775389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e3b46-591a-4ba4-82e2-a91ad79b0ea7 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:08.776758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e3b46-591a-4ba4-82e2-a91ad79b0ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:08.778186 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e3b46-591a-4ba4-82e2-a91ad79b0ea7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:08.779898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 197/396] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:08 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:08.787351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e3b46-591a-4ba4-82e2-a91ad79b0ea7 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:08.930047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e3b46-591a-4ba4-82e2-a91ad79b0ea7 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:08.946270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ec789-9896-46ad-b8a3-3894ad8988a6 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:08.989230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f79e8-b7ce-49e5-a17d-8121cf799cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:08.990805 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f79e8-b7ce-49e5-a17d-8121cf799cdb None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:08.991316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f79e8-b7ce-49e5-a17d-8121cf799cdb None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:08.991965 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f79e8-b7ce-49e5-a17d-8121cf799cdb None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6/groups/104928c57da54145ae76c66d2253b1f5/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:08.997098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f79e8-b7ce-49e5-a17d-8121cf799cdb None admin] RBAC: Authorizing `identity:create_grant(project_id=c596122d9ed84658a8bf43ea14abeec6, group_id=104928c57da54145ae76c66d2253b1f5, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:08.998832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f79e8-b7ce-49e5-a17d-8121cf799cdb None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:09.012520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61c953-7610-415c-bfaa-cd25a2f89c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:09.016359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61c953-7610-415c-bfaa-cd25a2f89c1c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.018081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61c953-7610-415c-bfaa-cd25a2f89c1c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.018746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61c953-7610-415c-bfaa-cd25a2f89c1c None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.020242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61c953-7610-415c-bfaa-cd25a2f89c1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:09.022647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 198/397] 10.222.0.61 () {58 vars in 1442 bytes} [Sat May 14 15:33:08 2022] PUT /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6/groups/104928c57da54145ae76c66d2253b1f5/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:09.023228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61c953-7610-415c-bfaa-cd25a2f89c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:09.025697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61c953-7610-415c-bfaa-cd25a2f89c1c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:09.041506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 200/398] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:09.047323 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f79e8-b7ce-49e5-a17d-8121cf799cdb None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:09.059026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a763def-0dcb-4421-be0c-df9caafe0e57 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.061620 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a763def-0dcb-4421-be0c-df9caafe0e57 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.062137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a763def-0dcb-4421-be0c-df9caafe0e57 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.063858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 201/399] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:09.069560 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566401c-82a5-4247-b7a2-294b8baff59b None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.070180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566401c-82a5-4247-b7a2-294b8baff59b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.070732 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566401c-82a5-4247-b7a2-294b8baff59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.108178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d566401c-82a5-4247-b7a2-294b8baff59b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:09.109398 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d566401c-82a5-4247-b7a2-294b8baff59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:09.250512 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 202/400] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:09.250924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f79e8-b7ce-49e5-a17d-8121cf799cdb None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:09.285011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566401c-82a5-4247-b7a2-294b8baff59b None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:09.303923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77193eb-62ce-4281-acbe-b969d9a7e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:09.305074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77193eb-62ce-4281-acbe-b969d9a7e810 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.305355 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77193eb-62ce-4281-acbe-b969d9a7e810 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.305676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77193eb-62ce-4281-acbe-b969d9a7e810 None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.308100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77193eb-62ce-4281-acbe-b969d9a7e810 None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:09.309173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77193eb-62ce-4281-acbe-b969d9a7e810 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:09.313487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 199/401] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:09 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:09.332751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77193eb-62ce-4281-acbe-b969d9a7e810 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:09.418336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566401c-82a5-4247-b7a2-294b8baff59b None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:09.449223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb2b16-d167-458e-9a1b-210b6dbce285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:09.450200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb2b16-d167-458e-9a1b-210b6dbce285 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.450330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb2b16-d167-458e-9a1b-210b6dbce285 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.450574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb2b16-d167-458e-9a1b-210b6dbce285 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.458661 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77193eb-62ce-4281-acbe-b969d9a7e810 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:09.462469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb2b16-d167-458e-9a1b-210b6dbce285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-8deb2b16-d167-458e-9a1b-210b6dbce285 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:09.470123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:09.471089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:09.471864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 203/402] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:33:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:09.479259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb2b16-d167-458e-9a1b-210b6dbce285 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:09.499259 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e445e8-7a51-4f60-aed3-007413fee917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:09.500479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e445e8-7a51-4f60-aed3-007413fee917 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.501042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e445e8-7a51-4f60-aed3-007413fee917 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.501516 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e445e8-7a51-4f60-aed3-007413fee917 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.503016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e445e8-7a51-4f60-aed3-007413fee917 None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:09.504818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e445e8-7a51-4f60-aed3-007413fee917 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:09.506785 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 200/403] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:09 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:09.508185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec26ad0-0997-4cc4-a736-ffb84ab89a50 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.508747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec26ad0-0997-4cc4-a736-ffb84ab89a50 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.509216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec26ad0-0997-4cc4-a736-ffb84ab89a50 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.511023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 201/404] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:09.516170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec26ad0-0997-4cc4-a736-ffb84ab89a50 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:09.610413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb2b16-d167-458e-9a1b-210b6dbce285 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:09.637367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec26ad0-0997-4cc4-a736-ffb84ab89a50 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:09.645530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059b281-d4ac-4d95-9009-7f133bddcad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:09.646281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b281-d4ac-4d95-9009-7f133bddcad6 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.646710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b281-d4ac-4d95-9009-7f133bddcad6 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.647086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059b281-d4ac-4d95-9009-7f133bddcad6 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.647889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059b281-d4ac-4d95-9009-7f133bddcad6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:09.648269 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059b281-d4ac-4d95-9009-7f133bddcad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:09.650752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059b281-d4ac-4d95-9009-7f133bddcad6 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:09.659296 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 204/405] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:09.660796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dfff2-bd21-4aa0-9b45-f0db1362b607 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.661053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dfff2-bd21-4aa0-9b45-f0db1362b607 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.661449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dfff2-bd21-4aa0-9b45-f0db1362b607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.677887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f25dfff2-bd21-4aa0-9b45-f0db1362b607 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:09.679200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f25dfff2-bd21-4aa0-9b45-f0db1362b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:09.680340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1015-4c98-43b8-afa4-9dc2b0afb94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:09.682200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1015-4c98-43b8-afa4-9dc2b0afb94c None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.683436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1015-4c98-43b8-afa4-9dc2b0afb94c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.683893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1015-4c98-43b8-afa4-9dc2b0afb94c None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74/groups/104928c57da54145ae76c66d2253b1f5/roles/97f5bd452f314fa093a222f49facdac7` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.686334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac1015-4c98-43b8-afa4-9dc2b0afb94c None admin] RBAC: Authorizing `identity:create_grant(project_id=235c60e5703c440590e4c72e2d095f74, group_id=104928c57da54145ae76c66d2253b1f5, role_id=97f5bd452f314fa093a222f49facdac7)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:09.688342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac1015-4c98-43b8-afa4-9dc2b0afb94c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:09.704326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 202/406] 10.222.0.61 () {58 vars in 1442 bytes} [Sat May 14 15:33:09 2022] PUT /identity/v3/projects/235c60e5703c440590e4c72e2d095f74/groups/104928c57da54145ae76c66d2253b1f5/roles/97f5bd452f314fa093a222f49facdac7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:33:09.705580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1015-4c98-43b8-afa4-9dc2b0afb94c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:09.758009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 205/407] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:09.781661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dfff2-bd21-4aa0-9b45-f0db1362b607 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:09.820619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1015-4c98-43b8-afa4-9dc2b0afb94c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:09.874781 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad45571-8da3-49e4-b3c8-e26625a86cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:09.875836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad45571-8da3-49e4-b3c8-e26625a86cc5 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.876193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad45571-8da3-49e4-b3c8-e26625a86cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.876582 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad45571-8da3-49e4-b3c8-e26625a86cc5 None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.878020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad45571-8da3-49e4-b3c8-e26625a86cc5 None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:09.879717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad45571-8da3-49e4-b3c8-e26625a86cc5 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:09.881663 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 203/408] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:09 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:09.887576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad45571-8da3-49e4-b3c8-e26625a86cc5 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:09.916272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dfff2-bd21-4aa0-9b45-f0db1362b607 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:09.958386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631dfe4-48a7-47ca-912f-50b09ae26a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:09.959524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631dfe4-48a7-47ca-912f-50b09ae26a76 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:09.959985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631dfe4-48a7-47ca-912f-50b09ae26a76 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:09.960433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631dfe4-48a7-47ca-912f-50b09ae26a76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:09.974768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631dfe4-48a7-47ca-912f-50b09ae26a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f631dfe4-48a7-47ca-912f-50b09ae26a76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:09.986253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:09.987226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:09.988011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:09.990765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 206/409] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:09.996080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631dfe4-48a7-47ca-912f-50b09ae26a76 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:10.036264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad45571-8da3-49e4-b3c8-e26625a86cc5 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:10.086915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493b752-5059-4c2d-9959-3adf4ced71f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:10.088504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493b752-5059-4c2d-9959-3adf4ced71f1 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:10.088932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493b752-5059-4c2d-9959-3adf4ced71f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:10.089403 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493b752-5059-4c2d-9959-3adf4ced71f1 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:10.090873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493b752-5059-4c2d-9959-3adf4ced71f1 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:10.092619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493b752-5059-4c2d-9959-3adf4ced71f1 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:10.094878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 204/410] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:09 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:10.100207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493b752-5059-4c2d-9959-3adf4ced71f1 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:10.120980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631dfe4-48a7-47ca-912f-50b09ae26a76 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:10.157965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196a2f4-cdb1-439b-a8b5-1c2964e3d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:10.159054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196a2f4-cdb1-439b-a8b5-1c2964e3d57e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:10.159478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196a2f4-cdb1-439b-a8b5-1c2964e3d57e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:10.159924 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196a2f4-cdb1-439b-a8b5-1c2964e3d57e None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:10.160828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196a2f4-cdb1-439b-a8b5-1c2964e3d57e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:10.161276 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196a2f4-cdb1-439b-a8b5-1c2964e3d57e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:10.163144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196a2f4-cdb1-439b-a8b5-1c2964e3d57e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:10.174000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 207/411] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:10.183371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196a2f4-cdb1-439b-a8b5-1c2964e3d57e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:10.245565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493b752-5059-4c2d-9959-3adf4ced71f1 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:10.291168 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e086b-f82f-4b4d-829a-e514d4e2d9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:10.292056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e086b-f82f-4b4d-829a-e514d4e2d9a3 None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:10.292339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e086b-f82f-4b4d-829a-e514d4e2d9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:10.292613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e086b-f82f-4b4d-829a-e514d4e2d9a3 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6/groups/104928c57da54145ae76c66d2253b1f5/roles/97f5bd452f314fa093a222f49facdac7` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:10.294492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196a2f4-cdb1-439b-a8b5-1c2964e3d57e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:10.299116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e086b-f82f-4b4d-829a-e514d4e2d9a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c596122d9ed84658a8bf43ea14abeec6, group_id=104928c57da54145ae76c66d2253b1f5, role_id=97f5bd452f314fa093a222f49facdac7)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:10.300559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e086b-f82f-4b4d-829a-e514d4e2d9a3 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:10.322715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 205/412] 10.222.0.61 () {58 vars in 1442 bytes} [Sat May 14 15:33:10 2022] PUT /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6/groups/104928c57da54145ae76c66d2253b1f5/roles/97f5bd452f314fa093a222f49facdac7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:10.339109 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4453547-5b62-496a-ad2c-6f47f229e5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:10.340258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4453547-5b62-496a-ad2c-6f47f229e5fd None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:10.340684 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4453547-5b62-496a-ad2c-6f47f229e5fd None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:10.341098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4453547-5b62-496a-ad2c-6f47f229e5fd None admin] PATH_INFO: `/v3/groups/3d3e9e391bc348a181b0f852d835c912` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:10.347313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4453547-5b62-496a-ad2c-6f47f229e5fd None admin] RBAC: Authorizing `identity:get_group(group_id=3d3e9e391bc348a181b0f852d835c912)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:10.349065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4453547-5b62-496a-ad2c-6f47f229e5fd None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:10.351063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 208/413] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:10 2022] GET /identity/v3/groups/3d3e9e391bc348a181b0f852d835c912 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:10.357847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e086b-f82f-4b4d-829a-e514d4e2d9a3 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:10.515505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e086b-f82f-4b4d-829a-e514d4e2d9a3 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:10.567555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd408e-ab2b-4dbb-8abe-0bc35bdcba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:10.568338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd408e-ab2b-4dbb-8abe-0bc35bdcba1c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:10.568618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd408e-ab2b-4dbb-8abe-0bc35bdcba1c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:10.568898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd408e-ab2b-4dbb-8abe-0bc35bdcba1c None admin] PATH_INFO: `/v3/projects/562024bfc95645e098dcd57dfe3300a0` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:10.571755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd408e-ab2b-4dbb-8abe-0bc35bdcba1c None admin] RBAC: Authorizing `identity:get_project(project_id=562024bfc95645e098dcd57dfe3300a0)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:10.573411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd408e-ab2b-4dbb-8abe-0bc35bdcba1c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:10.575474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 206/414] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:10 2022] GET /identity/v3/projects/562024bfc95645e098dcd57dfe3300a0 => generated 344 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:10.581257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4453547-5b62-496a-ad2c-6f47f229e5fd None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:10.611391 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065ff3d-f7ce-409e-a72b-b35daffb3190 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:10.611677 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065ff3d-f7ce-409e-a72b-b35daffb3190 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:10.611955 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065ff3d-f7ce-409e-a72b-b35daffb3190 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:10.617127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 207/415] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:33:10.619558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709e949-e7f0-4aa0-8777-006fd1d64304 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:10.619841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709e949-e7f0-4aa0-8777-006fd1d64304 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:10.620121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709e949-e7f0-4aa0-8777-006fd1d64304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:10.645491 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7709e949-e7f0-4aa0-8777-006fd1d64304 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:10.647237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7709e949-e7f0-4aa0-8777-006fd1d64304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:10.702231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4453547-5b62-496a-ad2c-6f47f229e5fd None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:10.740454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238a433-37b4-4125-9dbb-66ddc2eb427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:10.741744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a433-37b4-4125-9dbb-66ddc2eb427f None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:10.742545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a433-37b4-4125-9dbb-66ddc2eb427f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:10.743308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a433-37b4-4125-9dbb-66ddc2eb427f None admin] PATH_INFO: `/v3/projects/562024bfc95645e098dcd57dfe3300a0/groups/3d3e9e391bc348a181b0f852d835c912/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:10.745709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238a433-37b4-4125-9dbb-66ddc2eb427f None admin] RBAC: Authorizing `identity:create_grant(project_id=562024bfc95645e098dcd57dfe3300a0, group_id=3d3e9e391bc348a181b0f852d835c912, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:10.747470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238a433-37b4-4125-9dbb-66ddc2eb427f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:10.753236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 208/416] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:10.772572 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 209/417] 10.222.0.61 () {58 vars in 1442 bytes} [Sat May 14 15:33:10 2022] PUT /identity/v3/projects/562024bfc95645e098dcd57dfe3300a0/groups/3d3e9e391bc348a181b0f852d835c912/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:10.794449 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709e949-e7f0-4aa0-8777-006fd1d64304 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:10.922624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709e949-e7f0-4aa0-8777-006fd1d64304 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:10.958522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8a9fa-7afb-487a-a84b-8b7896b2dadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:10.959615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8a9fa-7afb-487a-a84b-8b7896b2dadc None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:10.960045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8a9fa-7afb-487a-a84b-8b7896b2dadc None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:10.960465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8a9fa-7afb-487a-a84b-8b7896b2dadc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:10.973495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8a9fa-7afb-487a-a84b-8b7896b2dadc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-5de8a9fa-7afb-487a-a84b-8b7896b2dadc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:10.982937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:10.984189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:10.985413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:10.987799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 209/418] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:10.995405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238a433-37b4-4125-9dbb-66ddc2eb427f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:11.117191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238a433-37b4-4125-9dbb-66ddc2eb427f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:11.152446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d39103-48eb-4f76-8541-8edd472ad77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:11.153795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39103-48eb-4f76-8541-8edd472ad77c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:11.154224 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39103-48eb-4f76-8541-8edd472ad77c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:11.154692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39103-48eb-4f76-8541-8edd472ad77c None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:11.155590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d39103-48eb-4f76-8541-8edd472ad77c None admin] RBAC: Adding query filter params (name=member) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:11.156042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d39103-48eb-4f76-8541-8edd472ad77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:11.157559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d39103-48eb-4f76-8541-8edd472ad77c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:11.166786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 210/419] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:33:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:11.171977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8a9fa-7afb-487a-a84b-8b7896b2dadc None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:11.278821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8a9fa-7afb-487a-a84b-8b7896b2dadc None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:11.314101 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb99da-684f-48b8-a062-c68a1a4caba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:11.315098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb99da-684f-48b8-a062-c68a1a4caba0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:11.315572 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb99da-684f-48b8-a062-c68a1a4caba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:11.316013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb99da-684f-48b8-a062-c68a1a4caba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:11.386199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb99da-684f-48b8-a062-c68a1a4caba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:11.387889 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb99da-684f-48b8-a062-c68a1a4caba0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:11.488920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 210/420] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:11.498337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d39103-48eb-4f76-8541-8edd472ad77c None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:11.638427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d39103-48eb-4f76-8541-8edd472ad77c None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:11.687906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761da365-4a51-4bdf-bedc-5108dbe53ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:11.688769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761da365-4a51-4bdf-bedc-5108dbe53ff5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:11.689048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761da365-4a51-4bdf-bedc-5108dbe53ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:11.689313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761da365-4a51-4bdf-bedc-5108dbe53ff5 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:11.690570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761da365-4a51-4bdf-bedc-5108dbe53ff5 None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:11.692074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761da365-4a51-4bdf-bedc-5108dbe53ff5 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:11.694114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 211/421] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:11 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:11.700010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb99da-684f-48b8-a062-c68a1a4caba0 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:11.828128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1439df-de70-4cdb-9b7a-9687fb161cb5 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:11.828427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1439df-de70-4cdb-9b7a-9687fb161cb5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:11.828683 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1439df-de70-4cdb-9b7a-9687fb161cb5 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:11.832736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 212/422] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:33:11.835208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb99da-684f-48b8-a062-c68a1a4caba0 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:11.842353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023e9d1-6a63-4c70-90e6-529eb6112cd5 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:11.842353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023e9d1-6a63-4c70-90e6-529eb6112cd5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:11.842353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023e9d1-6a63-4c70-90e6-529eb6112cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:11.875914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5dc72-ac17-49b7-9460-8b269d9ebe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:11.876790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5dc72-ac17-49b7-9460-8b269d9ebe67 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:11.877072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5dc72-ac17-49b7-9460-8b269d9ebe67 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:11.877344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5dc72-ac17-49b7-9460-8b269d9ebe67 None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:11.877446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-3023e9d1-6a63-4c70-90e6-529eb6112cd5 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:11.878559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5dc72-ac17-49b7-9460-8b269d9ebe67 None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:11.878668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-3023e9d1-6a63-4c70-90e6-529eb6112cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:11.879991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5dc72-ac17-49b7-9460-8b269d9ebe67 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:11.881911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 211/423] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:11 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:11.894168 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5dc72-ac17-49b7-9460-8b269d9ebe67 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:11.996655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5dc72-ac17-49b7-9460-8b269d9ebe67 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:12.025338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 213/424] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:12.044016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e135f6-e7e3-44a8-9207-b5407ce7317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:12.044703 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e135f6-e7e3-44a8-9207-b5407ce7317f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:12.044987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e135f6-e7e3-44a8-9207-b5407ce7317f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:12.045262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e135f6-e7e3-44a8-9207-b5407ce7317f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:12.046103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e135f6-e7e3-44a8-9207-b5407ce7317f None admin] RBAC: Adding query filter params (group.id=104928c57da54145ae76c66d2253b1f5, role.id=15a2a347c19845c9ac397da513eb944a, scope.project.id=235c60e5703c440590e4c72e2d095f74) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:12.046436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e135f6-e7e3-44a8-9207-b5407ce7317f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:12.047880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e135f6-e7e3-44a8-9207-b5407ce7317f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:12.048697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023e9d1-6a63-4c70-90e6-529eb6112cd5 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:12.054694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 212/425] 10.222.0.61 () {56 vars in 1376 bytes} [Sat May 14 15:33:11 2022] GET /identity/v3/role_assignments?group.id=104928c57da54145ae76c66d2253b1f5&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=15a2a347c19845c9ac397da513eb944a => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:12.189832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023e9d1-6a63-4c70-90e6-529eb6112cd5 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:12.245243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477085ba-47c6-422a-b524-6ba5e2d5cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:12.246052 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477085ba-47c6-422a-b524-6ba5e2d5cc24 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:12.246345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477085ba-47c6-422a-b524-6ba5e2d5cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:12.246621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477085ba-47c6-422a-b524-6ba5e2d5cc24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:12.267209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477085ba-47c6-422a-b524-6ba5e2d5cc24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-477085ba-47c6-422a-b524-6ba5e2d5cc24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:12.275142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:12.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 14 15:33:12.276795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:12.280782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 214/426] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:12.282101 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e135f6-e7e3-44a8-9207-b5407ce7317f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:12.426951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e135f6-e7e3-44a8-9207-b5407ce7317f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:12.472248 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fbb4b-7d19-4ba0-8308-20de5c00ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:12.472835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fbb4b-7d19-4ba0-8308-20de5c00ae6e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:12.473179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fbb4b-7d19-4ba0-8308-20de5c00ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:12.473450 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fbb4b-7d19-4ba0-8308-20de5c00ae6e None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:12.474242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fbb4b-7d19-4ba0-8308-20de5c00ae6e None admin] RBAC: Adding query filter params (name=member) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:12.475989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fbb4b-7d19-4ba0-8308-20de5c00ae6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:12.477740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fbb4b-7d19-4ba0-8308-20de5c00ae6e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:12.486584 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 213/427] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:33:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:12.492404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477085ba-47c6-422a-b524-6ba5e2d5cc24 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:12.535732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e0c2-659f-4ba8-a26e-2b06eae9b8fd None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:12.536064 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e0c2-659f-4ba8-a26e-2b06eae9b8fd None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:12.536266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888e0c2-659f-4ba8-a26e-2b06eae9b8fd None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:12.537901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 214/428] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:33:12.543409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3d0c8-656e-4388-9467-c337034f9204 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:12.543865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3d0c8-656e-4388-9467-c337034f9204 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:12.544314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3d0c8-656e-4388-9467-c337034f9204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:12.568343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-2db3d0c8-656e-4388-9467-c337034f9204 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:12.569765 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2db3d0c8-656e-4388-9467-c337034f9204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:12.610432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477085ba-47c6-422a-b524-6ba5e2d5cc24 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:12.647357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe3b0b-10fc-42a7-b345-5bccacc211b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:12.648288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3b0b-10fc-42a7-b345-5bccacc211b9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:12.648717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3b0b-10fc-42a7-b345-5bccacc211b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:12.649169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe3b0b-10fc-42a7-b345-5bccacc211b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:12.674333 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 215/429] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:12.705696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3d0c8-656e-4388-9467-c337034f9204 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:12.738516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe3b0b-10fc-42a7-b345-5bccacc211b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:12.740351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe3b0b-10fc-42a7-b345-5bccacc211b9 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:12.827775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3d0c8-656e-4388-9467-c337034f9204 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:12.865259 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bb60c-3249-4b31-acc8-0c4bbdca52a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:12.866478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bb60c-3249-4b31-acc8-0c4bbdca52a4 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:12.866966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bb60c-3249-4b31-acc8-0c4bbdca52a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:12.867454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bb60c-3249-4b31-acc8-0c4bbdca52a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:12.875256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 215/430] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:12.879526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe3b0b-10fc-42a7-b345-5bccacc211b9 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:12.883121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bb60c-3249-4b31-acc8-0c4bbdca52a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-671bb60c-3249-4b31-acc8-0c4bbdca52a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:12.892439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:12.893324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:12.894096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:12.896755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 216/431] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:33:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:12.902852 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bb60c-3249-4b31-acc8-0c4bbdca52a4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:13.009675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe3b0b-10fc-42a7-b345-5bccacc211b9 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:13.017332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bb60c-3249-4b31-acc8-0c4bbdca52a4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:13.052475 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fd12c-81c7-477c-958d-78914aa4ff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:13.053503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fd12c-81c7-477c-958d-78914aa4ff51 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.054136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fd12c-81c7-477c-958d-78914aa4ff51 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.054695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fd12c-81c7-477c-958d-78914aa4ff51 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.056030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fd12c-81c7-477c-958d-78914aa4ff51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:13.056624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fd12c-81c7-477c-958d-78914aa4ff51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:13.058058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e434ba-9711-4f76-bb39-908b0f530cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:13.058463 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fd12c-81c7-477c-958d-78914aa4ff51 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:13.058966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e434ba-9711-4f76-bb39-908b0f530cbb None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.059247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e434ba-9711-4f76-bb39-908b0f530cbb None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.059520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e434ba-9711-4f76-bb39-908b0f530cbb None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.060731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e434ba-9711-4f76-bb39-908b0f530cbb None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:13.062158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e434ba-9711-4f76-bb39-908b0f530cbb None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:13.064213 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 216/432] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:12 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:13.073148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e434ba-9711-4f76-bb39-908b0f530cbb None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:13.073455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 217/433] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:13.075312 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fd12c-81c7-477c-958d-78914aa4ff51 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:13.188736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e434ba-9711-4f76-bb39-908b0f530cbb None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:13.200439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fd12c-81c7-477c-958d-78914aa4ff51 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:13.232819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08d903-bf60-459c-954e-83ab8d89032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:13.233722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08d903-bf60-459c-954e-83ab8d89032d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.234059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08d903-bf60-459c-954e-83ab8d89032d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.234444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08d903-bf60-459c-954e-83ab8d89032d None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.235549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08d903-bf60-459c-954e-83ab8d89032d None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:13.236983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08d903-bf60-459c-954e-83ab8d89032d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:13.239907 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 217/434] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:13 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:13.240780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1342d28-a187-4fb5-8b49-4fdc973a4150 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.241067 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1342d28-a187-4fb5-8b49-4fdc973a4150 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.241342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1342d28-a187-4fb5-8b49-4fdc973a4150 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.243514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 218/435] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:13.245667 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1342d28-a187-4fb5-8b49-4fdc973a4150 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:13.250649 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c29e58-36bf-4b73-9c18-a2601b1d9c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:13.251310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29e58-36bf-4b73-9c18-a2601b1d9c79 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.251593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29e58-36bf-4b73-9c18-a2601b1d9c79 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.251871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c29e58-36bf-4b73-9c18-a2601b1d9c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.325184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c29e58-36bf-4b73-9c18-a2601b1d9c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:13.326669 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c29e58-36bf-4b73-9c18-a2601b1d9c79 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:13.347602 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1342d28-a187-4fb5-8b49-4fdc973a4150 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:13.384564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddbe9f-fccb-4e69-9112-60d9ec22dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:13.385241 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddbe9f-fccb-4e69-9112-60d9ec22dad5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.385518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddbe9f-fccb-4e69-9112-60d9ec22dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.385789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddbe9f-fccb-4e69-9112-60d9ec22dad5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.386650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddbe9f-fccb-4e69-9112-60d9ec22dad5 None admin] RBAC: Adding query filter params (group.id=104928c57da54145ae76c66d2253b1f5, role.id=15a2a347c19845c9ac397da513eb944a, scope.project.id=c596122d9ed84658a8bf43ea14abeec6) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:13.386957 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddbe9f-fccb-4e69-9112-60d9ec22dad5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:13.388373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddbe9f-fccb-4e69-9112-60d9ec22dad5 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:13.394132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 219/436] 10.222.0.61 () {56 vars in 1376 bytes} [Sat May 14 15:33:13 2022] GET /identity/v3/role_assignments?group.id=104928c57da54145ae76c66d2253b1f5&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=15a2a347c19845c9ac397da513eb944a => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:13.395482 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3100a-6253-47d0-85f0-7964077fe7b6 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.395779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3100a-6253-47d0-85f0-7964077fe7b6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.396040 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3100a-6253-47d0-85f0-7964077fe7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.414573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-dcc3100a-6253-47d0-85f0-7964077fe7b6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:13.417248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-dcc3100a-6253-47d0-85f0-7964077fe7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:13.444121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 218/437] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 14 15:33:13.449254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c29e58-36bf-4b73-9c18-a2601b1d9c79 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:13.506102 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 220/438] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:13.520561 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3100a-6253-47d0-85f0-7964077fe7b6 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:13.582786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c29e58-36bf-4b73-9c18-a2601b1d9c79 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:13.631509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504b673-1017-400d-9bac-cb4b9ddbf161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:13.632391 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504b673-1017-400d-9bac-cb4b9ddbf161 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.632681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504b673-1017-400d-9bac-cb4b9ddbf161 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.632963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504b673-1017-400d-9bac-cb4b9ddbf161 None admin] PATH_INFO: `/v3/projects/235c60e5703c440590e4c72e2d095f74` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.634856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504b673-1017-400d-9bac-cb4b9ddbf161 None admin] RBAC: Authorizing `identity:get_project(project_id=235c60e5703c440590e4c72e2d095f74)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:13.636320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504b673-1017-400d-9bac-cb4b9ddbf161 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:13.638404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 219/439] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:13 2022] GET /identity/v3/projects/235c60e5703c440590e4c72e2d095f74 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:13.644456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504b673-1017-400d-9bac-cb4b9ddbf161 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:13.660259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3100a-6253-47d0-85f0-7964077fe7b6 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:13.694301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b98b4b-ef4a-4fbb-a6e4-080f74ad786a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:13.695242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b98b4b-ef4a-4fbb-a6e4-080f74ad786a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.695434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b98b4b-ef4a-4fbb-a6e4-080f74ad786a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.695685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b98b4b-ef4a-4fbb-a6e4-080f74ad786a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.706750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b98b4b-ef4a-4fbb-a6e4-080f74ad786a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f4b98b4b-ef4a-4fbb-a6e4-080f74ad786a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:13.715462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:13.716464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:13.717246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 221/440] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:33:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:13.722284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b98b4b-ef4a-4fbb-a6e4-080f74ad786a None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:13.752000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504b673-1017-400d-9bac-cb4b9ddbf161 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:13.784957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a017b-3698-40b9-acc1-b1e79267ce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:13.785814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a017b-3698-40b9-acc1-b1e79267ce39 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.786102 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a017b-3698-40b9-acc1-b1e79267ce39 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.786402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a017b-3698-40b9-acc1-b1e79267ce39 None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.787590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a017b-3698-40b9-acc1-b1e79267ce39 None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:13.789018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a017b-3698-40b9-acc1-b1e79267ce39 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:13.796037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 220/441] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:13 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:13.797533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e9608-3d32-4edb-a4ca-4c706842642a None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.797821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e9608-3d32-4edb-a4ca-4c706842642a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.798122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e9608-3d32-4edb-a4ca-4c706842642a None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.799432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 221/442] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:33:13.800182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e9608-3d32-4edb-a4ca-4c706842642a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:13.831335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b98b4b-ef4a-4fbb-a6e4-080f74ad786a None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:13.869362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3abc-7ebc-4354-b0e2-45be770c552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:13.870020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3abc-7ebc-4354-b0e2-45be770c552e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.870328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3abc-7ebc-4354-b0e2-45be770c552e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.870606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3abc-7ebc-4354-b0e2-45be770c552e None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.871358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3abc-7ebc-4354-b0e2-45be770c552e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:13.871666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3abc-7ebc-4354-b0e2-45be770c552e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:13.873056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3abc-7ebc-4354-b0e2-45be770c552e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:13.880755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 222/443] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:13.885629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29a15-6411-4d47-9d4f-c6b9c64dcda6 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.885629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29a15-6411-4d47-9d4f-c6b9c64dcda6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.885629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29a15-6411-4d47-9d4f-c6b9c64dcda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.895748 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e9608-3d32-4edb-a4ca-4c706842642a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:13.897909 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-06b29a15-6411-4d47-9d4f-c6b9c64dcda6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:13.899163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-06b29a15-6411-4d47-9d4f-c6b9c64dcda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:13.927882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6c0a6-b433-4277-b924-b6f89eb1e140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:13.928525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6c0a6-b433-4277-b924-b6f89eb1e140 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:13.928808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6c0a6-b433-4277-b924-b6f89eb1e140 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:13.929075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6c0a6-b433-4277-b924-b6f89eb1e140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:13.929893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6c0a6-b433-4277-b924-b6f89eb1e140 None admin] RBAC: Adding query filter params (group.id=104928c57da54145ae76c66d2253b1f5, role.id=97f5bd452f314fa093a222f49facdac7, scope.project.id=235c60e5703c440590e4c72e2d095f74) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:13.930223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6c0a6-b433-4277-b924-b6f89eb1e140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:13.931761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6c0a6-b433-4277-b924-b6f89eb1e140 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:13.937315 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 222/444] 10.222.0.61 () {56 vars in 1376 bytes} [Sat May 14 15:33:13 2022] GET /identity/v3/role_assignments?group.id=104928c57da54145ae76c66d2253b1f5&scope.project.id=235c60e5703c440590e4c72e2d095f74&role.id=97f5bd452f314fa093a222f49facdac7 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:13.938081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6c0a6-b433-4277-b924-b6f89eb1e140 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:13.965254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 223/445] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:13.990030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b29a15-6411-4d47-9d4f-c6b9c64dcda6 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:14.043831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6c0a6-b433-4277-b924-b6f89eb1e140 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:14.079949 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a6810-d390-4f14-ab21-dab4c2ba5d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:14.080965 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a6810-d390-4f14-ab21-dab4c2ba5d30 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:14.081435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a6810-d390-4f14-ab21-dab4c2ba5d30 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:14.081709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a6810-d390-4f14-ab21-dab4c2ba5d30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:14.099706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b29a15-6411-4d47-9d4f-c6b9c64dcda6 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:14.139281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ffa30-424a-4bfc-8bee-00d2a396c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:14.140409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ffa30-424a-4bfc-8bee-00d2a396c387 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:14.140694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ffa30-424a-4bfc-8bee-00d2a396c387 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:14.140969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ffa30-424a-4bfc-8bee-00d2a396c387 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:14.152720 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a6810-d390-4f14-ab21-dab4c2ba5d30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:14.153178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ffa30-424a-4bfc-8bee-00d2a396c387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:14.154202 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a6810-d390-4f14-ab21-dab4c2ba5d30 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f39ffa30-424a-4bfc-8bee-00d2a396c387 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:14.160867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:14.161873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:14.162886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 224/446] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:14.169918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ffa30-424a-4bfc-8bee-00d2a396c387 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:14.258529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 223/447] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:14.263128 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a6810-d390-4f14-ab21-dab4c2ba5d30 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:14.282685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ffa30-424a-4bfc-8bee-00d2a396c387 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:14.320871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8b608-ea1f-4408-a154-e5b317b7de55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:14.322064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8b608-ea1f-4408-a154-e5b317b7de55 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:14.322381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8b608-ea1f-4408-a154-e5b317b7de55 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:14.322646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8b608-ea1f-4408-a154-e5b317b7de55 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:14.323387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8b608-ea1f-4408-a154-e5b317b7de55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:14.323695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8b608-ea1f-4408-a154-e5b317b7de55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:14.326287 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8b608-ea1f-4408-a154-e5b317b7de55 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:14.337133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 225/448] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:14.341020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8b608-ea1f-4408-a154-e5b317b7de55 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:14.363589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a6810-d390-4f14-ab21-dab4c2ba5d30 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:14.399091 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9dc35-3349-4337-9006-5a3afaf10327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:14.400311 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9dc35-3349-4337-9006-5a3afaf10327 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:14.400592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9dc35-3349-4337-9006-5a3afaf10327 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:14.400866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9dc35-3349-4337-9006-5a3afaf10327 None admin] PATH_INFO: `/v3/projects/c596122d9ed84658a8bf43ea14abeec6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:14.402078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9dc35-3349-4337-9006-5a3afaf10327 None admin] RBAC: Authorizing `identity:get_project(project_id=c596122d9ed84658a8bf43ea14abeec6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:14.403602 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9dc35-3349-4337-9006-5a3afaf10327 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:14.405307 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 224/449] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:14 2022] GET /identity/v3/projects/c596122d9ed84658a8bf43ea14abeec6 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:14.410879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9dc35-3349-4337-9006-5a3afaf10327 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:14.456230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8b608-ea1f-4408-a154-e5b317b7de55 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:14.497003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f1f1-fbde-4511-9eed-a919b35b8d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:14.497658 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f1f1-fbde-4511-9eed-a919b35b8d45 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:14.497945 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f1f1-fbde-4511-9eed-a919b35b8d45 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:14.498219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f1f1-fbde-4511-9eed-a919b35b8d45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:14.513973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9dc35-3349-4337-9006-5a3afaf10327 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:14.546207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9ac85-e974-4c99-8054-e32ad2cd11ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:14.547088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ac85-e974-4c99-8054-e32ad2cd11ff None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:14.547365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ac85-e974-4c99-8054-e32ad2cd11ff None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:14.547633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ac85-e974-4c99-8054-e32ad2cd11ff None admin] PATH_INFO: `/v3/groups/104928c57da54145ae76c66d2253b1f5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:14.548790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9ac85-e974-4c99-8054-e32ad2cd11ff None admin] RBAC: Authorizing `identity:get_group(group_id=104928c57da54145ae76c66d2253b1f5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:14.550352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9ac85-e974-4c99-8054-e32ad2cd11ff None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:14.551946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 225/450] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:14 2022] GET /identity/v3/groups/104928c57da54145ae76c66d2253b1f5 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:14.558239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9ac85-e974-4c99-8054-e32ad2cd11ff None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:14.563574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561f1f1-fbde-4511-9eed-a919b35b8d45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:14.565033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561f1f1-fbde-4511-9eed-a919b35b8d45 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:14.649698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9ac85-e974-4c99-8054-e32ad2cd11ff None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:14.655946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 226/451] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:14.661380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f1f1-fbde-4511-9eed-a919b35b8d45 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:14.682424 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba051b45-c090-4f8d-b984-db07e2c4a985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:14.683073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba051b45-c090-4f8d-b984-db07e2c4a985 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:14.683357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba051b45-c090-4f8d-b984-db07e2c4a985 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:14.683632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba051b45-c090-4f8d-b984-db07e2c4a985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:14.684563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba051b45-c090-4f8d-b984-db07e2c4a985 None admin] RBAC: Adding query filter params (group.id=104928c57da54145ae76c66d2253b1f5, role.id=97f5bd452f314fa093a222f49facdac7, scope.project.id=c596122d9ed84658a8bf43ea14abeec6) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:14.684873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba051b45-c090-4f8d-b984-db07e2c4a985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:14.686285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba051b45-c090-4f8d-b984-db07e2c4a985 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:14.706338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 226/452] 10.222.0.61 () {56 vars in 1376 bytes} [Sat May 14 15:33:14 2022] GET /identity/v3/role_assignments?group.id=104928c57da54145ae76c66d2253b1f5&scope.project.id=c596122d9ed84658a8bf43ea14abeec6&role.id=97f5bd452f314fa093a222f49facdac7 => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:14.759389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f1f1-fbde-4511-9eed-a919b35b8d45 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:14.793702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11810b22-7992-4b9c-8447-aa0e66bbc72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:14.794591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11810b22-7992-4b9c-8447-aa0e66bbc72a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:14.794872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11810b22-7992-4b9c-8447-aa0e66bbc72a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:14.795143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11810b22-7992-4b9c-8447-aa0e66bbc72a None admin] PATH_INFO: `/v3/projects/562024bfc95645e098dcd57dfe3300a0` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:14.796347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11810b22-7992-4b9c-8447-aa0e66bbc72a None admin] RBAC: Authorizing `identity:get_project(project_id=562024bfc95645e098dcd57dfe3300a0)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:14.797799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11810b22-7992-4b9c-8447-aa0e66bbc72a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:14.799549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 227/453] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:33:14 2022] GET /identity/v3/projects/562024bfc95645e098dcd57dfe3300a0 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:14.805097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba051b45-c090-4f8d-b984-db07e2c4a985 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:14.909487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba051b45-c090-4f8d-b984-db07e2c4a985 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:14.941915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04448711-e087-41e0-bf79-c38c6262b667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:14.942796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448711-e087-41e0-bf79-c38c6262b667 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:14.943074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448711-e087-41e0-bf79-c38c6262b667 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:14.943344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448711-e087-41e0-bf79-c38c6262b667 None admin] PATH_INFO: `/v3/groups/3d3e9e391bc348a181b0f852d835c912` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:14.944494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04448711-e087-41e0-bf79-c38c6262b667 None admin] RBAC: Authorizing `identity:get_group(group_id=3d3e9e391bc348a181b0f852d835c912)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:14.945997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04448711-e087-41e0-bf79-c38c6262b667 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:14.948116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 227/454] 10.222.0.61 () {56 vars in 1180 bytes} [Sat May 14 15:33:14 2022] GET /identity/v3/groups/3d3e9e391bc348a181b0f852d835c912 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:14.953867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11810b22-7992-4b9c-8447-aa0e66bbc72a None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:15.052207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11810b22-7992-4b9c-8447-aa0e66bbc72a None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:15.084708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aecb83-b34d-47c9-a256-00b034135ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:15.085357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aecb83-b34d-47c9-a256-00b034135ff3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:15.085637 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aecb83-b34d-47c9-a256-00b034135ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:15.085909 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aecb83-b34d-47c9-a256-00b034135ff3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:15.086830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aecb83-b34d-47c9-a256-00b034135ff3 None admin] RBAC: Adding query filter params (group.id=3d3e9e391bc348a181b0f852d835c912, role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=562024bfc95645e098dcd57dfe3300a0) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:15.087140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aecb83-b34d-47c9-a256-00b034135ff3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:15.088549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aecb83-b34d-47c9-a256-00b034135ff3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:15.094092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 228/455] 10.222.0.61 () {56 vars in 1376 bytes} [Sat May 14 15:33:14 2022] GET /identity/v3/role_assignments?group.id=3d3e9e391bc348a181b0f852d835c912&scope.project.id=562024bfc95645e098dcd57dfe3300a0&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:17.963558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723233ba-24f5-4d62-9f3d-3b50ad322984 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:17.964584 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723233ba-24f5-4d62-9f3d-3b50ad322984 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:17.965086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723233ba-24f5-4d62-9f3d-3b50ad322984 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:17.966966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 228/456] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:17.972048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743b0e9-dbc0-4278-8045-9f19d8eab3b5 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:17.972862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743b0e9-dbc0-4278-8045-9f19d8eab3b5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:17.973358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743b0e9-dbc0-4278-8045-9f19d8eab3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:17.982654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec116149-0647-4d8a-b910-bb073b6b2796 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:17.983258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec116149-0647-4d8a-b910-bb073b6b2796 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:17.983733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec116149-0647-4d8a-b910-bb073b6b2796 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:17.985592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 229/457] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:17.991592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b42c79-6a30-4eb0-95b7-0fc8f9851010 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:17.992208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b42c79-6a30-4eb0-95b7-0fc8f9851010 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:17.993183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b42c79-6a30-4eb0-95b7-0fc8f9851010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:17.997719 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c743b0e9-dbc0-4278-8045-9f19d8eab3b5 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:17.999576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c743b0e9-dbc0-4278-8045-9f19d8eab3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:18.031658 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-37b42c79-6a30-4eb0-95b7-0fc8f9851010 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:18.032856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-37b42c79-6a30-4eb0-95b7-0fc8f9851010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:18.080346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 229/458] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:18.105376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743b0e9-dbc0-4278-8045-9f19d8eab3b5 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:18.165611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 230/459] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:18.201937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b42c79-6a30-4eb0-95b7-0fc8f9851010 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:18.212342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743b0e9-dbc0-4278-8045-9f19d8eab3b5 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:18.252810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d179eea-1497-42c6-a3de-bbe83cd9f52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:18.254162 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179eea-1497-42c6-a3de-bbe83cd9f52a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:18.254475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179eea-1497-42c6-a3de-bbe83cd9f52a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:18.254751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179eea-1497-42c6-a3de-bbe83cd9f52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:18.269407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d179eea-1497-42c6-a3de-bbe83cd9f52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:18.270935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d179eea-1497-42c6-a3de-bbe83cd9f52a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-2d179eea-1497-42c6-a3de-bbe83cd9f52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:18.295352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:18.296270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:18.297128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:18.297128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:18.297128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:18.297128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:18.297128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 230/460] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:18.298165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe08d3-d990-40eb-9047-68fa3cc3daad None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:18.298690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe08d3-d990-40eb-9047-68fa3cc3daad None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:18.299095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe08d3-d990-40eb-9047-68fa3cc3daad None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:18.300744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 231/461] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:18.304648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe08d3-d990-40eb-9047-68fa3cc3daad None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:18.354422 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b42c79-6a30-4eb0-95b7-0fc8f9851010 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:18.397979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22340b-1309-48d1-b8b2-a7a5546ad4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:18.399302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22340b-1309-48d1-b8b2-a7a5546ad4a0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:18.400180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22340b-1309-48d1-b8b2-a7a5546ad4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:18.400577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22340b-1309-48d1-b8b2-a7a5546ad4a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:18.412791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22340b-1309-48d1-b8b2-a7a5546ad4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:18.415301 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22340b-1309-48d1-b8b2-a7a5546ad4a0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:18.415465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe08d3-d990-40eb-9047-68fa3cc3daad None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-ad22340b-1309-48d1-b8b2-a7a5546ad4a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:18.434612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:18.435674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:18.436713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:18.436713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:18.436713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:18.436713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:18.438258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 231/462] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:18.439749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90374b4f-ac84-4ea1-9f0b-cd0fcd05768e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:18.440182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90374b4f-ac84-4ea1-9f0b-cd0fcd05768e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:18.440458 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90374b4f-ac84-4ea1-9f0b-cd0fcd05768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:18.452484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3d2ca-45bc-4897-8ccc-f40c295eaa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:18.453415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3d2ca-45bc-4897-8ccc-f40c295eaa59 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:18.453718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3d2ca-45bc-4897-8ccc-f40c295eaa59 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:18.453994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3d2ca-45bc-4897-8ccc-f40c295eaa59 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:18.454753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3d2ca-45bc-4897-8ccc-f40c295eaa59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:18.455059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3d2ca-45bc-4897-8ccc-f40c295eaa59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:18.456437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3d2ca-45bc-4897-8ccc-f40c295eaa59 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:18.457011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-90374b4f-ac84-4ea1-9f0b-cd0fcd05768e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:18.458180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-90374b4f-ac84-4ea1-9f0b-cd0fcd05768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:18.471623 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 232/463] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:18.473083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118684-be96-4d67-a1ef-4eb77238a132 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:18.473438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118684-be96-4d67-a1ef-4eb77238a132 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:18.473784 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118684-be96-4d67-a1ef-4eb77238a132 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:18.475419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 233/464] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:18.476176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0118684-be96-4d67-a1ef-4eb77238a132 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:18.538336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 232/465] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:18.538336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90374b4f-ac84-4ea1-9f0b-cd0fcd05768e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:18.588359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0118684-be96-4d67-a1ef-4eb77238a132 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:18.621492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f493b-85ee-4659-ab12-5ebca3b3e33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:18.622153 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f493b-85ee-4659-ab12-5ebca3b3e33d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:18.622469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f493b-85ee-4659-ab12-5ebca3b3e33d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:18.622745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f493b-85ee-4659-ab12-5ebca3b3e33d None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:18.623475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f493b-85ee-4659-ab12-5ebca3b3e33d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:18.623781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f493b-85ee-4659-ab12-5ebca3b3e33d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:18.625180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f493b-85ee-4659-ab12-5ebca3b3e33d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:18.631469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90374b4f-ac84-4ea1-9f0b-cd0fcd05768e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:18.637280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 234/466] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:18.638547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88640ad0-73a9-4879-8100-97f063a2d47c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:18.638837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88640ad0-73a9-4879-8100-97f063a2d47c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:18.639113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88640ad0-73a9-4879-8100-97f063a2d47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:18.656384 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-88640ad0-73a9-4879-8100-97f063a2d47c None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:18.657522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-88640ad0-73a9-4879-8100-97f063a2d47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:18.668425 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2326b4-a9aa-424a-aa9b-41f3810ea5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:18.669313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2326b4-a9aa-424a-aa9b-41f3810ea5f5 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:18.669731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2326b4-a9aa-424a-aa9b-41f3810ea5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:18.670140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2326b4-a9aa-424a-aa9b-41f3810ea5f5 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:18.671002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2326b4-a9aa-424a-aa9b-41f3810ea5f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:18.672569 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2326b4-a9aa-424a-aa9b-41f3810ea5f5 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:18.693656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 233/467] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:33:18 2022] POST /identity/v3/users => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:33:18.703453 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2326b4-a9aa-424a-aa9b-41f3810ea5f5 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:18.737320 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 235/468] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:18.738559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88640ad0-73a9-4879-8100-97f063a2d47c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:18.834716 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2326b4-a9aa-424a-aa9b-41f3810ea5f5 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:18.871726 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88640ad0-73a9-4879-8100-97f063a2d47c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:18.873637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe9a03-0410-4b46-b128-c6bc4caf704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:18.875376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe9a03-0410-4b46-b128-c6bc4caf704d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:18.875376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe9a03-0410-4b46-b128-c6bc4caf704d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:18.875376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe9a03-0410-4b46-b128-c6bc4caf704d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:18.887551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe9a03-0410-4b46-b128-c6bc4caf704d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:18.889241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe9a03-0410-4b46-b128-c6bc4caf704d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-76fe9a03-0410-4b46-b128-c6bc4caf704d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:18.907735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:18.908878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:18.909921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:18.909921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:18.909921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:18.909921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:18.914058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 234/469] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:18.915955 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe9a03-0410-4b46-b128-c6bc4caf704d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:18.920350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676df629-fce0-49eb-a12e-f485a455f3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:18.921258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676df629-fce0-49eb-a12e-f485a455f3c0 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:18.921720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676df629-fce0-49eb-a12e-f485a455f3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:18.922199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676df629-fce0-49eb-a12e-f485a455f3c0 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:18.923117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676df629-fce0-49eb-a12e-f485a455f3c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:18.924739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676df629-fce0-49eb-a12e-f485a455f3c0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:18.948887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 236/470] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:33:18 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:33:18.949769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676df629-fce0-49eb-a12e-f485a455f3c0 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:19.044199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe9a03-0410-4b46-b128-c6bc4caf704d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:19.069479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676df629-fce0-49eb-a12e-f485a455f3c0 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:19.086188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74095e-cd0e-427d-852f-a12ed50cfa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:19.087331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74095e-cd0e-427d-852f-a12ed50cfa14 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:19.087819 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74095e-cd0e-427d-852f-a12ed50cfa14 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:19.088232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74095e-cd0e-427d-852f-a12ed50cfa14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:19.101162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74095e-cd0e-427d-852f-a12ed50cfa14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:19.103557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74095e-cd0e-427d-852f-a12ed50cfa14 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:19.109166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ce11a-989b-402f-8c1f-1c25b983519b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:19.109856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce11a-989b-402f-8c1f-1c25b983519b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:19.110145 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce11a-989b-402f-8c1f-1c25b983519b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:19.110457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ce11a-989b-402f-8c1f-1c25b983519b None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:19.111260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ce11a-989b-402f-8c1f-1c25b983519b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:19.111673 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ce11a-989b-402f-8c1f-1c25b983519b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:19.113104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ce11a-989b-402f-8c1f-1c25b983519b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-bf74095e-cd0e-427d-852f-a12ed50cfa14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:19.123719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:19.124828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:19.125884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:19.125884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:19.125884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:19.125884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:19.127407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 237/471] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:19.127689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 235/472] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:19.132942 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ce11a-989b-402f-8c1f-1c25b983519b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:19.136089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74095e-cd0e-427d-852f-a12ed50cfa14 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:19.237468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ce11a-989b-402f-8c1f-1c25b983519b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:19.248881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74095e-cd0e-427d-852f-a12ed50cfa14 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:19.272058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2332d-a4f1-480c-adae-75f60d2a92d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:19.272737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2332d-a4f1-480c-adae-75f60d2a92d7 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:19.273050 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2332d-a4f1-480c-adae-75f60d2a92d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:19.273288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2332d-a4f1-480c-adae-75f60d2a92d7 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:19.274577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2332d-a4f1-480c-adae-75f60d2a92d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:19.276048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2332d-a4f1-480c-adae-75f60d2a92d7 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:19.285766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3800961-6760-4d27-bebd-ff79f0e22541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:19.287224 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3800961-6760-4d27-bebd-ff79f0e22541 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:19.287975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3800961-6760-4d27-bebd-ff79f0e22541 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:19.288538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3800961-6760-4d27-bebd-ff79f0e22541 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:19.290623 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3800961-6760-4d27-bebd-ff79f0e22541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:19.291130 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3800961-6760-4d27-bebd-ff79f0e22541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:19.294286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3800961-6760-4d27-bebd-ff79f0e22541 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:19.299174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 238/473] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:33:19 2022] POST /identity/v3/users => generated 248 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:33:19.300363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dde919-5692-4520-98df-b3ab9cc08e3a None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:19.300649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dde919-5692-4520-98df-b3ab9cc08e3a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:19.300926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dde919-5692-4520-98df-b3ab9cc08e3a None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:19.302564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 239/474] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:19.309030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccceca7-8d64-42d0-952d-d1520ab7a414 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:19.309318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccceca7-8d64-42d0-952d-d1520ab7a414 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:19.309593 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccceca7-8d64-42d0-952d-d1520ab7a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:19.310112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 236/475] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:19.315383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3800961-6760-4d27-bebd-ff79f0e22541 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:19.328404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-0ccceca7-8d64-42d0-952d-d1520ab7a414 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:19.329866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0ccceca7-8d64-42d0-952d-d1520ab7a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:19.407588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 240/476] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:19.433514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccceca7-8d64-42d0-952d-d1520ab7a414 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:19.448860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3800961-6760-4d27-bebd-ff79f0e22541 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:19.495667 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800b755-4dde-470f-b692-8d13e2797a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:19.496277 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800b755-4dde-470f-b692-8d13e2797a9a None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:19.496560 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800b755-4dde-470f-b692-8d13e2797a9a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:19.496841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800b755-4dde-470f-b692-8d13e2797a9a None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:19.498166 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800b755-4dde-470f-b692-8d13e2797a9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:19.500073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800b755-4dde-470f-b692-8d13e2797a9a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:19.527170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 237/477] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:33:19 2022] POST /identity/v3/users => generated 249 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:33:19.556701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccceca7-8d64-42d0-952d-d1520ab7a414 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:19.600123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23646fb4-6e84-418e-9622-9630e8e4dfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:19.600818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23646fb4-6e84-418e-9622-9630e8e4dfc8 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:19.601107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23646fb4-6e84-418e-9622-9630e8e4dfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:19.601384 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23646fb4-6e84-418e-9622-9630e8e4dfc8 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:19.602745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23646fb4-6e84-418e-9622-9630e8e4dfc8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:19.604165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23646fb4-6e84-418e-9622-9630e8e4dfc8 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:19.611215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.sql.core [None req-23646fb4-6e84-418e-9622-9630e8e4dfc8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 14 15:33:19.611215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 14 15:33:19.611215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [parameters: {'id': 'b232f0e9389b4f559eac1079d99a2ba0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 14 15:33:19.611215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86464) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-23646fb4-6e84-418e-9622-9630e8e4dfc8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application result = self._query(query) May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application conn.query(q) May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application result.read() May 14 15:33:19.629302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return ref.to_dict() May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 15:33:19.630205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application next(self.gen) May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application yield resource May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application next(self.gen) May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self.session.rollback() May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self.force_reraise() May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise self.value May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application session.commit() May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 14 15:33:19.631139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._prepare_impl() May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self.session.flush() May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._flush(objects) May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application compat.raise_( May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application flush_context.execute() May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rec.execute(self) May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 14 15:33:19.632002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application _emit_insert_statements( May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application c = connection._execute_20( May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ret = self._execute_context( May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 15:33:19.632854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application result = self._query(query) May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application conn.query(q) May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application result.read() May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 15:33:19.634288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [parameters: {'id': 'b232f0e9389b4f559eac1079d99a2ba0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:19.637036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 14 15:33:19.639080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:19.648328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 241/478] 10.222.0.61 () {60 vars in 1131 bytes} [Sat May 14 15:33:19 2022] POST /identity/v3/roles => generated 144 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:19.648465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800b755-4dde-470f-b692-8d13e2797a9a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:19.752954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800b755-4dde-470f-b692-8d13e2797a9a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:19.786939 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e3f69-1c23-466f-a1ca-7c175c7d6554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:19.787754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e3f69-1c23-466f-a1ca-7c175c7d6554 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:19.788041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e3f69-1c23-466f-a1ca-7c175c7d6554 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:19.788325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e3f69-1c23-466f-a1ca-7c175c7d6554 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:19.799462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e3f69-1c23-466f-a1ca-7c175c7d6554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-685e3f69-1c23-466f-a1ca-7c175c7d6554 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:19.807943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:19.808829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:19.809612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 238/479] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:33:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:19.816401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23646fb4-6e84-418e-9622-9630e8e4dfc8 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:19.932763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23646fb4-6e84-418e-9622-9630e8e4dfc8 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:19.966224 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66648d02-44c2-4f18-a961-bc93ac289bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:19.967145 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66648d02-44c2-4f18-a961-bc93ac289bbd None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:19.967566 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66648d02-44c2-4f18-a961-bc93ac289bbd None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:19.967976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66648d02-44c2-4f18-a961-bc93ac289bbd None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:19.968881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66648d02-44c2-4f18-a961-bc93ac289bbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:19.969322 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66648d02-44c2-4f18-a961-bc93ac289bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:19.970873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66648d02-44c2-4f18-a961-bc93ac289bbd None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:19.979408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 242/480] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:21.746154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80952d-2383-442b-a582-582914f6860b None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:21.746736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80952d-2383-442b-a582-582914f6860b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:21.746736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80952d-2383-442b-a582-582914f6860b None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:21.748378 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 239/481] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:21.753380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2aa8a-ffd0-4808-b2ad-17b97f78389e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:21.753781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2aa8a-ffd0-4808-b2ad-17b97f78389e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:21.753949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2aa8a-ffd0-4808-b2ad-17b97f78389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:21.779833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-dba2aa8a-ffd0-4808-b2ad-17b97f78389e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:21.780701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67df63-07f7-4f07-b495-cfded3619278 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:21.780995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67df63-07f7-4f07-b495-cfded3619278 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:21.781099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-dba2aa8a-ffd0-4808-b2ad-17b97f78389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:21.781275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67df63-07f7-4f07-b495-cfded3619278 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:21.782935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 240/482] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:21.800074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28642-93c6-4343-979c-877596804617 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:21.800710 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28642-93c6-4343-979c-877596804617 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:21.801186 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a28642-93c6-4343-979c-877596804617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:21.839601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c9a28642-93c6-4343-979c-877596804617 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:21.839601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c9a28642-93c6-4343-979c-877596804617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:21.866932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 243/483] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:21.901798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2aa8a-ffd0-4808-b2ad-17b97f78389e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:21.927531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 241/484] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:21.971784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a28642-93c6-4343-979c-877596804617 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:22.069952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2aa8a-ffd0-4808-b2ad-17b97f78389e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:22.143400 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5d89a-3028-4096-8e29-2c54042a69c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:22.144602 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5d89a-3028-4096-8e29-2c54042a69c5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.145084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5d89a-3028-4096-8e29-2c54042a69c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.145557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5d89a-3028-4096-8e29-2c54042a69c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.163018 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5d89a-3028-4096-8e29-2c54042a69c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-0ac5d89a-3028-4096-8e29-2c54042a69c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:22.172947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:22.173841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:22.174670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:22.175768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a28642-93c6-4343-979c-877596804617 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:22.177561 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 244/485] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:22.182856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5d89a-3028-4096-8e29-2c54042a69c5 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:22.234890 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c854b-e19b-467a-8b7f-9412679e941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:22.235688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c854b-e19b-467a-8b7f-9412679e941d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.235966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c854b-e19b-467a-8b7f-9412679e941d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.236235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c854b-e19b-467a-8b7f-9412679e941d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.248871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c854b-e19b-467a-8b7f-9412679e941d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-634c854b-e19b-467a-8b7f-9412679e941d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:22.258647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:22.259858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:22.260757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 242/486] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:22.261932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732403-d9d9-49b4-bc9e-0da5f44e4d90 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.261932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732403-d9d9-49b4-bc9e-0da5f44e4d90 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.262099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9732403-d9d9-49b4-bc9e-0da5f44e4d90 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.266384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 243/487] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:22.269480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9732403-d9d9-49b4-bc9e-0da5f44e4d90 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:22.313980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5d89a-3028-4096-8e29-2c54042a69c5 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:22.350670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51744f3-fa9e-4eed-897f-40d024a014cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:22.351605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51744f3-fa9e-4eed-897f-40d024a014cf None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.351605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51744f3-fa9e-4eed-897f-40d024a014cf None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.351865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51744f3-fa9e-4eed-897f-40d024a014cf None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.353570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51744f3-fa9e-4eed-897f-40d024a014cf None admin] RBAC: Adding query filter params (name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:22.353964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51744f3-fa9e-4eed-897f-40d024a014cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:22.355378 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51744f3-fa9e-4eed-897f-40d024a014cf None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:22.370039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 245/488] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:22.370039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fae1ff-04d9-40b5-8e23-0356d1667630 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.370039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fae1ff-04d9-40b5-8e23-0356d1667630 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.370039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fae1ff-04d9-40b5-8e23-0356d1667630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.385425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d4fae1ff-04d9-40b5-8e23-0356d1667630 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:22.387039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d4fae1ff-04d9-40b5-8e23-0356d1667630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:22.402742 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9732403-d9d9-49b4-bc9e-0da5f44e4d90 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:22.446580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087bbd-07d0-4183-bd59-724deebdcb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:22.448114 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087bbd-07d0-4183-bd59-724deebdcb81 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.448962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087bbd-07d0-4183-bd59-724deebdcb81 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.449444 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5087bbd-07d0-4183-bd59-724deebdcb81 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.450582 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5087bbd-07d0-4183-bd59-724deebdcb81 None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:22.451350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5087bbd-07d0-4183-bd59-724deebdcb81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:22.453430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5087bbd-07d0-4183-bd59-724deebdcb81 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:22.466333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 246/489] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:22.466333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fae1ff-04d9-40b5-8e23-0356d1667630 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:22.472018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 244/490] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:22.478868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087bbd-07d0-4183-bd59-724deebdcb81 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:22.583509 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fae1ff-04d9-40b5-8e23-0356d1667630 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:22.592665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5087bbd-07d0-4183-bd59-724deebdcb81 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:22.618825 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dfad1-d413-407b-a4aa-30babd6a98b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:22.619832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfad1-d413-407b-a4aa-30babd6a98b6 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.620113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfad1-d413-407b-a4aa-30babd6a98b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.620386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfad1-d413-407b-a4aa-30babd6a98b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.629466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550d15f-bbe2-4f95-a9b1-78af3b0fedf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:22.630249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550d15f-bbe2-4f95-a9b1-78af3b0fedf9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.630573 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550d15f-bbe2-4f95-a9b1-78af3b0fedf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.630734 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dfad1-d413-407b-a4aa-30babd6a98b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:22.630829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550d15f-bbe2-4f95-a9b1-78af3b0fedf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.632134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dfad1-d413-407b-a4aa-30babd6a98b6 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:22.641350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550d15f-bbe2-4f95-a9b1-78af3b0fedf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:22.642809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550d15f-bbe2-4f95-a9b1-78af3b0fedf9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-c95dfad1-d413-407b-a4aa-30babd6a98b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:22.649660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:22.650541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:22.651394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:22.651394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:22.651394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:22.651394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:22.651394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 247/491] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:22.651663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dfad1-d413-407b-a4aa-30babd6a98b6 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-c550d15f-bbe2-4f95-a9b1-78af3b0fedf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:22.664982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:22.665962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:22.666853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:22.666853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:22.666853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:22.666853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:22.667417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 245/492] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:22.668669 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c6ed2-5e3e-4d63-adfb-5652bf64dca9 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.668954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c6ed2-5e3e-4d63-adfb-5652bf64dca9 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.669228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c6ed2-5e3e-4d63-adfb-5652bf64dca9 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.670626 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 246/493] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:22.671178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c6ed2-5e3e-4d63-adfb-5652bf64dca9 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:22.763854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dfad1-d413-407b-a4aa-30babd6a98b6 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:22.771576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c6ed2-5e3e-4d63-adfb-5652bf64dca9 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:22.797135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2882-1624-49cf-a5bd-cfd5ee42aff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:22.797921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2882-1624-49cf-a5bd-cfd5ee42aff1 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.798197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2882-1624-49cf-a5bd-cfd5ee42aff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.798504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df2882-1624-49cf-a5bd-cfd5ee42aff1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.804939 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33450c55-bab9-4dbe-8f19-70b6336c911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:22.805736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33450c55-bab9-4dbe-8f19-70b6336c911a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.806014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33450c55-bab9-4dbe-8f19-70b6336c911a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.806290 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33450c55-bab9-4dbe-8f19-70b6336c911a None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.807036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33450c55-bab9-4dbe-8f19-70b6336c911a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:22.807344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33450c55-bab9-4dbe-8f19-70b6336c911a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:22.808313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df2882-1624-49cf-a5bd-cfd5ee42aff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:22.808713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33450c55-bab9-4dbe-8f19-70b6336c911a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-a4df2882-1624-49cf-a5bd-cfd5ee42aff1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:22.815938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:22.816811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:22.817649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 248/494] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:22.818966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2882-1624-49cf-a5bd-cfd5ee42aff1 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:22.829786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 247/495] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:22.829786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0557c-bc31-43cf-beb2-204fb261752b None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.829786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0557c-bc31-43cf-beb2-204fb261752b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.829786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0557c-bc31-43cf-beb2-204fb261752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.847897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-4ec0557c-bc31-43cf-beb2-204fb261752b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:22.849134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4ec0557c-bc31-43cf-beb2-204fb261752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:22.917489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 248/496] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:22.918789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0557c-bc31-43cf-beb2-204fb261752b None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:22.938904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df2882-1624-49cf-a5bd-cfd5ee42aff1 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:22.973672 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e76929-7e97-416c-b37a-aa30b7abb349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:22.974342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76929-7e97-416c-b37a-aa30b7abb349 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:22.974637 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76929-7e97-416c-b37a-aa30b7abb349 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:22.974913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76929-7e97-416c-b37a-aa30b7abb349 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:22.975672 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e76929-7e97-416c-b37a-aa30b7abb349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:22.975982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e76929-7e97-416c-b37a-aa30b7abb349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:22.978272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e76929-7e97-416c-b37a-aa30b7abb349 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:22.990353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 249/497] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:22.990353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e76929-7e97-416c-b37a-aa30b7abb349 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.023714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0557c-bc31-43cf-beb2-204fb261752b None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.057509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34106c4-4b59-42df-b7a8-3680f955dbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.058174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34106c4-4b59-42df-b7a8-3680f955dbe6 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.058499 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34106c4-4b59-42df-b7a8-3680f955dbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.058774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34106c4-4b59-42df-b7a8-3680f955dbe6 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.059526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34106c4-4b59-42df-b7a8-3680f955dbe6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:23.059827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34106c4-4b59-42df-b7a8-3680f955dbe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:23.061191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34106c4-4b59-42df-b7a8-3680f955dbe6 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:23.068807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 249/498] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:23.069667 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34106c4-4b59-42df-b7a8-3680f955dbe6 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.088094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e76929-7e97-416c-b37a-aa30b7abb349 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.120795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22a231-992f-4d7d-b756-508698150b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.121579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22a231-992f-4d7d-b756-508698150b78 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.121859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22a231-992f-4d7d-b756-508698150b78 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.122129 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22a231-992f-4d7d-b756-508698150b78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.128910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22a231-992f-4d7d-b756-508698150b78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:23.130357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22a231-992f-4d7d-b756-508698150b78 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-db22a231-992f-4d7d-b756-508698150b78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:23.146715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:23.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:23.148633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:23.148633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:23.148633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:23.148633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:23.148633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:23.148633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:23.148633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:23.148633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:23.148633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:23.148633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:23.148633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 250/499] 10.222.0.61 () {56 vars in 1093 bytes} [Sat May 14 15:33:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:23.149231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22a231-992f-4d7d-b756-508698150b78 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.167092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34106c4-4b59-42df-b7a8-3680f955dbe6 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.199225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb304150-2f0f-4e11-82ec-61bc4a7ce33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.199937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304150-2f0f-4e11-82ec-61bc4a7ce33d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.200219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304150-2f0f-4e11-82ec-61bc4a7ce33d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.200501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304150-2f0f-4e11-82ec-61bc4a7ce33d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.210174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb304150-2f0f-4e11-82ec-61bc4a7ce33d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-cb304150-2f0f-4e11-82ec-61bc4a7ce33d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:23.218021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:23.219110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 250/500] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:23.224783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308322b-a4ba-4f9f-ad3d-553ada9e6bc7 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.225488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308322b-a4ba-4f9f-ad3d-553ada9e6bc7 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.225488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308322b-a4ba-4f9f-ad3d-553ada9e6bc7 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.226402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 251/501] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:23.227595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308322b-a4ba-4f9f-ad3d-553ada9e6bc7 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.243685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22a231-992f-4d7d-b756-508698150b78 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.275963 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cab56a-ac15-4a38-81be-d864a41bcb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.276748 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cab56a-ac15-4a38-81be-d864a41bcb70 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.277033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cab56a-ac15-4a38-81be-d864a41bcb70 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.277307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cab56a-ac15-4a38-81be-d864a41bcb70 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.284073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cab56a-ac15-4a38-81be-d864a41bcb70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:23.285530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cab56a-ac15-4a38-81be-d864a41bcb70 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-e9cab56a-ac15-4a38-81be-d864a41bcb70 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:23.300065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:23.301103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:23.302174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:23.302174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:23.302174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:23.302174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:23.302174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:23.302174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:23.302174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:23.302174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:23.302174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 14 15:33:23.302174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:23.302174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 251/502] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:23.302878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cab56a-ac15-4a38-81be-d864a41bcb70 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.330555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308322b-a4ba-4f9f-ad3d-553ada9e6bc7 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.363025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf2665-59cc-4e9d-b9c8-f871189c04a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.363810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf2665-59cc-4e9d-b9c8-f871189c04a9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.364090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf2665-59cc-4e9d-b9c8-f871189c04a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.364359 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf2665-59cc-4e9d-b9c8-f871189c04a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.374514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf2665-59cc-4e9d-b9c8-f871189c04a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:23.375952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf2665-59cc-4e9d-b9c8-f871189c04a9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-eccf2665-59cc-4e9d-b9c8-f871189c04a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:23.392696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:23.393652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:23.399155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:23.399155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:23.399155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:23.399155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:23.399155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 252/503] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:23.399155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf2665-59cc-4e9d-b9c8-f871189c04a9 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.399809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cab56a-ac15-4a38-81be-d864a41bcb70 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.432506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e9b1f-7982-405f-aaf9-4e8fcfdd645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.433166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e9b1f-7982-405f-aaf9-4e8fcfdd645d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.433448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e9b1f-7982-405f-aaf9-4e8fcfdd645d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.433722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e9b1f-7982-405f-aaf9-4e8fcfdd645d None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.434590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e9b1f-7982-405f-aaf9-4e8fcfdd645d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:23.434894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e9b1f-7982-405f-aaf9-4e8fcfdd645d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:23.436319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e9b1f-7982-405f-aaf9-4e8fcfdd645d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:23.471888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 252/504] 10.222.0.61 () {56 vars in 1133 bytes} [Sat May 14 15:33:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:23.473132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52b1c-f13c-419b-94c8-a21808fbf24b None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.473428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52b1c-f13c-419b-94c8-a21808fbf24b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.473704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52b1c-f13c-419b-94c8-a21808fbf24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.488601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf2665-59cc-4e9d-b9c8-f871189c04a9 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.490116 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-40a52b1c-f13c-419b-94c8-a21808fbf24b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:23.491390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-40a52b1c-f13c-419b-94c8-a21808fbf24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:23.520419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c2070-9f70-43b2-9161-c5ae33eff096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.521073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2070-9f70-43b2-9161-c5ae33eff096 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.521353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2070-9f70-43b2-9161-c5ae33eff096 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.521625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c2070-9f70-43b2-9161-c5ae33eff096 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.522386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c2070-9f70-43b2-9161-c5ae33eff096 None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:23.522691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c2070-9f70-43b2-9161-c5ae33eff096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:23.524317 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c2070-9f70-43b2-9161-c5ae33eff096 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:23.531626 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 253/505] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:23.532404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c2070-9f70-43b2-9161-c5ae33eff096 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.554880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 253/506] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:23.556319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a52b1c-f13c-419b-94c8-a21808fbf24b None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.628046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c2070-9f70-43b2-9161-c5ae33eff096 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.650877 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a52b1c-f13c-419b-94c8-a21808fbf24b None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.659625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f471b-4b0e-4dcb-b597-aebb765aa93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.660289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f471b-4b0e-4dcb-b597-aebb765aa93b None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.660570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f471b-4b0e-4dcb-b597-aebb765aa93b None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.660843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f471b-4b0e-4dcb-b597-aebb765aa93b None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.661670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f471b-4b0e-4dcb-b597-aebb765aa93b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:23.661974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f471b-4b0e-4dcb-b597-aebb765aa93b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:23.663426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f471b-4b0e-4dcb-b597-aebb765aa93b None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:23.683508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2c25-79ca-4a2a-8296-74e0ad3bdf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.684158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2c25-79ca-4a2a-8296-74e0ad3bdf3f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.684441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2c25-79ca-4a2a-8296-74e0ad3bdf3f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.684716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c2c25-79ca-4a2a-8296-74e0ad3bdf3f None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.685440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2c25-79ca-4a2a-8296-74e0ad3bdf3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:23.685743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2c25-79ca-4a2a-8296-74e0ad3bdf3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:23.687137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c2c25-79ca-4a2a-8296-74e0ad3bdf3f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:23.697767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 254/507] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:23.698589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2c25-79ca-4a2a-8296-74e0ad3bdf3f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.699313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 254/508] 10.222.0.61 () {56 vars in 1137 bytes} [Sat May 14 15:33:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:23.700137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f471b-4b0e-4dcb-b597-aebb765aa93b None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.795222 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f471b-4b0e-4dcb-b597-aebb765aa93b None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.795840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c2c25-79ca-4a2a-8296-74e0ad3bdf3f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.826252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f086261-2cce-43fc-9675-df3b1534d07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.826447 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ab7f5-95b9-4122-9fc5-87e174c99c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.826976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ab7f5-95b9-4122-9fc5-87e174c99c40 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.827067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f086261-2cce-43fc-9675-df3b1534d07f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.827258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ab7f5-95b9-4122-9fc5-87e174c99c40 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.827345 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f086261-2cce-43fc-9675-df3b1534d07f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.827534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ab7f5-95b9-4122-9fc5-87e174c99c40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.827621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f086261-2cce-43fc-9675-df3b1534d07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:23.840086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f086261-2cce-43fc-9675-df3b1534d07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:23.841566 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f086261-2cce-43fc-9675-df3b1534d07f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-0f086261-2cce-43fc-9675-df3b1534d07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:23.860204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:23.861042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:23.861881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:23.861881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:23.861881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:23.861881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:23.861881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 255/509] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:23.862134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f086261-2cce-43fc-9675-df3b1534d07f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.891832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ab7f5-95b9-4122-9fc5-87e174c99c40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:23.893266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ab7f5-95b9-4122-9fc5-87e174c99c40 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:23.956385 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f086261-2cce-43fc-9675-df3b1534d07f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:23.985503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 255/510] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:23.986143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ab7f5-95b9-4122-9fc5-87e174c99c40 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:23.993518 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8042ae-5895-413c-baeb-996f9d67bd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:23.994300 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8042ae-5895-413c-baeb-996f9d67bd97 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:23.994606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8042ae-5895-413c-baeb-996f9d67bd97 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:23.994880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8042ae-5895-413c-baeb-996f9d67bd97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.005069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8042ae-5895-413c-baeb-996f9d67bd97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.006503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8042ae-5895-413c-baeb-996f9d67bd97 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-9c8042ae-5895-413c-baeb-996f9d67bd97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:24.022884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:24.023706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:24.025129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:24.025129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:24.025129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:24.025129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:24.025129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 256/511] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:24.025859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8042ae-5895-413c-baeb-996f9d67bd97 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:24.076703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ab7f5-95b9-4122-9fc5-87e174c99c40 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:24.108351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354b8cc-ca49-4e21-805a-753a4715fc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:24.109127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354b8cc-ca49-4e21-805a-753a4715fc27 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:24.109401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354b8cc-ca49-4e21-805a-753a4715fc27 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:24.109676 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354b8cc-ca49-4e21-805a-753a4715fc27 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.116334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354b8cc-ca49-4e21-805a-753a4715fc27 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.118335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354b8cc-ca49-4e21-805a-753a4715fc27 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:24.119232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8042ae-5895-413c-baeb-996f9d67bd97 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-a354b8cc-ca49-4e21-805a-753a4715fc27 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:24.132524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:24.133754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:24.134675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:24.134675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:24.134675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:24.134675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:24.134675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:24.134675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:24.134675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:24.134675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:24.134675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 14 15:33:24.134675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:24.134675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 256/512] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:24.135215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354b8cc-ca49-4e21-805a-753a4715fc27 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:24.153877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7294d-16d6-4c74-9be9-7b61ba481a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:24.154551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7294d-16d6-4c74-9be9-7b61ba481a38 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:24.154833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7294d-16d6-4c74-9be9-7b61ba481a38 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:24.155103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7294d-16d6-4c74-9be9-7b61ba481a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.217916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7294d-16d6-4c74-9be9-7b61ba481a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.219402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7294d-16d6-4c74-9be9-7b61ba481a38 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:24.225982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354b8cc-ca49-4e21-805a-753a4715fc27 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:24.260508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e23d-c1ca-4b14-9281-e7c3b52fa57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:24.261167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e23d-c1ca-4b14-9281-e7c3b52fa57b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:24.261444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e23d-c1ca-4b14-9281-e7c3b52fa57b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:24.261714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e23d-c1ca-4b14-9281-e7c3b52fa57b None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.262462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e23d-c1ca-4b14-9281-e7c3b52fa57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:24.262764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e23d-c1ca-4b14-9281-e7c3b52fa57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.264120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e23d-c1ca-4b14-9281-e7c3b52fa57b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:24.275316 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 257/513] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:24.276093 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e23d-c1ca-4b14-9281-e7c3b52fa57b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:24.313626 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 257/514] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:24.314495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7294d-16d6-4c74-9be9-7b61ba481a38 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:24.372868 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e23d-c1ca-4b14-9281-e7c3b52fa57b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:24.404573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c2c4-efd7-43d9-ab5f-a71d679df17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:24.405353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c2c4-efd7-43d9-ab5f-a71d679df17b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:24.405631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c2c4-efd7-43d9-ab5f-a71d679df17b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:24.405902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37c2c4-efd7-43d9-ab5f-a71d679df17b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.409389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7294d-16d6-4c74-9be9-7b61ba481a38 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:24.415821 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37c2c4-efd7-43d9-ab5f-a71d679df17b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.417249 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c37c2c4-efd7-43d9-ab5f-a71d679df17b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-9c37c2c4-efd7-43d9-ab5f-a71d679df17b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:24.434450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:24.435475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:24.436499 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:24.436499 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:24.436499 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:24.436499 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:24.436499 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 258/515] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:24.436823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c2c4-efd7-43d9-ab5f-a71d679df17b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:24.447807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87693f-bd1a-4c49-8f8b-9088f64dad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:24.448463 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87693f-bd1a-4c49-8f8b-9088f64dad7a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:24.448743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87693f-bd1a-4c49-8f8b-9088f64dad7a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:24.449011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87693f-bd1a-4c49-8f8b-9088f64dad7a None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.449722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87693f-bd1a-4c49-8f8b-9088f64dad7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:24.450021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87693f-bd1a-4c49-8f8b-9088f64dad7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.451412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87693f-bd1a-4c49-8f8b-9088f64dad7a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:24.462496 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 258/516] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:24.463276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87693f-bd1a-4c49-8f8b-9088f64dad7a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:24.529466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37c2c4-efd7-43d9-ab5f-a71d679df17b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:24.556031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87693f-bd1a-4c49-8f8b-9088f64dad7a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:24.561055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5150b1-769c-4f2c-80a0-9f08166334a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:24.561718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5150b1-769c-4f2c-80a0-9f08166334a9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:24.562001 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5150b1-769c-4f2c-80a0-9f08166334a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:24.562274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5150b1-769c-4f2c-80a0-9f08166334a9 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.563136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5150b1-769c-4f2c-80a0-9f08166334a9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:24.563442 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5150b1-769c-4f2c-80a0-9f08166334a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.564857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5150b1-769c-4f2c-80a0-9f08166334a9 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:24.581600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 259/517] 10.222.0.61 () {56 vars in 1137 bytes} [Sat May 14 15:33:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:24.582417 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5150b1-769c-4f2c-80a0-9f08166334a9 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:24.591769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6cd43-3003-45f2-9452-547956346940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:24.592553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6cd43-3003-45f2-9452-547956346940 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:24.592827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6cd43-3003-45f2-9452-547956346940 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:24.593094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6cd43-3003-45f2-9452-547956346940 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.600409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6cd43-3003-45f2-9452-547956346940 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.601821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6cd43-3003-45f2-9452-547956346940 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-bcb6cd43-3003-45f2-9452-547956346940 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:24.617362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:24.618929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:24.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:24.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:24.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:24.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:24.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:24.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:24.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:24.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:24.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 14 15:33:24.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:24.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 259/518] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:24.620392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6cd43-3003-45f2-9452-547956346940 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:24.676392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5150b1-769c-4f2c-80a0-9f08166334a9 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:24.708764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695dcc1-91b9-4bda-ab20-342a11f0e87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:24.709545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695dcc1-91b9-4bda-ab20-342a11f0e87e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:24.709827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695dcc1-91b9-4bda-ab20-342a11f0e87e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:24.710103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695dcc1-91b9-4bda-ab20-342a11f0e87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.713605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6cd43-3003-45f2-9452-547956346940 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:24.719759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695dcc1-91b9-4bda-ab20-342a11f0e87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.721198 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695dcc1-91b9-4bda-ab20-342a11f0e87e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-6695dcc1-91b9-4bda-ab20-342a11f0e87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:24.738117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:24.739152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:24.740251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:24.740251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:24.740251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:24.740251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:24.740251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 260/519] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:24.740251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695dcc1-91b9-4bda-ab20-342a11f0e87e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:24.746591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ae6b1-e2b4-4444-87a2-07f9e569db56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:24.747246 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ae6b1-e2b4-4444-87a2-07f9e569db56 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:24.747526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ae6b1-e2b4-4444-87a2-07f9e569db56 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:24.747796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ae6b1-e2b4-4444-87a2-07f9e569db56 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.748508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ae6b1-e2b4-4444-87a2-07f9e569db56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:24.748809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ae6b1-e2b4-4444-87a2-07f9e569db56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.750163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ae6b1-e2b4-4444-87a2-07f9e569db56 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:24.762117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 260/520] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:24.762933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ae6b1-e2b4-4444-87a2-07f9e569db56 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:24.835310 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695dcc1-91b9-4bda-ab20-342a11f0e87e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:24.857783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ae6b1-e2b4-4444-87a2-07f9e569db56 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:24.868397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c095d6c-ef1b-472d-aa47-751189f9beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:24.869065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095d6c-ef1b-472d-aa47-751189f9beb1 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:24.869348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095d6c-ef1b-472d-aa47-751189f9beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:24.869626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c095d6c-ef1b-472d-aa47-751189f9beb1 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.870342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c095d6c-ef1b-472d-aa47-751189f9beb1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.871782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c095d6c-ef1b-472d-aa47-751189f9beb1 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:24.890527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 261/521] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:33:24 2022] POST /identity/v3/users => generated 247 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:33:24.890826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1401c2-1764-4865-9ea1-f9bcee8712b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:24.891335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c095d6c-ef1b-472d-aa47-751189f9beb1 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:24.891570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1401c2-1764-4865-9ea1-f9bcee8712b9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:24.891746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1401c2-1764-4865-9ea1-f9bcee8712b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:24.892021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1401c2-1764-4865-9ea1-f9bcee8712b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:24.970560 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1401c2-1764-4865-9ea1-f9bcee8712b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:24.972013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1401c2-1764-4865-9ea1-f9bcee8712b9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:25.015227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c095d6c-ef1b-472d-aa47-751189f9beb1 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:25.051887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64100d34-ad5d-4dc4-a5bb-4e18daf5d197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:25.052581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64100d34-ad5d-4dc4-a5bb-4e18daf5d197 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:25.052867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64100d34-ad5d-4dc4-a5bb-4e18daf5d197 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:25.053182 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64100d34-ad5d-4dc4-a5bb-4e18daf5d197 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:25.054003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64100d34-ad5d-4dc4-a5bb-4e18daf5d197 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:25.054348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64100d34-ad5d-4dc4-a5bb-4e18daf5d197 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:25.056048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64100d34-ad5d-4dc4-a5bb-4e18daf5d197 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:25.075031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 262/522] 10.222.0.61 () {56 vars in 1139 bytes} [Sat May 14 15:33:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:25.079402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 261/523] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:25.079517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64100d34-ad5d-4dc4-a5bb-4e18daf5d197 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:25.079615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1401c2-1764-4865-9ea1-f9bcee8712b9 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:25.182288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1401c2-1764-4865-9ea1-f9bcee8712b9 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:25.185443 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64100d34-ad5d-4dc4-a5bb-4e18daf5d197 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:25.215534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ebf90-3db6-44de-a59a-f5497330ba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:25.216327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ebf90-3db6-44de-a59a-f5497330ba87 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:25.216609 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ebf90-3db6-44de-a59a-f5497330ba87 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:25.216880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ebf90-3db6-44de-a59a-f5497330ba87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:25.219467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbe4a2-99e2-4da0-9bf6-35e247dcbd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:25.220338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbe4a2-99e2-4da0-9bf6-35e247dcbd78 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:25.220885 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbe4a2-99e2-4da0-9bf6-35e247dcbd78 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:25.221357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbe4a2-99e2-4da0-9bf6-35e247dcbd78 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:25.222276 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbe4a2-99e2-4da0-9bf6-35e247dcbd78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:25.222794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbe4a2-99e2-4da0-9bf6-35e247dcbd78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:25.223472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ebf90-3db6-44de-a59a-f5497330ba87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:25.224528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbe4a2-99e2-4da0-9bf6-35e247dcbd78 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:25.224924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ebf90-3db6-44de-a59a-f5497330ba87 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:25.237398 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 263/524] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:25.238533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbe4a2-99e2-4da0-9bf6-35e247dcbd78 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-0e4ebf90-3db6-44de-a59a-f5497330ba87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:25.239865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:25.240684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:25.241784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:25.241784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:25.241784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:25.241784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:25.241784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:25.241784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:25.241784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:25.241784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:25.242645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 262/525] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:25.243550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ebf90-3db6-44de-a59a-f5497330ba87 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:25.342573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbe4a2-99e2-4da0-9bf6-35e247dcbd78 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:25.347040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ebf90-3db6-44de-a59a-f5497330ba87 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:25.376935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cae3c-f00b-4234-a6ab-f6af930b65ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:25.377831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cae3c-f00b-4234-a6ab-f6af930b65ae None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:25.378113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cae3c-f00b-4234-a6ab-f6af930b65ae None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:25.378429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cae3c-f00b-4234-a6ab-f6af930b65ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:25.382225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcdf59-e4be-4869-8a20-1c081c012cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:25.383031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcdf59-e4be-4869-8a20-1c081c012cb2 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:25.383426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcdf59-e4be-4869-8a20-1c081c012cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:25.383750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcdf59-e4be-4869-8a20-1c081c012cb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:25.394065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcdf59-e4be-4869-8a20-1c081c012cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:25.395562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcdf59-e4be-4869-8a20-1c081c012cb2 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-87bcdf59-e4be-4869-8a20-1c081c012cb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:25.412804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:25.413673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:25.414617 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:25.414617 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:25.414617 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:25.414617 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:25.414617 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 263/526] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:25.419582 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcdf59-e4be-4869-8a20-1c081c012cb2 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:25.447165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cae3c-f00b-4234-a6ab-f6af930b65ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:25.448617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cae3c-f00b-4234-a6ab-f6af930b65ae None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:25.518844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcdf59-e4be-4869-8a20-1c081c012cb2 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:25.549958 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 264/527] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:25.549958 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cae3c-f00b-4234-a6ab-f6af930b65ae None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:25.556184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05093e23-47c3-43c8-8aa0-619a67bb9924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:25.556980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093e23-47c3-43c8-8aa0-619a67bb9924 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:25.557260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093e23-47c3-43c8-8aa0-619a67bb9924 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:25.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05093e23-47c3-43c8-8aa0-619a67bb9924 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:25.564156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05093e23-47c3-43c8-8aa0-619a67bb9924 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:25.565588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05093e23-47c3-43c8-8aa0-619a67bb9924 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-05093e23-47c3-43c8-8aa0-619a67bb9924 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:25.580151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:25.580987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:25.581828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:25.581828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:25.581828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:25.581828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:25.581828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:25.581828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:25.581828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:25.581828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:25.586022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 264/528] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:25.587372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05093e23-47c3-43c8-8aa0-619a67bb9924 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:25.644810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cae3c-f00b-4234-a6ab-f6af930b65ae None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:25.677578 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d53f3-d9f9-4617-80eb-e542d86cd2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:25.678233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d53f3-d9f9-4617-80eb-e542d86cd2a1 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:25.678556 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d53f3-d9f9-4617-80eb-e542d86cd2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:25.678836 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d53f3-d9f9-4617-80eb-e542d86cd2a1 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:25.679619 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d53f3-d9f9-4617-80eb-e542d86cd2a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:25.679925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d53f3-d9f9-4617-80eb-e542d86cd2a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:25.681996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d53f3-d9f9-4617-80eb-e542d86cd2a1 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:25.684970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05093e23-47c3-43c8-8aa0-619a67bb9924 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:25.699623 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 265/529] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:25.700696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d53f3-d9f9-4617-80eb-e542d86cd2a1 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:25.719097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd80da-a111-4926-bdaa-723601fd44bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:25.719753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd80da-a111-4926-bdaa-723601fd44bd None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:25.720029 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd80da-a111-4926-bdaa-723601fd44bd None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:25.720297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd80da-a111-4926-bdaa-723601fd44bd None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:25.721013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd80da-a111-4926-bdaa-723601fd44bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:25.721311 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd80da-a111-4926-bdaa-723601fd44bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:25.722709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd80da-a111-4926-bdaa-723601fd44bd None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:25.734896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 265/530] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:25.735610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd80da-a111-4926-bdaa-723601fd44bd None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:25.802676 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d53f3-d9f9-4617-80eb-e542d86cd2a1 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:25.837809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd80da-a111-4926-bdaa-723601fd44bd None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:25.840990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b8e66-2db6-44e5-a398-23218af2d5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:25.841715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b8e66-2db6-44e5-a398-23218af2d5ea None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:25.841999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b8e66-2db6-44e5-a398-23218af2d5ea None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:25.842271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b8e66-2db6-44e5-a398-23218af2d5ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:25.853328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b8e66-2db6-44e5-a398-23218af2d5ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:25.854825 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b8e66-2db6-44e5-a398-23218af2d5ea None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:25.869418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182290c4-c232-46c1-b030-ca823deba502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:25.870067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182290c4-c232-46c1-b030-ca823deba502 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:25.870372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182290c4-c232-46c1-b030-ca823deba502 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:25.870644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182290c4-c232-46c1-b030-ca823deba502 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:25.871418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182290c4-c232-46c1-b030-ca823deba502 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-785b8e66-2db6-44e5-a398-23218af2d5ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:25.871670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:25.872427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:25.873258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:25.873258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:25.873258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:25.873258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:25.873469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182290c4-c232-46c1-b030-ca823deba502 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:25.873469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182290c4-c232-46c1-b030-ca823deba502 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:25.877297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 266/531] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:25.878132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b8e66-2db6-44e5-a398-23218af2d5ea None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:25.891071 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 266/532] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:25.896478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182290c4-c232-46c1-b030-ca823deba502 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:25.972609 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b8e66-2db6-44e5-a398-23218af2d5ea None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:25.992455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182290c4-c232-46c1-b030-ca823deba502 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:26.005768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5157ba-df33-48ea-a2f8-f3fc067e5b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:26.006449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5157ba-df33-48ea-a2f8-f3fc067e5b62 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:26.006734 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5157ba-df33-48ea-a2f8-f3fc067e5b62 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:26.007001 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5157ba-df33-48ea-a2f8-f3fc067e5b62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:26.007829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5157ba-df33-48ea-a2f8-f3fc067e5b62 None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=ebefa53d595b4e6486ce409f2ac47ff1) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:26.008247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5157ba-df33-48ea-a2f8-f3fc067e5b62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:26.009756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5157ba-df33-48ea-a2f8-f3fc067e5b62 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:26.024606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 267/533] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:25 2022] GET /identity/v3/role_assignments?user.id=ebefa53d595b4e6486ce409f2ac47ff1&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:26.024606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5157ba-df33-48ea-a2f8-f3fc067e5b62 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:26.027849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d90c78-e328-434b-a217-fb1c8b10e5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:26.028673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d90c78-e328-434b-a217-fb1c8b10e5a9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:26.028955 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d90c78-e328-434b-a217-fb1c8b10e5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:26.029230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d90c78-e328-434b-a217-fb1c8b10e5a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:26.041258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d90c78-e328-434b-a217-fb1c8b10e5a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:26.042803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d90c78-e328-434b-a217-fb1c8b10e5a9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-90d90c78-e328-434b-a217-fb1c8b10e5a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:26.058389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:26.059295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:26.060174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:26.060174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:26.060174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:26.060174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:26.060174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:26.060174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:26.060174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:26.060174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:26.060174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 267/534] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:26.061219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d90c78-e328-434b-a217-fb1c8b10e5a9 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:26.143738 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5157ba-df33-48ea-a2f8-f3fc067e5b62 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:26.177899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d90c78-e328-434b-a217-fb1c8b10e5a9 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:26.188285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4a715-1c85-4e71-8d2a-b6e16790a05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:26.188965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4a715-1c85-4e71-8d2a-b6e16790a05c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:26.189247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4a715-1c85-4e71-8d2a-b6e16790a05c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:26.189523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4a715-1c85-4e71-8d2a-b6e16790a05c None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:26.190359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4a715-1c85-4e71-8d2a-b6e16790a05c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:26.190618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4a715-1c85-4e71-8d2a-b6e16790a05c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:26.192019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4a715-1c85-4e71-8d2a-b6e16790a05c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:26.205553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 268/535] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:26.206528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4a715-1c85-4e71-8d2a-b6e16790a05c None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:26.226936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7f685-8c38-4e04-8ad0-12aa69476f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:26.228017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7f685-8c38-4e04-8ad0-12aa69476f1d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:26.228303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7f685-8c38-4e04-8ad0-12aa69476f1d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:26.228582 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7f685-8c38-4e04-8ad0-12aa69476f1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:26.229425 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7f685-8c38-4e04-8ad0-12aa69476f1d None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=d346be1ef7604f1f87371f5d322fd010) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:26.229739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7f685-8c38-4e04-8ad0-12aa69476f1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:26.231214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7f685-8c38-4e04-8ad0-12aa69476f1d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:26.243057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 268/536] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:26 2022] GET /identity/v3/role_assignments?user.id=d346be1ef7604f1f87371f5d322fd010&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:26.244291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7f685-8c38-4e04-8ad0-12aa69476f1d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:26.321547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4a715-1c85-4e71-8d2a-b6e16790a05c None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:26.357729 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7540ef0-73e6-44a5-9e42-15864de77ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:26.358798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7540ef0-73e6-44a5-9e42-15864de77ff9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:26.359281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7540ef0-73e6-44a5-9e42-15864de77ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:26.359752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7540ef0-73e6-44a5-9e42-15864de77ff9 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:26.360743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7540ef0-73e6-44a5-9e42-15864de77ff9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:26.361274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7540ef0-73e6-44a5-9e42-15864de77ff9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:26.362982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7540ef0-73e6-44a5-9e42-15864de77ff9 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:26.376806 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 269/537] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:26.386273 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7540ef0-73e6-44a5-9e42-15864de77ff9 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:26.433106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7f685-8c38-4e04-8ad0-12aa69476f1d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:26.522000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7b4dc-ae96-45a5-a24e-f972a33a3b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:26.523202 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b4dc-ae96-45a5-a24e-f972a33a3b79 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:26.523846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b4dc-ae96-45a5-a24e-f972a33a3b79 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:26.524332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7b4dc-ae96-45a5-a24e-f972a33a3b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:26.536206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7b4dc-ae96-45a5-a24e-f972a33a3b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:26.538371 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7b4dc-ae96-45a5-a24e-f972a33a3b79 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-b1d7b4dc-ae96-45a5-a24e-f972a33a3b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:26.571344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:26.572343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:26.573199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:26.573199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:26.573199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:26.573199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:26.573199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:26.573199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:26.573199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:26.573199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:26.578567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 269/538] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:26.584564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7540ef0-73e6-44a5-9e42-15864de77ff9 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:26.585826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7b4dc-ae96-45a5-a24e-f972a33a3b79 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:26.621075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6500c-76e6-4ec4-b6ab-5a75501e52bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:26.621727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6500c-76e6-4ec4-b6ab-5a75501e52bf None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:26.622013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6500c-76e6-4ec4-b6ab-5a75501e52bf None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:26.622293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6500c-76e6-4ec4-b6ab-5a75501e52bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:26.623304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6500c-76e6-4ec4-b6ab-5a75501e52bf None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=b9b7a0202f394b16800af94487a21ef0) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:26.623620 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6500c-76e6-4ec4-b6ab-5a75501e52bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:26.625073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6500c-76e6-4ec4-b6ab-5a75501e52bf None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:26.631175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 270/539] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:26 2022] GET /identity/v3/role_assignments?user.id=b9b7a0202f394b16800af94487a21ef0&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:26.730053 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7b4dc-ae96-45a5-a24e-f972a33a3b79 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:26.777632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739c6867-9caa-4504-9220-0c1707d4a899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:26.778601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c6867-9caa-4504-9220-0c1707d4a899 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:26.779027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c6867-9caa-4504-9220-0c1707d4a899 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:26.779439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739c6867-9caa-4504-9220-0c1707d4a899 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:26.780374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c6867-9caa-4504-9220-0c1707d4a899 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:26.780822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c6867-9caa-4504-9220-0c1707d4a899 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:26.782444 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739c6867-9caa-4504-9220-0c1707d4a899 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:26.798999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 270/540] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:26.805850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6500c-76e6-4ec4-b6ab-5a75501e52bf None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:26.943063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6500c-76e6-4ec4-b6ab-5a75501e52bf None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:26.981004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df463d-4923-420a-b6d6-992b24f1d15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:26.982007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df463d-4923-420a-b6d6-992b24f1d15d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:26.982296 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df463d-4923-420a-b6d6-992b24f1d15d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:26.982597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df463d-4923-420a-b6d6-992b24f1d15d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:26.983438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df463d-4923-420a-b6d6-992b24f1d15d None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=abfc1e35362a4495a05475878db260f2) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:26.983751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df463d-4923-420a-b6d6-992b24f1d15d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:26.985197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df463d-4923-420a-b6d6-992b24f1d15d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:26.991551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 271/541] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:26 2022] GET /identity/v3/role_assignments?user.id=abfc1e35362a4495a05475878db260f2&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:27.359544 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a7097-6671-4cf5-9e9b-f63eef7e0ae1 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:27.360065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a7097-6671-4cf5-9e9b-f63eef7e0ae1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:27.360171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a7097-6671-4cf5-9e9b-f63eef7e0ae1 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:27.361714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 271/542] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:27.367243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e44385-db5d-4a90-a03a-6bb8939b808e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:27.367603 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e44385-db5d-4a90-a03a-6bb8939b808e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:27.368415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e44385-db5d-4a90-a03a-6bb8939b808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:27.392079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-61e44385-db5d-4a90-a03a-6bb8939b808e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:27.393541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-61e44385-db5d-4a90-a03a-6bb8939b808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:27.475136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 272/543] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:27.507056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a7097-6671-4cf5-9e9b-f63eef7e0ae1 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:27.632242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a7097-6671-4cf5-9e9b-f63eef7e0ae1 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:27.673777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06161536-693d-48c3-a7ad-13374d57e906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:27.674867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06161536-693d-48c3-a7ad-13374d57e906 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:27.675290 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06161536-693d-48c3-a7ad-13374d57e906 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:27.675702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06161536-693d-48c3-a7ad-13374d57e906 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:27.691309 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06161536-693d-48c3-a7ad-13374d57e906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-06161536-693d-48c3-a7ad-13374d57e906 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:27.700190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:27.701330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:27.706379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:27.709061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 272/544] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:27.714874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e44385-db5d-4a90-a03a-6bb8939b808e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:27.921393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e44385-db5d-4a90-a03a-6bb8939b808e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:27.968864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd3afd-57fa-4d67-b70e-1ce8e4788632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:27.969615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd3afd-57fa-4d67-b70e-1ce8e4788632 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:27.969811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd3afd-57fa-4d67-b70e-1ce8e4788632 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:27.970083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd3afd-57fa-4d67-b70e-1ce8e4788632 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:27.970857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd3afd-57fa-4d67-b70e-1ce8e4788632 None admin] RBAC: Adding query filter params (name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:27.971160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd3afd-57fa-4d67-b70e-1ce8e4788632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:27.972654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd3afd-57fa-4d67-b70e-1ce8e4788632 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:27.986155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 273/545] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:27.991218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06161536-693d-48c3-a7ad-13374d57e906 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:28.117683 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06161536-693d-48c3-a7ad-13374d57e906 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:28.157791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f540dd-5d70-40df-bc81-09cb9be44837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:28.158622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f540dd-5d70-40df-bc81-09cb9be44837 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:28.158907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f540dd-5d70-40df-bc81-09cb9be44837 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:28.159181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f540dd-5d70-40df-bc81-09cb9be44837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:28.170303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f540dd-5d70-40df-bc81-09cb9be44837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:28.171836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f540dd-5d70-40df-bc81-09cb9be44837 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-e8f540dd-5d70-40df-bc81-09cb9be44837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:28.199874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:28.200771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:28.201635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:28.201635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:28.201635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:28.201635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:28.201635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 273/546] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:28.206929 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd3afd-57fa-4d67-b70e-1ce8e4788632 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:28.353281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd3afd-57fa-4d67-b70e-1ce8e4788632 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:28.397570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007ae3-3e1c-43b8-aa94-e6e90cac6201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:28.398229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007ae3-3e1c-43b8-aa94-e6e90cac6201 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:28.398529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007ae3-3e1c-43b8-aa94-e6e90cac6201 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:28.398935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba007ae3-3e1c-43b8-aa94-e6e90cac6201 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:28.399668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba007ae3-3e1c-43b8-aa94-e6e90cac6201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:28.399970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba007ae3-3e1c-43b8-aa94-e6e90cac6201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:28.401333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba007ae3-3e1c-43b8-aa94-e6e90cac6201 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:28.417236 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 274/547] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:28.422291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f540dd-5d70-40df-bc81-09cb9be44837 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:28.575760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f540dd-5d70-40df-bc81-09cb9be44837 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:28.610196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bde5e4-957c-48c5-aa45-d09e8a676af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:28.611027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bde5e4-957c-48c5-aa45-d09e8a676af5 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:28.611310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bde5e4-957c-48c5-aa45-d09e8a676af5 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:28.611587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bde5e4-957c-48c5-aa45-d09e8a676af5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:28.620218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bde5e4-957c-48c5-aa45-d09e8a676af5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:28.621686 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bde5e4-957c-48c5-aa45-d09e8a676af5 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-10bde5e4-957c-48c5-aa45-d09e8a676af5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:28.636343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:28.638576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:28.640695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:28.640695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:28.640695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:28.640695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:28.640695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:28.640695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:28.640695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:28.640695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:28.640695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:28.640695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:28.640695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 274/548] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:28.646330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007ae3-3e1c-43b8-aa94-e6e90cac6201 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:28.727947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b311f6e-5255-4890-9709-dc6bbe917565 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:28.728395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b311f6e-5255-4890-9709-dc6bbe917565 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:28.728578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b311f6e-5255-4890-9709-dc6bbe917565 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:28.730122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 275/549] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:28.735136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d02c3-927e-4f0a-99c0-a28030284a43 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:28.735424 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d02c3-927e-4f0a-99c0-a28030284a43 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:28.735705 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d02c3-927e-4f0a-99c0-a28030284a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:28.759690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-996d02c3-927e-4f0a-99c0-a28030284a43 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:28.760888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-996d02c3-927e-4f0a-99c0-a28030284a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:28.786157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba007ae3-3e1c-43b8-aa94-e6e90cac6201 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:28.827715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff97edc-98aa-46bf-a4a2-f9ad11d7c0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:28.828724 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff97edc-98aa-46bf-a4a2-f9ad11d7c0a7 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:28.829226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff97edc-98aa-46bf-a4a2-f9ad11d7c0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:28.829696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff97edc-98aa-46bf-a4a2-f9ad11d7c0a7 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:28.830762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff97edc-98aa-46bf-a4a2-f9ad11d7c0a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:28.832391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff97edc-98aa-46bf-a4a2-f9ad11d7c0a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:28.834020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff97edc-98aa-46bf-a4a2-f9ad11d7c0a7 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:28.853637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 276/550] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:28.861746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 275/551] 10.222.0.61 () {56 vars in 1135 bytes} [Sat May 14 15:33:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:28.867117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d02c3-927e-4f0a-99c0-a28030284a43 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:28.881241 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff97edc-98aa-46bf-a4a2-f9ad11d7c0a7 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:28.982707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d02c3-927e-4f0a-99c0-a28030284a43 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:29.028816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afef1a7-5c58-44ea-896d-aef17b6646d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:29.029468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef1a7-5c58-44ea-896d-aef17b6646d9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.029751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef1a7-5c58-44ea-896d-aef17b6646d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.030025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef1a7-5c58-44ea-896d-aef17b6646d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.082660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff97edc-98aa-46bf-a4a2-f9ad11d7c0a7 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:29.129805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd55b07-8a09-4998-b943-599440f14b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:29.130903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd55b07-8a09-4998-b943-599440f14b90 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.131331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd55b07-8a09-4998-b943-599440f14b90 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.131751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd55b07-8a09-4998-b943-599440f14b90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.157649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd55b07-8a09-4998-b943-599440f14b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-3dd55b07-8a09-4998-b943-599440f14b90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:29.167163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:29.168270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:29.169243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:29.172401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 276/552] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:29.173875 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66870a0-bf5f-4ef5-b4fe-4caaf9f1994a None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.174260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66870a0-bf5f-4ef5-b4fe-4caaf9f1994a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.174684 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66870a0-bf5f-4ef5-b4fe-4caaf9f1994a None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.176507 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 277/553] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:29.178643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afef1a7-5c58-44ea-896d-aef17b6646d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:29.180836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afef1a7-5c58-44ea-896d-aef17b6646d9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:29.181838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66870a0-bf5f-4ef5-b4fe-4caaf9f1994a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:29.290852 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 277/554] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:29.292427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fd70a-7056-4acf-bf60-596c5a56a9bc None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.292871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fd70a-7056-4acf-bf60-596c5a56a9bc None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.293323 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fd70a-7056-4acf-bf60-596c5a56a9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.309995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66870a0-bf5f-4ef5-b4fe-4caaf9f1994a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:29.315384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-155fd70a-7056-4acf-bf60-596c5a56a9bc None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:29.316674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-155fd70a-7056-4acf-bf60-596c5a56a9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:29.347442 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848998b-bcf3-425b-847d-17d782279924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:29.348452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848998b-bcf3-425b-847d-17d782279924 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.349062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848998b-bcf3-425b-847d-17d782279924 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.349813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848998b-bcf3-425b-847d-17d782279924 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.350883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848998b-bcf3-425b-847d-17d782279924 None admin] RBAC: Adding query filter params (name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:29.351336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848998b-bcf3-425b-847d-17d782279924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:29.353853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848998b-bcf3-425b-847d-17d782279924 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:29.361970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 278/555] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:29.362995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848998b-bcf3-425b-847d-17d782279924 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:29.394733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 278/556] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:29.396742 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af53ec-18fa-47a6-9267-a1ba01d9b074 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.397032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af53ec-18fa-47a6-9267-a1ba01d9b074 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.397310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af53ec-18fa-47a6-9267-a1ba01d9b074 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.398583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 279/557] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:29.399516 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af53ec-18fa-47a6-9267-a1ba01d9b074 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:29.489353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848998b-bcf3-425b-847d-17d782279924 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:29.500152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af53ec-18fa-47a6-9267-a1ba01d9b074 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:29.524414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42d288-312d-4a60-916b-f1223309c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:29.525206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42d288-312d-4a60-916b-f1223309c55d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.525490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42d288-312d-4a60-916b-f1223309c55d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.525767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42d288-312d-4a60-916b-f1223309c55d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.533858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b3f0-d346-4d5c-a37d-8f0b32ef1b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:29.534754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b3f0-d346-4d5c-a37d-8f0b32ef1b30 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.535040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b3f0-d346-4d5c-a37d-8f0b32ef1b30 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.535313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878b3f0-d346-4d5c-a37d-8f0b32ef1b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.536272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42d288-312d-4a60-916b-f1223309c55d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:29.537715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42d288-312d-4a60-916b-f1223309c55d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:29.546514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878b3f0-d346-4d5c-a37d-8f0b32ef1b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:29.548066 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878b3f0-d346-4d5c-a37d-8f0b32ef1b30 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-ef42d288-312d-4a60-916b-f1223309c55d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:29.555871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:29.556695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:29.557526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:29.557526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:29.557526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:29.557526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:29.557526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 279/558] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:29.558339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc5ff7-3a8e-4ccb-b594-97226c34d265 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.558623 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc5ff7-3a8e-4ccb-b594-97226c34d265 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.558898 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc5ff7-3a8e-4ccb-b594-97226c34d265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-7878b3f0-d346-4d5c-a37d-8f0b32ef1b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:29.570691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:29.571794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:29.572650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:29.572650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:29.572650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:29.572650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:29.576289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 280/559] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:29.576486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-88bc5ff7-3a8e-4ccb-b594-97226c34d265 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:29.576639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b3f0-d346-4d5c-a37d-8f0b32ef1b30 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:29.576782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-88bc5ff7-3a8e-4ccb-b594-97226c34d265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:29.647139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 280/560] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:29.647911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc5ff7-3a8e-4ccb-b594-97226c34d265 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:29.684777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878b3f0-d346-4d5c-a37d-8f0b32ef1b30 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:29.717251 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f81bab-37e2-4256-88ff-2e231afb9569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:29.718045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f81bab-37e2-4256-88ff-2e231afb9569 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.718345 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f81bab-37e2-4256-88ff-2e231afb9569 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.718628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f81bab-37e2-4256-88ff-2e231afb9569 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.729285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f81bab-37e2-4256-88ff-2e231afb9569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-46f81bab-37e2-4256-88ff-2e231afb9569 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:29.737125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:29.738032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 281/561] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:29.744552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f81bab-37e2-4256-88ff-2e231afb9569 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:29.749067 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc5ff7-3a8e-4ccb-b594-97226c34d265 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:29.782921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e59d8-70c7-45ff-92c8-3432343cfe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:29.783584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e59d8-70c7-45ff-92c8-3432343cfe81 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.783867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e59d8-70c7-45ff-92c8-3432343cfe81 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.784136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e59d8-70c7-45ff-92c8-3432343cfe81 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.784866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e59d8-70c7-45ff-92c8-3432343cfe81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:29.785172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e59d8-70c7-45ff-92c8-3432343cfe81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:29.786579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e59d8-70c7-45ff-92c8-3432343cfe81 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:29.797537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 281/562] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:29.798263 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e59d8-70c7-45ff-92c8-3432343cfe81 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:29.841883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f81bab-37e2-4256-88ff-2e231afb9569 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:29.873762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee1681-02df-442d-acf5-cb31fa2306aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:29.874447 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1681-02df-442d-acf5-cb31fa2306aa None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.874731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1681-02df-442d-acf5-cb31fa2306aa None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.875002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee1681-02df-442d-acf5-cb31fa2306aa None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.875716 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee1681-02df-442d-acf5-cb31fa2306aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:29.876018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee1681-02df-442d-acf5-cb31fa2306aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:29.877387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee1681-02df-442d-acf5-cb31fa2306aa None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:29.888998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 282/563] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:29.889774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee1681-02df-442d-acf5-cb31fa2306aa None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:29.893923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e59d8-70c7-45ff-92c8-3432343cfe81 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:29.925466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f5625-b674-4f49-a925-001c54751195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:29.926248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f5625-b674-4f49-a925-001c54751195 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.926555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f5625-b674-4f49-a925-001c54751195 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.926834 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f5625-b674-4f49-a925-001c54751195 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.937153 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f5625-b674-4f49-a925-001c54751195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-d28f5625-b674-4f49-a925-001c54751195 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:29.944766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:29.946933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 282/564] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:29.948134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbdc78-5443-4e6c-8d84-b82b650e2c48 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:29.949043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbdc78-5443-4e6c-8d84-b82b650e2c48 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:29.949043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbdc78-5443-4e6c-8d84-b82b650e2c48 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:29.949533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 283/565] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:29.950222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbdc78-5443-4e6c-8d84-b82b650e2c48 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:29.987234 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee1681-02df-442d-acf5-cb31fa2306aa None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.020439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fd3c7-ec13-4f8a-ad8e-3e15c42774cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.021097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fd3c7-ec13-4f8a-ad8e-3e15c42774cc None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.021377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fd3c7-ec13-4f8a-ad8e-3e15c42774cc None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.021650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fd3c7-ec13-4f8a-ad8e-3e15c42774cc None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.022414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fd3c7-ec13-4f8a-ad8e-3e15c42774cc None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:30.022712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fd3c7-ec13-4f8a-ad8e-3e15c42774cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.024162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232fd3c7-ec13-4f8a-ad8e-3e15c42774cc None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.031672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 283/566] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:30.032447 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fd3c7-ec13-4f8a-ad8e-3e15c42774cc None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.047368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbdc78-5443-4e6c-8d84-b82b650e2c48 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.079533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8afbd-88b4-48a7-9aa3-307610443f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.080326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8afbd-88b4-48a7-9aa3-307610443f8e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.080613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8afbd-88b4-48a7-9aa3-307610443f8e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.080892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8afbd-88b4-48a7-9aa3-307610443f8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.088521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8afbd-88b4-48a7-9aa3-307610443f8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.089974 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8afbd-88b4-48a7-9aa3-307610443f8e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-70c8afbd-88b4-48a7-9aa3-307610443f8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:30.105205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:30.106338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:30.107506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:30.107506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:30.107506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:30.107506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:30.107506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:30.107506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:30.107506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:30.107506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:30.107506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 284/567] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:30.107972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18053c-f7fc-41be-bbd3-374c1cf0387c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.107972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18053c-f7fc-41be-bbd3-374c1cf0387c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.108119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18053c-f7fc-41be-bbd3-374c1cf0387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.124226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-da18053c-f7fc-41be-bbd3-374c1cf0387c None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:30.125416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-da18053c-f7fc-41be-bbd3-374c1cf0387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:30.128316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fd3c7-ec13-4f8a-ad8e-3e15c42774cc None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.160228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7590172-d3fb-4e37-b762-92c2de4ebae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.161007 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7590172-d3fb-4e37-b762-92c2de4ebae8 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.161285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7590172-d3fb-4e37-b762-92c2de4ebae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.161555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7590172-d3fb-4e37-b762-92c2de4ebae8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.168762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7590172-d3fb-4e37-b762-92c2de4ebae8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.170171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7590172-d3fb-4e37-b762-92c2de4ebae8 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-b7590172-d3fb-4e37-b762-92c2de4ebae8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:30.183641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:30.184698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 284/568] 10.222.0.61 () {56 vars in 1093 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:30.185712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7590172-d3fb-4e37-b762-92c2de4ebae8 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.202331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 285/569] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:30.202331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18053c-f7fc-41be-bbd3-374c1cf0387c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.281420 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7590172-d3fb-4e37-b762-92c2de4ebae8 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.282083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18053c-f7fc-41be-bbd3-374c1cf0387c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.313645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbb57a-a18c-43db-8eae-2587b795fe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.314025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87430b11-c57f-48fc-8188-d31081acf0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.314336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbb57a-a18c-43db-8eae-2587b795fe87 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.314615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbb57a-a18c-43db-8eae-2587b795fe87 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.314818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430b11-c57f-48fc-8188-d31081acf0e8 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.314907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbb57a-a18c-43db-8eae-2587b795fe87 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.315095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430b11-c57f-48fc-8188-d31081acf0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.315361 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430b11-c57f-48fc-8188-d31081acf0e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.315616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbb57a-a18c-43db-8eae-2587b795fe87 None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:30.315919 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbb57a-a18c-43db-8eae-2587b795fe87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.317276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbb57a-a18c-43db-8eae-2587b795fe87 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.324910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87430b11-c57f-48fc-8188-d31081acf0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.325050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 285/570] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:30.325719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbb57a-a18c-43db-8eae-2587b795fe87 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.326456 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87430b11-c57f-48fc-8188-d31081acf0e8 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-87430b11-c57f-48fc-8188-d31081acf0e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:30.343744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:30.344790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:30.346390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:30.346390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:30.346390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:30.346390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:30.346390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 286/571] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:30.346390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87430b11-c57f-48fc-8188-d31081acf0e8 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.422703 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbb57a-a18c-43db-8eae-2587b795fe87 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.442487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87430b11-c57f-48fc-8188-d31081acf0e8 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.453411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86107-2161-4d04-bd35-7203bcbbccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.454060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86107-2161-4d04-bd35-7203bcbbccd8 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.454357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86107-2161-4d04-bd35-7203bcbbccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.454628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86107-2161-4d04-bd35-7203bcbbccd8 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.455399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86107-2161-4d04-bd35-7203bcbbccd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:30.455701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86107-2161-4d04-bd35-7203bcbbccd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.457122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86107-2161-4d04-bd35-7203bcbbccd8 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.469218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 286/572] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:30.469915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86107-2161-4d04-bd35-7203bcbbccd8 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.474668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4881a-9637-44e8-bac3-36b8576ca5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.475327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4881a-9637-44e8-bac3-36b8576ca5ba None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.475607 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4881a-9637-44e8-bac3-36b8576ca5ba None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.475880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4881a-9637-44e8-bac3-36b8576ca5ba None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.476709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4881a-9637-44e8-bac3-36b8576ca5ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:30.478024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4881a-9637-44e8-bac3-36b8576ca5ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.479632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4881a-9637-44e8-bac3-36b8576ca5ba None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.496050 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 287/573] 10.222.0.61 () {56 vars in 1133 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:30.496836 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4881a-9637-44e8-bac3-36b8576ca5ba None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.568107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86107-2161-4d04-bd35-7203bcbbccd8 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.589103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4881a-9637-44e8-bac3-36b8576ca5ba None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.599646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26875a-ac74-4c2d-ac91-9e7bcaa69d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.600446 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26875a-ac74-4c2d-ac91-9e7bcaa69d9d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.600728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26875a-ac74-4c2d-ac91-9e7bcaa69d9d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.601003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26875a-ac74-4c2d-ac91-9e7bcaa69d9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.611315 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26875a-ac74-4c2d-ac91-9e7bcaa69d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-4a26875a-ac74-4c2d-ac91-9e7bcaa69d9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:30.618879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:30.620108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 287/574] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:30.621126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26875a-ac74-4c2d-ac91-9e7bcaa69d9d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.624494 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24c61e-8927-41f5-9611-bccbb69ad142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.625271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c61e-8927-41f5-9611-bccbb69ad142 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.625546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c61e-8927-41f5-9611-bccbb69ad142 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.625819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c61e-8927-41f5-9611-bccbb69ad142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.635751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24c61e-8927-41f5-9611-bccbb69ad142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.637201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24c61e-8927-41f5-9611-bccbb69ad142 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-0e24c61e-8927-41f5-9611-bccbb69ad142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:30.654480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:30.655528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:30.656645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:30.656645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:30.656645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:30.656645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:30.656645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 288/575] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:30.657000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24c61e-8927-41f5-9611-bccbb69ad142 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.717843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26875a-ac74-4c2d-ac91-9e7bcaa69d9d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.749638 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cfd4c-db75-4732-bbc1-c2f9d6b94ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.750287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cfd4c-db75-4732-bbc1-c2f9d6b94ff2 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.750601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cfd4c-db75-4732-bbc1-c2f9d6b94ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.750872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cfd4c-db75-4732-bbc1-c2f9d6b94ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.751580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cfd4c-db75-4732-bbc1-c2f9d6b94ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:30.751776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24c61e-8927-41f5-9611-bccbb69ad142 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.751878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cfd4c-db75-4732-bbc1-c2f9d6b94ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.753228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cfd4c-db75-4732-bbc1-c2f9d6b94ff2 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.764327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 288/576] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:30.765116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cfd4c-db75-4732-bbc1-c2f9d6b94ff2 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.784117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d88384-0b06-407e-8408-d5326dccc11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.784760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88384-0b06-407e-8408-d5326dccc11a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.785040 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88384-0b06-407e-8408-d5326dccc11a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.785312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88384-0b06-407e-8408-d5326dccc11a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.786142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d88384-0b06-407e-8408-d5326dccc11a None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=1713718ff95744b9bd42f21d4ec8bb91) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:30.786480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d88384-0b06-407e-8408-d5326dccc11a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.787888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d88384-0b06-407e-8408-d5326dccc11a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.793750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 289/577] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/role_assignments?user.id=1713718ff95744b9bd42f21d4ec8bb91&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:30.794540 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d88384-0b06-407e-8408-d5326dccc11a None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.886910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cfd4c-db75-4732-bbc1-c2f9d6b94ff2 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.899782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d88384-0b06-407e-8408-d5326dccc11a None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:30.922640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17763da5-fca2-47fb-aee1-c2dd1cc402eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.923429 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17763da5-fca2-47fb-aee1-c2dd1cc402eb None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.923704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17763da5-fca2-47fb-aee1-c2dd1cc402eb None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.923973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17763da5-fca2-47fb-aee1-c2dd1cc402eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.934901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17763da5-fca2-47fb-aee1-c2dd1cc402eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.935272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b739e-07f7-4934-b91c-889e73d1b7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:30.935860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b739e-07f7-4934-b91c-889e73d1b7f2 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:30.936142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b739e-07f7-4934-b91c-889e73d1b7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:30.936404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17763da5-fca2-47fb-aee1-c2dd1cc402eb None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.936507 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b739e-07f7-4934-b91c-889e73d1b7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:30.937162 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b739e-07f7-4934-b91c-889e73d1b7f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:30.937469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b739e-07f7-4934-b91c-889e73d1b7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:30.938894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b739e-07f7-4934-b91c-889e73d1b7f2 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:30.948394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 290/578] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:30.949261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b739e-07f7-4934-b91c-889e73d1b7f2 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-17763da5-fca2-47fb-aee1-c2dd1cc402eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:30.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:30.957691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:30.958811 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:30.958811 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:30.958811 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:30.958811 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:30.965007 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 289/579] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:30.965007 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17763da5-fca2-47fb-aee1-c2dd1cc402eb None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.049136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b739e-07f7-4934-b91c-889e73d1b7f2 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.063757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17763da5-fca2-47fb-aee1-c2dd1cc402eb None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.082532 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97184cff-0cca-4333-974f-5c6e68ee6160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.083198 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97184cff-0cca-4333-974f-5c6e68ee6160 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.083486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97184cff-0cca-4333-974f-5c6e68ee6160 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.083763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97184cff-0cca-4333-974f-5c6e68ee6160 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.084490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97184cff-0cca-4333-974f-5c6e68ee6160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:31.084794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97184cff-0cca-4333-974f-5c6e68ee6160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.086848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97184cff-0cca-4333-974f-5c6e68ee6160 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.098485 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 291/580] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:31.099083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b0f7-c86b-4fd8-b1f7-f81d24e941e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.099283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b0f7-c86b-4fd8-b1f7-f81d24e941e7 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.099400 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97184cff-0cca-4333-974f-5c6e68ee6160 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.099573 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b0f7-c86b-4fd8-b1f7-f81d24e941e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.099849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621b0f7-c86b-4fd8-b1f7-f81d24e941e7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.110502 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621b0f7-c86b-4fd8-b1f7-f81d24e941e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.111954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621b0f7-c86b-4fd8-b1f7-f81d24e941e7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-4621b0f7-c86b-4fd8-b1f7-f81d24e941e7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:31.126240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:31.127257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 290/581] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:31.133564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b0f7-c86b-4fd8-b1f7-f81d24e941e7 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.206097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97184cff-0cca-4333-974f-5c6e68ee6160 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.232419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621b0f7-c86b-4fd8-b1f7-f81d24e941e7 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.239449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b3629-10d5-41bd-9123-7077a79b5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.240240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b3629-10d5-41bd-9123-7077a79b5a0e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.240523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b3629-10d5-41bd-9123-7077a79b5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.240801 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b3629-10d5-41bd-9123-7077a79b5a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.251829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b3629-10d5-41bd-9123-7077a79b5a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.253290 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b3629-10d5-41bd-9123-7077a79b5a0e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.266008 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbdc33-dd28-4b79-b87a-dca9f7e04cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.266705 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbdc33-dd28-4b79-b87a-dca9f7e04cba None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.267019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbdc33-dd28-4b79-b87a-dca9f7e04cba None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.267342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbdc33-dd28-4b79-b87a-dca9f7e04cba None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.268067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbdc33-dd28-4b79-b87a-dca9f7e04cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:31.268370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbdc33-dd28-4b79-b87a-dca9f7e04cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.269732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbdc33-dd28-4b79-b87a-dca9f7e04cba None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-002b3629-10d5-41bd-9123-7077a79b5a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:31.271669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:31.272513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:31.273410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:31.273410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:31.273410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:31.273410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:31.273410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 292/582] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:31.274224 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b3629-10d5-41bd-9123-7077a79b5a0e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.285084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 291/583] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:31.286040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbdc33-dd28-4b79-b87a-dca9f7e04cba None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.381553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b3629-10d5-41bd-9123-7077a79b5a0e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.387144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbdc33-dd28-4b79-b87a-dca9f7e04cba None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.416023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c31805-0cdb-4175-815b-ad34be934485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.416815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c31805-0cdb-4175-815b-ad34be934485 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.417113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c31805-0cdb-4175-815b-ad34be934485 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.417381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c31805-0cdb-4175-815b-ad34be934485 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.420992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e44d8-2a6e-40a6-8bce-a3107e7e2184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.421653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e44d8-2a6e-40a6-8bce-a3107e7e2184 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.421936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e44d8-2a6e-40a6-8bce-a3107e7e2184 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.422206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e44d8-2a6e-40a6-8bce-a3107e7e2184 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.423072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e44d8-2a6e-40a6-8bce-a3107e7e2184 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:31.423377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e44d8-2a6e-40a6-8bce-a3107e7e2184 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.424584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c31805-0cdb-4175-815b-ad34be934485 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.424826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e44d8-2a6e-40a6-8bce-a3107e7e2184 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.426021 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c31805-0cdb-4175-815b-ad34be934485 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-d6c31805-0cdb-4175-815b-ad34be934485 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:31.441160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:31.442214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:31.443199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:31.443199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:31.443199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:31.443199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:31.443199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:31.443199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:31.443199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:31.443199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:31.443199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 14 15:33:31.443199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:31.443199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 293/584] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:31.443821 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c31805-0cdb-4175-815b-ad34be934485 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.449344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 292/585] 10.222.0.61 () {56 vars in 1137 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:31.449344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e44d8-2a6e-40a6-8bce-a3107e7e2184 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.544820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c31805-0cdb-4175-815b-ad34be934485 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.550338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e44d8-2a6e-40a6-8bce-a3107e7e2184 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.578282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd63b8-3c6c-4e80-a7e9-9eed6275490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.578966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd63b8-3c6c-4e80-a7e9-9eed6275490b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.579250 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd63b8-3c6c-4e80-a7e9-9eed6275490b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.579521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd63b8-3c6c-4e80-a7e9-9eed6275490b None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.580240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd63b8-3c6c-4e80-a7e9-9eed6275490b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:31.580544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd63b8-3c6c-4e80-a7e9-9eed6275490b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.581899 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd63b8-3c6c-4e80-a7e9-9eed6275490b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.585411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c6633-7c0a-4d68-8fea-8ed6cfb3e243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.586236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c6633-7c0a-4d68-8fea-8ed6cfb3e243 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.587120 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c6633-7c0a-4d68-8fea-8ed6cfb3e243 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.587404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c6633-7c0a-4d68-8fea-8ed6cfb3e243 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.594202 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c6633-7c0a-4d68-8fea-8ed6cfb3e243 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.595124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 294/586] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:31.595678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c6633-7c0a-4d68-8fea-8ed6cfb3e243 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.596272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd63b8-3c6c-4e80-a7e9-9eed6275490b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-7c5c6633-7c0a-4d68-8fea-8ed6cfb3e243 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:31.614058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:31.615044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:31.620882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:31.620882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:31.620882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:31.620882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:31.620882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:31.620882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:31.620882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:31.620882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:31.620882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 293/587] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:31.620882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c6633-7c0a-4d68-8fea-8ed6cfb3e243 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.705144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd63b8-3c6c-4e80-a7e9-9eed6275490b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.717540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c6633-7c0a-4d68-8fea-8ed6cfb3e243 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.738923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d1693-5bc3-47f9-9d07-59f2c938bf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.739711 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1693-5bc3-47f9-9d07-59f2c938bf88 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.740004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1693-5bc3-47f9-9d07-59f2c938bf88 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.740283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1693-5bc3-47f9-9d07-59f2c938bf88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.750613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d1693-5bc3-47f9-9d07-59f2c938bf88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.752043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d1693-5bc3-47f9-9d07-59f2c938bf88 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.753679 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac22e4-517c-49f5-ad41-6be56cba24fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.754399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac22e4-517c-49f5-ad41-6be56cba24fc None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.754641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac22e4-517c-49f5-ad41-6be56cba24fc None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.754915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac22e4-517c-49f5-ad41-6be56cba24fc None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.755751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac22e4-517c-49f5-ad41-6be56cba24fc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:31.756057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac22e4-517c-49f5-ad41-6be56cba24fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.757459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac22e4-517c-49f5-ad41-6be56cba24fc None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-0d3d1693-5bc3-47f9-9d07-59f2c938bf88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:31.768983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:31.769866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:31.771165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:31.771165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:31.771165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:31.771165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:31.771165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 295/588] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:31.771437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d1693-5bc3-47f9-9d07-59f2c938bf88 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.780061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 294/589] 10.222.0.61 () {56 vars in 1137 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:31.781140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac22e4-517c-49f5-ad41-6be56cba24fc None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.876440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d1693-5bc3-47f9-9d07-59f2c938bf88 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.879526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac22e4-517c-49f5-ad41-6be56cba24fc None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:31.909701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4524f-2d20-4b96-b036-28e930571b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.910546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4524f-2d20-4b96-b036-28e930571b08 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.910834 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4524f-2d20-4b96-b036-28e930571b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.911112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4524f-2d20-4b96-b036-28e930571b08 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.913483 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562509d-8ed1-4218-bb67-4efd4711f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:31.914171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562509d-8ed1-4218-bb67-4efd4711f426 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:31.915090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562509d-8ed1-4218-bb67-4efd4711f426 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:31.915364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562509d-8ed1-4218-bb67-4efd4711f426 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:31.916171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562509d-8ed1-4218-bb67-4efd4711f426 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:31.916480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562509d-8ed1-4218-bb67-4efd4711f426 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.917948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562509d-8ed1-4218-bb67-4efd4711f426 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.921174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4524f-2d20-4b96-b036-28e930571b08 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:31.922663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4524f-2d20-4b96-b036-28e930571b08 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:31.931160 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 295/590] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:31.932001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562509d-8ed1-4218-bb67-4efd4711f426 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-54a4524f-2d20-4b96-b036-28e930571b08 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:31.938441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:31.939360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:31.940301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:31.940301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:31.940301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:31.940301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:31.940301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:31.940301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:31.940301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:31.940301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:31.940301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 14 15:33:31.940301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:31.942597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 296/591] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:31.943490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4524f-2d20-4b96-b036-28e930571b08 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.037207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562509d-8ed1-4218-bb67-4efd4711f426 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.043522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4524f-2d20-4b96-b036-28e930571b08 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.074298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f9c47-b53d-4bfe-b5f2-9f48d75d8a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.075293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f9c47-b53d-4bfe-b5f2-9f48d75d8a8f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.075786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f9c47-b53d-4bfe-b5f2-9f48d75d8a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.076380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f9c47-b53d-4bfe-b5f2-9f48d75d8a8f None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.077535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79061d4-3cb1-4940-8a76-ce95a5a43d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.077662 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f9c47-b53d-4bfe-b5f2-9f48d75d8a8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:32.078029 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f9c47-b53d-4bfe-b5f2-9f48d75d8a8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.078341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79061d4-3cb1-4940-8a76-ce95a5a43d07 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.078628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79061d4-3cb1-4940-8a76-ce95a5a43d07 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.078902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79061d4-3cb1-4940-8a76-ce95a5a43d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.080367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f9c47-b53d-4bfe-b5f2-9f48d75d8a8f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.090586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79061d4-3cb1-4940-8a76-ce95a5a43d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.091960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79061d4-3cb1-4940-8a76-ce95a5a43d07 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.097304 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 296/592] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:32.097304 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f9c47-b53d-4bfe-b5f2-9f48d75d8a8f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-e79061d4-3cb1-4940-8a76-ce95a5a43d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:32.109780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:32.111034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:32.111918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:32.111918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:32.111918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:32.111918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:32.114463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 297/593] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:32.115782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79061d4-3cb1-4940-8a76-ce95a5a43d07 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.198126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f9c47-b53d-4bfe-b5f2-9f48d75d8a8f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.212110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79061d4-3cb1-4940-8a76-ce95a5a43d07 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.231236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835016b2-c407-46b2-befc-3667967f582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.232117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835016b2-c407-46b2-befc-3667967f582d None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.232398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835016b2-c407-46b2-befc-3667967f582d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.232690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835016b2-c407-46b2-befc-3667967f582d None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/ebefa53d595b4e6486ce409f2ac47ff1/roles/28455344d2b44d699796e0163a62e252` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.245132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f01d59-e865-4aac-8f4d-f46d4a7b476a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.245797 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f01d59-e865-4aac-8f4d-f46d4a7b476a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.246086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f01d59-e865-4aac-8f4d-f46d4a7b476a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.246385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f01d59-e865-4aac-8f4d-f46d4a7b476a None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.247221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f01d59-e865-4aac-8f4d-f46d4a7b476a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:32.247455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835016b2-c407-46b2-befc-3667967f582d None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=ebefa53d595b4e6486ce409f2ac47ff1, role_id=28455344d2b44d699796e0163a62e252)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.247555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f01d59-e865-4aac-8f4d-f46d4a7b476a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.248883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835016b2-c407-46b2-befc-3667967f582d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.248983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f01d59-e865-4aac-8f4d-f46d4a7b476a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.263076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 297/594] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:33:32 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/ebefa53d595b4e6486ce409f2ac47ff1/roles/28455344d2b44d699796e0163a62e252 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:32.267521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 298/595] 10.222.0.61 () {56 vars in 1139 bytes} [Sat May 14 15:33:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:32.268807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f01d59-e865-4aac-8f4d-f46d4a7b476a None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.275337 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835016b2-c407-46b2-befc-3667967f582d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.389314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835016b2-c407-46b2-befc-3667967f582d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.396117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f01d59-e865-4aac-8f4d-f46d4a7b476a None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.427610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f74b0b-09f4-4825-b3fe-e38aba57a1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.428602 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f74b0b-09f4-4825-b3fe-e38aba57a1f1 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.429041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f74b0b-09f4-4825-b3fe-e38aba57a1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.429418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f74b0b-09f4-4825-b3fe-e38aba57a1f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.436188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb205e91-d480-4e77-a85d-a5453ca6dcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.437110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205e91-d480-4e77-a85d-a5453ca6dcbb None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.437562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205e91-d480-4e77-a85d-a5453ca6dcbb None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.438001 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205e91-d480-4e77-a85d-a5453ca6dcbb None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.438525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f74b0b-09f4-4825-b3fe-e38aba57a1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.439110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb205e91-d480-4e77-a85d-a5453ca6dcbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:32.439565 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb205e91-d480-4e77-a85d-a5453ca6dcbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.440352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f74b0b-09f4-4825-b3fe-e38aba57a1f1 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.441568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb205e91-d480-4e77-a85d-a5453ca6dcbb None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.454538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 299/596] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:32.455627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb205e91-d480-4e77-a85d-a5453ca6dcbb None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-02f74b0b-09f4-4825-b3fe-e38aba57a1f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:32.456922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:32.457885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:32.458826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:32.458826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:32.458826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:32.458826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:32.458826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:32.458826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:32.458826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:32.458826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:32.459256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 298/597] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:32.460205 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f74b0b-09f4-4825-b3fe-e38aba57a1f1 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.562668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb205e91-d480-4e77-a85d-a5453ca6dcbb None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.569435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f74b0b-09f4-4825-b3fe-e38aba57a1f1 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.596866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f8ff5-9462-4c2b-8149-c8a89509811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.597985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f8ff5-9462-4c2b-8149-c8a89509811b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.598467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f8ff5-9462-4c2b-8149-c8a89509811b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.598947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f8ff5-9462-4c2b-8149-c8a89509811b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.604122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14aa3e3-98cf-40b9-a0a7-bfd7bbc314d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.604920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aa3e3-98cf-40b9-a0a7-bfd7bbc314d8 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.605207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aa3e3-98cf-40b9-a0a7-bfd7bbc314d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.605485 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14aa3e3-98cf-40b9-a0a7-bfd7bbc314d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.612606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14aa3e3-98cf-40b9-a0a7-bfd7bbc314d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.613410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f8ff5-9462-4c2b-8149-c8a89509811b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.614055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14aa3e3-98cf-40b9-a0a7-bfd7bbc314d8 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.615517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f8ff5-9462-4c2b-8149-c8a89509811b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-a14aa3e3-98cf-40b9-a0a7-bfd7bbc314d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:32.630125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:32.631088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:32.631978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:32.631978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:32.631978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:32.631978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:32.631978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:32.631978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:32.631978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:32.631978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:32.631978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 299/598] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:32.632463 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14aa3e3-98cf-40b9-a0a7-bfd7bbc314d8 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-578f8ff5-9462-4c2b-8149-c8a89509811b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:32.637088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:32.637978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:32.638919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:32.638919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:32.638919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:32.638919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:32.641117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 300/599] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:32.642243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f8ff5-9462-4c2b-8149-c8a89509811b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.738268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14aa3e3-98cf-40b9-a0a7-bfd7bbc314d8 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.744037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f8ff5-9462-4c2b-8149-c8a89509811b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.773830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a42d1a-f805-4dfe-b7cf-4302ca3ebd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.774873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a42d1a-f805-4dfe-b7cf-4302ca3ebd2e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.775105 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a42d1a-f805-4dfe-b7cf-4302ca3ebd2e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.775336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a42d1a-f805-4dfe-b7cf-4302ca3ebd2e None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.776127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a42d1a-f805-4dfe-b7cf-4302ca3ebd2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:32.776456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a42d1a-f805-4dfe-b7cf-4302ca3ebd2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.777868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a42d1a-f805-4dfe-b7cf-4302ca3ebd2e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.780700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1a3da-65de-4b14-939c-752f519ecac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.781583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1a3da-65de-4b14-939c-752f519ecac3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.782077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1a3da-65de-4b14-939c-752f519ecac3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.782574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1a3da-65de-4b14-939c-752f519ecac3 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.783558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1a3da-65de-4b14-939c-752f519ecac3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:32.784082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1a3da-65de-4b14-939c-752f519ecac3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.785727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1a3da-65de-4b14-939c-752f519ecac3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.790515 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 300/600] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:32.791364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a42d1a-f805-4dfe-b7cf-4302ca3ebd2e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.799890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 301/601] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:32.800978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1a3da-65de-4b14-939c-752f519ecac3 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.906430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1a3da-65de-4b14-939c-752f519ecac3 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.911636 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a42d1a-f805-4dfe-b7cf-4302ca3ebd2e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:32.941274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402e773-aad6-4091-9f4d-55f9e02a4b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.942653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402e773-aad6-4091-9f4d-55f9e02a4b1a None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.943293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402e773-aad6-4091-9f4d-55f9e02a4b1a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.943874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402e773-aad6-4091-9f4d-55f9e02a4b1a None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/d346be1ef7604f1f87371f5d322fd010/roles/28455344d2b44d699796e0163a62e252` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.946293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2da9b-ce2f-49cd-a2c6-3823614dd8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:32.946986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2da9b-ce2f-49cd-a2c6-3823614dd8f1 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:32.947272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2da9b-ce2f-49cd-a2c6-3823614dd8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:32.947559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2da9b-ce2f-49cd-a2c6-3823614dd8f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:32.948277 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2da9b-ce2f-49cd-a2c6-3823614dd8f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:32.948583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2da9b-ce2f-49cd-a2c6-3823614dd8f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.949962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2da9b-ce2f-49cd-a2c6-3823614dd8f1 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.961749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402e773-aad6-4091-9f4d-55f9e02a4b1a None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=d346be1ef7604f1f87371f5d322fd010, role_id=28455344d2b44d699796e0163a62e252)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:32.963540 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402e773-aad6-4091-9f4d-55f9e02a4b1a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:32.967806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 301/602] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:32.968735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2da9b-ce2f-49cd-a2c6-3823614dd8f1 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:32.978744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 302/603] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:33:32 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/d346be1ef7604f1f87371f5d322fd010/roles/28455344d2b44d699796e0163a62e252 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:32.984790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402e773-aad6-4091-9f4d-55f9e02a4b1a None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:33.082524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2da9b-ce2f-49cd-a2c6-3823614dd8f1 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:33.125804 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402e773-aad6-4091-9f4d-55f9e02a4b1a None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:33.129957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c97b77-fd89-498d-a5dc-8c065ba17272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:33.130949 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c97b77-fd89-498d-a5dc-8c065ba17272 None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:33.131229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c97b77-fd89-498d-a5dc-8c065ba17272 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:33.131501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c97b77-fd89-498d-a5dc-8c065ba17272 None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/b9b7a0202f394b16800af94487a21ef0/roles/28455344d2b44d699796e0163a62e252` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:33.150534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c97b77-fd89-498d-a5dc-8c065ba17272 None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=b9b7a0202f394b16800af94487a21ef0, role_id=28455344d2b44d699796e0163a62e252)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:33.151992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c97b77-fd89-498d-a5dc-8c065ba17272 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:33.170813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 302/604] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:33:32 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/b9b7a0202f394b16800af94487a21ef0/roles/28455344d2b44d699796e0163a62e252 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:33.171119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40abd99-9095-4e04-ae6d-12c274ce7f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:33.171864 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2217173-c2e4-4e03-9d99-33d79882ec43 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:33.172048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40abd99-9095-4e04-ae6d-12c274ce7f17 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:33.172145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2217173-c2e4-4e03-9d99-33d79882ec43 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:33.172332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40abd99-9095-4e04-ae6d-12c274ce7f17 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:33.172488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2217173-c2e4-4e03-9d99-33d79882ec43 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:33.172652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40abd99-9095-4e04-ae6d-12c274ce7f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:33.174026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 303/605] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:33.181738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440d844-9cc1-4dcf-9625-576242bbad96 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:33.182078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440d844-9cc1-4dcf-9625-576242bbad96 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:33.182283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440d844-9cc1-4dcf-9625-576242bbad96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:33.194979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40abd99-9095-4e04-ae6d-12c274ce7f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:33.196695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40abd99-9095-4e04-ae6d-12c274ce7f17 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f40abd99-9095-4e04-ae6d-12c274ce7f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:33.219555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:33.220521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:33.221465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:33.221465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:33.221465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:33.221465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:33.221465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:33.221465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:33.221465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:33.221465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:33.221465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 303/606] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:33.226124 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-0440d844-9cc1-4dcf-9625-576242bbad96 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:33.228353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40abd99-9095-4e04-ae6d-12c274ce7f17 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:33.228733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-0440d844-9cc1-4dcf-9625-576242bbad96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:33.317383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 304/607] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:33.351393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40abd99-9095-4e04-ae6d-12c274ce7f17 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:33.356045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440d844-9cc1-4dcf-9625-576242bbad96 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:33.406853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fc1b0-3faa-40f1-b69e-8e9815ddbfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:33.407533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc1b0-3faa-40f1-b69e-8e9815ddbfac None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:33.407815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc1b0-3faa-40f1-b69e-8e9815ddbfac None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:33.408085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fc1b0-3faa-40f1-b69e-8e9815ddbfac None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:33.408889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fc1b0-3faa-40f1-b69e-8e9815ddbfac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:33.409496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fc1b0-3faa-40f1-b69e-8e9815ddbfac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:33.411239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fc1b0-3faa-40f1-b69e-8e9815ddbfac None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:33.427931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 304/608] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:33.434247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fc1b0-3faa-40f1-b69e-8e9815ddbfac None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:33.480123 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440d844-9cc1-4dcf-9625-576242bbad96 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:33.518933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730f189-ac71-4ec2-b7ff-282ab6b0331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:33.519739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730f189-ac71-4ec2-b7ff-282ab6b0331a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:33.520015 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730f189-ac71-4ec2-b7ff-282ab6b0331a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:33.520282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730f189-ac71-4ec2-b7ff-282ab6b0331a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:33.535719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730f189-ac71-4ec2-b7ff-282ab6b0331a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-3730f189-ac71-4ec2-b7ff-282ab6b0331a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:33.546014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:33.546993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:33.547831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:33.554627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 305/609] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:33.557110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730f189-ac71-4ec2-b7ff-282ab6b0331a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:33.557774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fc1b0-3faa-40f1-b69e-8e9815ddbfac None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:33.600351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1dac6-7e4f-4f69-8f0b-05d4234d73c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:33.601261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1dac6-7e4f-4f69-8f0b-05d4234d73c4 None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:33.602177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1dac6-7e4f-4f69-8f0b-05d4234d73c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:33.602731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1dac6-7e4f-4f69-8f0b-05d4234d73c4 None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/abfc1e35362a4495a05475878db260f2/roles/28455344d2b44d699796e0163a62e252` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:33.622827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1dac6-7e4f-4f69-8f0b-05d4234d73c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=abfc1e35362a4495a05475878db260f2, role_id=28455344d2b44d699796e0163a62e252)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:33.624594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1dac6-7e4f-4f69-8f0b-05d4234d73c4 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:33.652360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 305/610] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:33:33 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/abfc1e35362a4495a05475878db260f2/roles/28455344d2b44d699796e0163a62e252 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:33:33.672716 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730f189-ac71-4ec2-b7ff-282ab6b0331a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:33.709885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c2521-5cfb-4938-8427-b8a308b7eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:33.711002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c2521-5cfb-4938-8427-b8a308b7eb71 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:33.712103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c2521-5cfb-4938-8427-b8a308b7eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:33.712573 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c2521-5cfb-4938-8427-b8a308b7eb71 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:33.713546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c2521-5cfb-4938-8427-b8a308b7eb71 None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:33.714071 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c2521-5cfb-4938-8427-b8a308b7eb71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:33.715804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c2521-5cfb-4938-8427-b8a308b7eb71 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:33.730283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 306/611] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:33.732106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1dac6-7e4f-4f69-8f0b-05d4234d73c4 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:33.894710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1dac6-7e4f-4f69-8f0b-05d4234d73c4 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:33.930988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9daf-5bf7-427f-aeca-39db8189bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:33.931775 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9daf-5bf7-427f-aeca-39db8189bcea None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:33.932049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9daf-5bf7-427f-aeca-39db8189bcea None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:33.932315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9daf-5bf7-427f-aeca-39db8189bcea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:33.943045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c9daf-5bf7-427f-aeca-39db8189bcea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:33.944483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c9daf-5bf7-427f-aeca-39db8189bcea None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-9e9c9daf-5bf7-427f-aeca-39db8189bcea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:33.962568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:33.963457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:33.964567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:33.964567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:33.964567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:33.964567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:33.964567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 306/612] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:33.971346 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c2521-5cfb-4938-8427-b8a308b7eb71 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:34.083555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c2521-5cfb-4938-8427-b8a308b7eb71 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:34.118250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19420a05-f008-4cab-a1f0-0fe1ce7ac269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:34.119391 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420a05-f008-4cab-a1f0-0fe1ce7ac269 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:34.119930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420a05-f008-4cab-a1f0-0fe1ce7ac269 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:34.120404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19420a05-f008-4cab-a1f0-0fe1ce7ac269 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:34.121329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19420a05-f008-4cab-a1f0-0fe1ce7ac269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:34.121833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19420a05-f008-4cab-a1f0-0fe1ce7ac269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:34.123473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19420a05-f008-4cab-a1f0-0fe1ce7ac269 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:34.141265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 307/613] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:34.143376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9daf-5bf7-427f-aeca-39db8189bcea None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:34.285121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9daf-5bf7-427f-aeca-39db8189bcea None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:34.323960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222712ab-d369-427c-96e1-ba690d0136ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:34.324854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222712ab-d369-427c-96e1-ba690d0136ba None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:34.325139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222712ab-d369-427c-96e1-ba690d0136ba None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:34.325413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222712ab-d369-427c-96e1-ba690d0136ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:34.333058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222712ab-d369-427c-96e1-ba690d0136ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:34.337384 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222712ab-d369-427c-96e1-ba690d0136ba None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-222712ab-d369-427c-96e1-ba690d0136ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:34.358538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:34.359531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:34.360886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:34.360886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:34.360886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:34.360886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:34.360886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:34.360886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:34.360886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:34.360886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:34.360886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:34.360886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:34.360886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 307/614] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:34.368392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19420a05-f008-4cab-a1f0-0fe1ce7ac269 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:34.535864 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19420a05-f008-4cab-a1f0-0fe1ce7ac269 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:34.583038 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e2f3-1d21-427f-8aeb-da15d173d45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:34.583723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e2f3-1d21-427f-8aeb-da15d173d45a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:34.584009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e2f3-1d21-427f-8aeb-da15d173d45a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:34.584283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e2f3-1d21-427f-8aeb-da15d173d45a None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:34.585124 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e2f3-1d21-427f-8aeb-da15d173d45a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:34.585429 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e2f3-1d21-427f-8aeb-da15d173d45a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:34.587836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e2f3-1d21-427f-8aeb-da15d173d45a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:34.609760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 308/615] 10.222.0.61 () {56 vars in 1135 bytes} [Sat May 14 15:33:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:34.615277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222712ab-d369-427c-96e1-ba690d0136ba None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:34.694401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0f9e1-bf57-432e-b048-a94ad288bc3c None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:34.695899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0f9e1-bf57-432e-b048-a94ad288bc3c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:34.696464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0f9e1-bf57-432e-b048-a94ad288bc3c None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:34.699623 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 309/616] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:34.703962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f602-a5f0-4cba-8ce3-649cc1895883 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:34.704506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f602-a5f0-4cba-8ce3-649cc1895883 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:34.704996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097f602-a5f0-4cba-8ce3-649cc1895883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:34.721891 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-3097f602-a5f0-4cba-8ce3-649cc1895883 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:34.723610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3097f602-a5f0-4cba-8ce3-649cc1895883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:34.746025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222712ab-d369-427c-96e1-ba690d0136ba None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:34.788731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80ebfe-fceb-4447-a2fa-478a083f1639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:34.791616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ebfe-fceb-4447-a2fa-478a083f1639 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:34.792125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ebfe-fceb-4447-a2fa-478a083f1639 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:34.793554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80ebfe-fceb-4447-a2fa-478a083f1639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:34.811620 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80ebfe-fceb-4447-a2fa-478a083f1639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:34.813092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80ebfe-fceb-4447-a2fa-478a083f1639 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:34.815356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 310/617] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-df80ebfe-fceb-4447-a2fa-478a083f1639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:34.841555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:34.842518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:34.843869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:34.843869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:34.843869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:34.843869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:34.843869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 308/618] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:34.849903 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097f602-a5f0-4cba-8ce3-649cc1895883 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:34.880643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80ebfe-fceb-4447-a2fa-478a083f1639 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:35.017041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097f602-a5f0-4cba-8ce3-649cc1895883 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:35.033514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80ebfe-fceb-4447-a2fa-478a083f1639 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:35.075245 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff9bea-06c9-49c5-8388-3186e6b53014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:35.076046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff9bea-06c9-49c5-8388-3186e6b53014 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:35.076327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff9bea-06c9-49c5-8388-3186e6b53014 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:35.076600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff9bea-06c9-49c5-8388-3186e6b53014 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:35.091482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e9e9-404f-4e2e-9fa4-f59944078ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:35.092180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e9e9-404f-4e2e-9fa4-f59944078ca5 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:35.092462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e9e9-404f-4e2e-9fa4-f59944078ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:35.092736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8e9e9-404f-4e2e-9fa4-f59944078ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:35.093479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e9e9-404f-4e2e-9fa4-f59944078ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:35.093783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e9e9-404f-4e2e-9fa4-f59944078ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:35.095232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8e9e9-404f-4e2e-9fa4-f59944078ca5 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:35.103122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff9bea-06c9-49c5-8388-3186e6b53014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-abff9bea-06c9-49c5-8388-3186e6b53014 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:35.110756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:35.113288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:35.115243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 309/619] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:35.122910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 311/620] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:35.123820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff9bea-06c9-49c5-8388-3186e6b53014 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:35.131242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e9e9-404f-4e2e-9fa4-f59944078ca5 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:35.228644 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff9bea-06c9-49c5-8388-3186e6b53014 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:35.274608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8e9e9-404f-4e2e-9fa4-f59944078ca5 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:35.276444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d003ffc-7304-4374-80d0-a30229bdbe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:35.277123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d003ffc-7304-4374-80d0-a30229bdbe8f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:35.277404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d003ffc-7304-4374-80d0-a30229bdbe8f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:35.277678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d003ffc-7304-4374-80d0-a30229bdbe8f None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:35.278471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d003ffc-7304-4374-80d0-a30229bdbe8f None admin] RBAC: Adding query filter params (name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:35.278774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d003ffc-7304-4374-80d0-a30229bdbe8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:35.280149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d003ffc-7304-4374-80d0-a30229bdbe8f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:35.300799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 310/621] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:35.306705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d003ffc-7304-4374-80d0-a30229bdbe8f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:35.319432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0293d-6b68-461c-af58-77807eb1c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:35.320231 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0293d-6b68-461c-af58-77807eb1c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:35.320561 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0293d-6b68-461c-af58-77807eb1c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:35.320838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0293d-6b68-461c-af58-77807eb1c5c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:35.331674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0293d-6b68-461c-af58-77807eb1c5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:35.333073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0293d-6b68-461c-af58-77807eb1c5c4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-7aa0293d-6b68-461c-af58-77807eb1c5c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:35.352814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:35.353723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:35.356116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:35.356116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:35.356116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:35.356116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:35.356116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:35.356116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:35.356116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:35.356116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:35.356116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 312/622] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:35.366563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0293d-6b68-461c-af58-77807eb1c5c4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:35.479745 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0293d-6b68-461c-af58-77807eb1c5c4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:35.513888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d003ffc-7304-4374-80d0-a30229bdbe8f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:35.520392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a227d6-1539-4380-a632-53e098d93056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:35.521150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a227d6-1539-4380-a632-53e098d93056 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:35.521477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a227d6-1539-4380-a632-53e098d93056 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:35.521756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a227d6-1539-4380-a632-53e098d93056 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:35.522578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a227d6-1539-4380-a632-53e098d93056 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:35.522937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a227d6-1539-4380-a632-53e098d93056 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:35.525587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a227d6-1539-4380-a632-53e098d93056 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:35.538443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 313/623] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:35.547267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a227d6-1539-4380-a632-53e098d93056 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:35.565626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dce2a2-23c2-47c9-8587-f56bde9a5486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:35.566454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce2a2-23c2-47c9-8587-f56bde9a5486 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:35.566740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce2a2-23c2-47c9-8587-f56bde9a5486 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:35.567015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dce2a2-23c2-47c9-8587-f56bde9a5486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:35.594678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dce2a2-23c2-47c9-8587-f56bde9a5486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:35.596053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dce2a2-23c2-47c9-8587-f56bde9a5486 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-b2dce2a2-23c2-47c9-8587-f56bde9a5486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:35.628491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:35.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:35.630950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:35.630950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:35.630950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:35.630950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:35.630950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 311/624] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:35.638249 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dce2a2-23c2-47c9-8587-f56bde9a5486 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:35.694747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a227d6-1539-4380-a632-53e098d93056 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:35.731965 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e39ea-4990-421e-b978-d834ef18708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:35.732855 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e39ea-4990-421e-b978-d834ef18708f None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:35.733138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e39ea-4990-421e-b978-d834ef18708f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:35.733410 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e39ea-4990-421e-b978-d834ef18708f None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/1713718ff95744b9bd42f21d4ec8bb91/roles/28455344d2b44d699796e0163a62e252` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:35.762037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e39ea-4990-421e-b978-d834ef18708f None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=1713718ff95744b9bd42f21d4ec8bb91, role_id=28455344d2b44d699796e0163a62e252)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:35.763516 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e39ea-4990-421e-b978-d834ef18708f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:35.792913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 314/625] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:33:35 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/1713718ff95744b9bd42f21d4ec8bb91/roles/28455344d2b44d699796e0163a62e252 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:35.807502 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dce2a2-23c2-47c9-8587-f56bde9a5486 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:35.879007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca9423-0584-41ca-a26b-8b09738dd358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:35.880023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca9423-0584-41ca-a26b-8b09738dd358 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:35.880570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca9423-0584-41ca-a26b-8b09738dd358 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:35.881036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca9423-0584-41ca-a26b-8b09738dd358 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:35.881981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca9423-0584-41ca-a26b-8b09738dd358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:35.882573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca9423-0584-41ca-a26b-8b09738dd358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:35.884278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca9423-0584-41ca-a26b-8b09738dd358 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:35.903486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 312/626] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:35.909514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e39ea-4990-421e-b978-d834ef18708f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:36.026266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e39ea-4990-421e-b978-d834ef18708f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:36.063989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645edda1-40f1-49e8-a3c7-6dcdc5b2d9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:36.065256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645edda1-40f1-49e8-a3c7-6dcdc5b2d9be None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.065763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645edda1-40f1-49e8-a3c7-6dcdc5b2d9be None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.066241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645edda1-40f1-49e8-a3c7-6dcdc5b2d9be None admin] PATH_INFO: `/v3/users/nova` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.074797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645edda1-40f1-49e8-a3c7-6dcdc5b2d9be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:36.076497 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645edda1-40f1-49e8-a3c7-6dcdc5b2d9be None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-645edda1-40f1-49e8-a3c7-6dcdc5b2d9be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:36.095061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:36.096037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:36.096974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:36.096974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:36.096974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:36.096974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:36.096974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:36.096974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:36.096974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:36.096974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:36.096974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:36.096974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:36.096974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 315/627] 10.222.0.61 () {56 vars in 1093 bytes} [Sat May 14 15:33:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:36.102930 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca9423-0584-41ca-a26b-8b09738dd358 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:36.145314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6efb41-9130-493e-a93b-93523eb0a994 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.145605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6efb41-9130-493e-a93b-93523eb0a994 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.145792 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6efb41-9130-493e-a93b-93523eb0a994 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.147449 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 316/628] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:33:36.154344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b5374-cd8e-4a30-bfa8-b85cefcb0a94 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.154344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b5374-cd8e-4a30-bfa8-b85cefcb0a94 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.154344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b5374-cd8e-4a30-bfa8-b85cefcb0a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.172011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-232b5374-cd8e-4a30-bfa8-b85cefcb0a94 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:36.173441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-232b5374-cd8e-4a30-bfa8-b85cefcb0a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:36.257077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca9423-0584-41ca-a26b-8b09738dd358 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:36.262674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 317/629] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:36.262674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c5572-2b72-4543-a9af-f1dc1429993f None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.262674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c5572-2b72-4543-a9af-f1dc1429993f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.262674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c5572-2b72-4543-a9af-f1dc1429993f None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.262674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 318/630] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:36.268122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c2ef-d4dd-476a-a2ee-881ec0e4f0b1 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.268122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c2ef-d4dd-476a-a2ee-881ec0e4f0b1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.268421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c2ef-d4dd-476a-a2ee-881ec0e4f0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.285392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7390c2ef-d4dd-476a-a2ee-881ec0e4f0b1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:36.286477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7390c2ef-d4dd-476a-a2ee-881ec0e4f0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:36.314681 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df0d8f-4177-472d-bfa0-4bd49f5a4197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:36.315354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df0d8f-4177-472d-bfa0-4bd49f5a4197 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.315636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df0d8f-4177-472d-bfa0-4bd49f5a4197 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.315911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df0d8f-4177-472d-bfa0-4bd49f5a4197 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.316751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df0d8f-4177-472d-bfa0-4bd49f5a4197 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:36.317060 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df0d8f-4177-472d-bfa0-4bd49f5a4197 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:36.318597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df0d8f-4177-472d-bfa0-4bd49f5a4197 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:36.337829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 313/631] 10.222.0.61 () {56 vars in 1133 bytes} [Sat May 14 15:33:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:36.338455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df0d8f-4177-472d-bfa0-4bd49f5a4197 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:36.363917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 319/632] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:36.365108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390c2ef-d4dd-476a-a2ee-881ec0e4f0b1 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:36.442856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df0d8f-4177-472d-bfa0-4bd49f5a4197 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:36.466128 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390c2ef-d4dd-476a-a2ee-881ec0e4f0b1 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:36.478772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf7d88-0a36-47d3-bcd7-3779def69850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:36.479615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf7d88-0a36-47d3-bcd7-3779def69850 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.479940 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf7d88-0a36-47d3-bcd7-3779def69850 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.480220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf7d88-0a36-47d3-bcd7-3779def69850 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.492169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf7d88-0a36-47d3-bcd7-3779def69850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-fadf7d88-0a36-47d3-bcd7-3779def69850 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:36.499918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:36.500837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:36.501714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 314/633] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:36.503003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6e84-3991-43e9-bf74-f9414cc4ce5a None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.503003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6e84-3991-43e9-bf74-f9414cc4ce5a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.503003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6e84-3991-43e9-bf74-f9414cc4ce5a None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.506414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 315/634] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:36.506414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6e84-3991-43e9-bf74-f9414cc4ce5a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:36.507338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c26c89-511b-4a41-b37f-6a9c0e5c5230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:36.508136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c26c89-511b-4a41-b37f-6a9c0e5c5230 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.508742 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c26c89-511b-4a41-b37f-6a9c0e5c5230 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.508892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c26c89-511b-4a41-b37f-6a9c0e5c5230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.577379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c26c89-511b-4a41-b37f-6a9c0e5c5230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:36.578907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c26c89-511b-4a41-b37f-6a9c0e5c5230 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:36.607121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6e84-3991-43e9-bf74-f9414cc4ce5a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:36.640714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a9de3-6061-4139-b8b6-6a651b19aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:36.641552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a9de3-6061-4139-b8b6-6a651b19aaf5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.641841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a9de3-6061-4139-b8b6-6a651b19aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.642124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a9de3-6061-4139-b8b6-6a651b19aaf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.653309 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a9de3-6061-4139-b8b6-6a651b19aaf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-e47a9de3-6061-4139-b8b6-6a651b19aaf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:36.660983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:36.661895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 316/635] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:36.663005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a9de3-6061-4139-b8b6-6a651b19aaf5 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:36.687504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 320/636] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:36.688808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4262fb-63c2-42d1-8f22-fd2dc394c5cc None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.689096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4262fb-63c2-42d1-8f22-fd2dc394c5cc None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.689374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4262fb-63c2-42d1-8f22-fd2dc394c5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.705690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7c4262fb-63c2-42d1-8f22-fd2dc394c5cc None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:36.706835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7c4262fb-63c2-42d1-8f22-fd2dc394c5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:36.767146 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a9de3-6061-4139-b8b6-6a651b19aaf5 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:36.782334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 321/637] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:36.782334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4262fb-63c2-42d1-8f22-fd2dc394c5cc None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:36.802466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1605b-d7b1-4553-8a39-b456dede09fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:36.803191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1605b-d7b1-4553-8a39-b456dede09fd None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.803468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1605b-d7b1-4553-8a39-b456dede09fd None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.803773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1605b-d7b1-4553-8a39-b456dede09fd None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.804522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1605b-d7b1-4553-8a39-b456dede09fd None admin] RBAC: Adding query filter params (name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:36.804856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1605b-d7b1-4553-8a39-b456dede09fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:36.806336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1605b-d7b1-4553-8a39-b456dede09fd None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:36.814449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 317/638] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:36.818989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1605b-d7b1-4553-8a39-b456dede09fd None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:36.891860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4262fb-63c2-42d1-8f22-fd2dc394c5cc None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:36.919762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1605b-d7b1-4553-8a39-b456dede09fd None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:36.924588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e04091-691d-4111-82d1-90d70b601123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:36.925365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04091-691d-4111-82d1-90d70b601123 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.925772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04091-691d-4111-82d1-90d70b601123 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.926161 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e04091-691d-4111-82d1-90d70b601123 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.927039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e04091-691d-4111-82d1-90d70b601123 None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:36.927442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e04091-691d-4111-82d1-90d70b601123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:36.928892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e04091-691d-4111-82d1-90d70b601123 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:36.937073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 322/639] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:36.941996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e04091-691d-4111-82d1-90d70b601123 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:36.954873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7d347-48d9-4580-b100-a512f30770d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:36.956015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d347-48d9-4580-b100-a512f30770d7 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:36.956649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d347-48d9-4580-b100-a512f30770d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:36.957066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7d347-48d9-4580-b100-a512f30770d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:36.968267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7d347-48d9-4580-b100-a512f30770d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:36.969851 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7d347-48d9-4580-b100-a512f30770d7 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-74b7d347-48d9-4580-b100-a512f30770d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:36.987329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:36.988599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:36.989670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:36.989670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:36.989670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:36.989670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:36.991583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 318/640] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:36.992581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7d347-48d9-4580-b100-a512f30770d7 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:37.043509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e04091-691d-4111-82d1-90d70b601123 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.076564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194471d5-1d3c-4e8e-a3d0-35edc36dc43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.077451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194471d5-1d3c-4e8e-a3d0-35edc36dc43f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.077742 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194471d5-1d3c-4e8e-a3d0-35edc36dc43f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.078020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194471d5-1d3c-4e8e-a3d0-35edc36dc43f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.088087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194471d5-1d3c-4e8e-a3d0-35edc36dc43f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:37.090057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7d347-48d9-4580-b100-a512f30770d7 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-194471d5-1d3c-4e8e-a3d0-35edc36dc43f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:37.095971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:37.097151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:37.098175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:37.102995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 323/641] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:37.104199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194471d5-1d3c-4e8e-a3d0-35edc36dc43f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:37.130359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57ca62-b5c0-4cf8-940d-1407c77d4d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.131422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57ca62-b5c0-4cf8-940d-1407c77d4d6e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.131943 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57ca62-b5c0-4cf8-940d-1407c77d4d6e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.132052 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57ca62-b5c0-4cf8-940d-1407c77d4d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.142568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57ca62-b5c0-4cf8-940d-1407c77d4d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:37.144058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57ca62-b5c0-4cf8-940d-1407c77d4d6e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-dd57ca62-b5c0-4cf8-940d-1407c77d4d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:37.161382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:37.162405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:37.163424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:37.163424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:37.163424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:37.163424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:37.163424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 319/642] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:37.163424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57ca62-b5c0-4cf8-940d-1407c77d4d6e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:37.206866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194471d5-1d3c-4e8e-a3d0-35edc36dc43f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.240457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5f139-978e-4091-94df-6d831ae3fb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.241254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f139-978e-4091-94df-6d831ae3fb9b None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.241542 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f139-978e-4091-94df-6d831ae3fb9b None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.241820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f139-978e-4091-94df-6d831ae3fb9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.253545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5f139-978e-4091-94df-6d831ae3fb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:37.255037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5f139-978e-4091-94df-6d831ae3fb9b None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:37.263037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57ca62-b5c0-4cf8-940d-1407c77d4d6e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-02b5f139-978e-4091-94df-6d831ae3fb9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:37.271874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:37.272754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:37.279241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:37.279241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:37.279241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:37.279241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:37.279241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 324/643] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:37.279241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5f139-978e-4091-94df-6d831ae3fb9b None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:37.295664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d85c8-6786-4e23-9b6e-328ba0a05da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.296326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d85c8-6786-4e23-9b6e-328ba0a05da0 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.296605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d85c8-6786-4e23-9b6e-328ba0a05da0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.296878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d85c8-6786-4e23-9b6e-328ba0a05da0 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.301607 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d85c8-6786-4e23-9b6e-328ba0a05da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:37.301931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d85c8-6786-4e23-9b6e-328ba0a05da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:37.303343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d85c8-6786-4e23-9b6e-328ba0a05da0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:37.319860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 320/644] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:37.319860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d85c8-6786-4e23-9b6e-328ba0a05da0 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:37.379320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5f139-978e-4091-94df-6d831ae3fb9b None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.411291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d85c8-6786-4e23-9b6e-328ba0a05da0 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.412385 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3782eaa-c8c1-4e5e-bc1a-1db95ea4c0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.413040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3782eaa-c8c1-4e5e-bc1a-1db95ea4c0a2 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.413320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3782eaa-c8c1-4e5e-bc1a-1db95ea4c0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.413598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3782eaa-c8c1-4e5e-bc1a-1db95ea4c0a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.414923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3782eaa-c8c1-4e5e-bc1a-1db95ea4c0a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:37.415353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3782eaa-c8c1-4e5e-bc1a-1db95ea4c0a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:37.416712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3782eaa-c8c1-4e5e-bc1a-1db95ea4c0a2 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:37.425118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 325/645] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:37.425899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3782eaa-c8c1-4e5e-bc1a-1db95ea4c0a2 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:37.450124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40794e5c-adeb-47d3-b434-a74811a25c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.450822 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794e5c-adeb-47d3-b434-a74811a25c61 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.451106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794e5c-adeb-47d3-b434-a74811a25c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.451380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40794e5c-adeb-47d3-b434-a74811a25c61 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.452107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40794e5c-adeb-47d3-b434-a74811a25c61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:37.452412 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40794e5c-adeb-47d3-b434-a74811a25c61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:37.453764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40794e5c-adeb-47d3-b434-a74811a25c61 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:37.469632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 321/646] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:37.469632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40794e5c-adeb-47d3-b434-a74811a25c61 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:37.526634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3782eaa-c8c1-4e5e-bc1a-1db95ea4c0a2 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.560762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7834257-5225-476b-9474-5a40cddddaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.561432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7834257-5225-476b-9474-5a40cddddaa8 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.561710 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7834257-5225-476b-9474-5a40cddddaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.561991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7834257-5225-476b-9474-5a40cddddaa8 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.562752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7834257-5225-476b-9474-5a40cddddaa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:37.563055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7834257-5225-476b-9474-5a40cddddaa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:37.564417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7834257-5225-476b-9474-5a40cddddaa8 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:37.567726 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40794e5c-adeb-47d3-b434-a74811a25c61 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.576904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 326/647] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:37.577089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7834257-5225-476b-9474-5a40cddddaa8 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:37.605406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c274967-5723-42a7-beff-64fb56805d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.606192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c274967-5723-42a7-beff-64fb56805d20 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.606547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c274967-5723-42a7-beff-64fb56805d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.606828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c274967-5723-42a7-beff-64fb56805d20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.613298 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c274967-5723-42a7-beff-64fb56805d20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:37.614785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c274967-5723-42a7-beff-64fb56805d20 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-3c274967-5723-42a7-beff-64fb56805d20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:37.629305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:37.630233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:37.631185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:37.631185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:37.631185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:37.631185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:37.631185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:37.631185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:37.631185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:37.631185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:37.631185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 322/648] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:37.631682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c274967-5723-42a7-beff-64fb56805d20 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:37.678184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7834257-5225-476b-9474-5a40cddddaa8 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.712470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb773e-d2f7-4043-ba54-e8940ae2b21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.713408 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb773e-d2f7-4043-ba54-e8940ae2b21f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.713693 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb773e-d2f7-4043-ba54-e8940ae2b21f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.713970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb773e-d2f7-4043-ba54-e8940ae2b21f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.723959 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb773e-d2f7-4043-ba54-e8940ae2b21f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:37.725326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb773e-d2f7-4043-ba54-e8940ae2b21f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:37.732165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c274967-5723-42a7-beff-64fb56805d20 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-6cdb773e-d2f7-4043-ba54-e8940ae2b21f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:37.743637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:37.744724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:37.745620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:37.745620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:37.745620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:37.745620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:37.745620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 327/649] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:37.745620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb773e-d2f7-4043-ba54-e8940ae2b21f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:37.771942 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456a2cd-a851-48ca-8725-d08a317a7386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.772737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456a2cd-a851-48ca-8725-d08a317a7386 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.773022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456a2cd-a851-48ca-8725-d08a317a7386 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.773293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456a2cd-a851-48ca-8725-d08a317a7386 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.780394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456a2cd-a851-48ca-8725-d08a317a7386 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:37.781899 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456a2cd-a851-48ca-8725-d08a317a7386 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-9456a2cd-a851-48ca-8725-d08a317a7386 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:37.800754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:37.801746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:37.802728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:37.802728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:37.802728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:37.802728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:37.802728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:37.802728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:37.802728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:37.802728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:37.802728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 14 15:33:37.802728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:37.807847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 323/650] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:37.808478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456a2cd-a851-48ca-8725-d08a317a7386 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:37.849309 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb773e-d2f7-4043-ba54-e8940ae2b21f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.884940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eeb00-909e-4154-9aaf-284d0ad63ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.885738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eeb00-909e-4154-9aaf-284d0ad63ed6 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.886021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eeb00-909e-4154-9aaf-284d0ad63ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.886293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eeb00-909e-4154-9aaf-284d0ad63ed6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.893265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eeb00-909e-4154-9aaf-284d0ad63ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:37.894757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eeb00-909e-4154-9aaf-284d0ad63ed6 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:37.906828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456a2cd-a851-48ca-8725-d08a317a7386 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:37.943426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf3f00-6779-4cc8-bcf5-393e1aca73be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:37.944101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf3f00-6779-4cc8-bcf5-393e1aca73be None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:37.944382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf3f00-6779-4cc8-bcf5-393e1aca73be None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:37.944654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf3f00-6779-4cc8-bcf5-393e1aca73be None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:37.945528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf3f00-6779-4cc8-bcf5-393e1aca73be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:37.946005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf3f00-6779-4cc8-bcf5-393e1aca73be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:37.947552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf3f00-6779-4cc8-bcf5-393e1aca73be None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:37.965712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 324/651] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:37.965712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf3f00-6779-4cc8-bcf5-393e1aca73be None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-a32eeb00-909e-4154-9aaf-284d0ad63ed6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:38.028691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:38.029676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 328/652] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:38.035489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eeb00-909e-4154-9aaf-284d0ad63ed6 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:38.070777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf3f00-6779-4cc8-bcf5-393e1aca73be None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:38.104616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e677a80-75f1-4be1-96fe-d493108952ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:38.105271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e677a80-75f1-4be1-96fe-d493108952ac None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.105549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e677a80-75f1-4be1-96fe-d493108952ac None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.105819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e677a80-75f1-4be1-96fe-d493108952ac None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.106569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e677a80-75f1-4be1-96fe-d493108952ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:38.106871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e677a80-75f1-4be1-96fe-d493108952ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:38.108230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e677a80-75f1-4be1-96fe-d493108952ac None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:38.120520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 325/653] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:38.121329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e677a80-75f1-4be1-96fe-d493108952ac None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:38.141441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eeb00-909e-4154-9aaf-284d0ad63ed6 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:38.174545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf294d-27ea-4bdf-ba9c-dceee7e31e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:38.175216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf294d-27ea-4bdf-ba9c-dceee7e31e51 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.175500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf294d-27ea-4bdf-ba9c-dceee7e31e51 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.175780 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf294d-27ea-4bdf-ba9c-dceee7e31e51 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.176615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf294d-27ea-4bdf-ba9c-dceee7e31e51 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:38.176920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf294d-27ea-4bdf-ba9c-dceee7e31e51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:38.178410 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf294d-27ea-4bdf-ba9c-dceee7e31e51 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:38.200625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 329/654] 10.222.0.61 () {56 vars in 1137 bytes} [Sat May 14 15:33:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:38.200625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf294d-27ea-4bdf-ba9c-dceee7e31e51 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:38.215725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e677a80-75f1-4be1-96fe-d493108952ac None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:38.248586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0a301-463e-4638-a311-c574e94f973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:38.249231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0a301-463e-4638-a311-c574e94f973b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.249508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0a301-463e-4638-a311-c574e94f973b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.249779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0a301-463e-4638-a311-c574e94f973b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.250649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0a301-463e-4638-a311-c574e94f973b None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=ebefa53d595b4e6486ce409f2ac47ff1) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:38.250959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0a301-463e-4638-a311-c574e94f973b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:38.252372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b0a301-463e-4638-a311-c574e94f973b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:38.258428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 326/655] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:38 2022] GET /identity/v3/role_assignments?user.id=ebefa53d595b4e6486ce409f2ac47ff1&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:38.259444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0a301-463e-4638-a311-c574e94f973b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:38.298921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf294d-27ea-4bdf-ba9c-dceee7e31e51 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:38.334188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af395fc4-6322-4be9-920b-79b12d485a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:38.334907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af395fc4-6322-4be9-920b-79b12d485a4d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.335192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af395fc4-6322-4be9-920b-79b12d485a4d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.335469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af395fc4-6322-4be9-920b-79b12d485a4d None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.336389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af395fc4-6322-4be9-920b-79b12d485a4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:38.336707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af395fc4-6322-4be9-920b-79b12d485a4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:38.338191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af395fc4-6322-4be9-920b-79b12d485a4d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:38.357288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 330/656] 10.222.0.61 () {56 vars in 1137 bytes} [Sat May 14 15:33:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:38.358165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af395fc4-6322-4be9-920b-79b12d485a4d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:38.362937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0a301-463e-4638-a311-c574e94f973b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:38.398513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dfe81-64eb-4693-bea1-24e6d490b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:38.399458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dfe81-64eb-4693-bea1-24e6d490b28d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.399665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dfe81-64eb-4693-bea1-24e6d490b28d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.399969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dfe81-64eb-4693-bea1-24e6d490b28d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.407855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dfe81-64eb-4693-bea1-24e6d490b28d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:38.409320 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dfe81-64eb-4693-bea1-24e6d490b28d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-bc2dfe81-64eb-4693-bea1-24e6d490b28d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:38.424831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:38.425862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:38.426878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:38.426878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:38.426878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:38.426878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:38.426878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:38.426878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:38.426878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:38.426878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:38.426878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 14 15:33:38.426878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:38.426878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 327/657] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:38.427468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322be186-3bdd-4e1f-b6e7-4587ea71ffd0 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.428084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322be186-3bdd-4e1f-b6e7-4587ea71ffd0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.428084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322be186-3bdd-4e1f-b6e7-4587ea71ffd0 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.434144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 328/658] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:38.435140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322be186-3bdd-4e1f-b6e7-4587ea71ffd0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:38.470061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af395fc4-6322-4be9-920b-79b12d485a4d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:38.505996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f0845-9d72-4a77-9357-1d8085871e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:38.507312 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f0845-9d72-4a77-9357-1d8085871e68 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.507594 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f0845-9d72-4a77-9357-1d8085871e68 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.507911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f0845-9d72-4a77-9357-1d8085871e68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.543619 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322be186-3bdd-4e1f-b6e7-4587ea71ffd0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:38.576496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c857e-735c-47c2-b682-5caa2b236415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:38.576942 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f0845-9d72-4a77-9357-1d8085871e68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:38.577139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c857e-735c-47c2-b682-5caa2b236415 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.577415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c857e-735c-47c2-b682-5caa2b236415 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.577685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c857e-735c-47c2-b682-5caa2b236415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.578424 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f0845-9d72-4a77-9357-1d8085871e68 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:38.643097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c857e-735c-47c2-b682-5caa2b236415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:38.644548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c857e-735c-47c2-b682-5caa2b236415 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:38.686595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 331/659] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:38.687182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f0845-9d72-4a77-9357-1d8085871e68 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:38.748995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 329/660] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:38.750692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2af183-5167-46aa-a99e-a790fea09d23 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.751182 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2af183-5167-46aa-a99e-a790fea09d23 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.751675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2af183-5167-46aa-a99e-a790fea09d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.767813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-ad2af183-5167-46aa-a99e-a790fea09d23 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:38.768997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ad2af183-5167-46aa-a99e-a790fea09d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:38.793833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f0845-9d72-4a77-9357-1d8085871e68 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:38.837545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 330/661] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:38.838183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e72647-4332-4f24-af74-1638c30e2368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:38.838758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2af183-5167-46aa-a99e-a790fea09d23 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:38.838999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e72647-4332-4f24-af74-1638c30e2368 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.839286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e72647-4332-4f24-af74-1638c30e2368 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.839563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e72647-4332-4f24-af74-1638c30e2368 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.840404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e72647-4332-4f24-af74-1638c30e2368 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:38.840712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e72647-4332-4f24-af74-1638c30e2368 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:38.846479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e72647-4332-4f24-af74-1638c30e2368 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:38.865927 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 332/662] 10.222.0.61 () {56 vars in 1139 bytes} [Sat May 14 15:33:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:38.867172 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e72647-4332-4f24-af74-1638c30e2368 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:38.936045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2af183-5167-46aa-a99e-a790fea09d23 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:38.960843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e72647-4332-4f24-af74-1638c30e2368 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:38.968220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04436e1d-8f57-4622-989f-4634091de630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:38.969006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436e1d-8f57-4622-989f-4634091de630 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.969284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436e1d-8f57-4622-989f-4634091de630 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.969554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04436e1d-8f57-4622-989f-4634091de630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.979899 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04436e1d-8f57-4622-989f-4634091de630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:38.981352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04436e1d-8f57-4622-989f-4634091de630 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:38.995342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a694-5d6a-42f2-a32a-c30b78cb8103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:38.996144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a694-5d6a-42f2-a32a-c30b78cb8103 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:38.996424 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a694-5d6a-42f2-a32a-c30b78cb8103 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:38.996696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a694-5d6a-42f2-a32a-c30b78cb8103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-04436e1d-8f57-4622-989f-4634091de630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:38.998916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:38.999772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:39.000685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:39.000685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:39.000685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:39.000685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:39.004618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 331/663] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:39.005457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04436e1d-8f57-4622-989f-4634091de630 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.009508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a694-5d6a-42f2-a32a-c30b78cb8103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:39.010993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a694-5d6a-42f2-a32a-c30b78cb8103 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-4307a694-5d6a-42f2-a32a-c30b78cb8103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:39.028930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:39.029848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:39.031298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:39.031298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:39.031298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:39.031298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:39.034706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 333/664] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:39.035291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a694-5d6a-42f2-a32a-c30b78cb8103 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.104301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04436e1d-8f57-4622-989f-4634091de630 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:39.132634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a694-5d6a-42f2-a32a-c30b78cb8103 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:39.137142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db7525-3c4c-4131-a87e-abe4a8ccf4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:39.137935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7525-3c4c-4131-a87e-abe4a8ccf4ba None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:39.138219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7525-3c4c-4131-a87e-abe4a8ccf4ba None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:39.138526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db7525-3c4c-4131-a87e-abe4a8ccf4ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:39.149209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db7525-3c4c-4131-a87e-abe4a8ccf4ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-a6db7525-3c4c-4131-a87e-abe4a8ccf4ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:39.156866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:39.157783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:39.158653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 332/665] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:39.159960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db7525-3c4c-4131-a87e-abe4a8ccf4ba None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.170778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceee8f-72ab-4731-8258-0469c873a277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:39.171428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceee8f-72ab-4731-8258-0469c873a277 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:39.171705 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceee8f-72ab-4731-8258-0469c873a277 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:39.171982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ceee8f-72ab-4731-8258-0469c873a277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:39.240223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ceee8f-72ab-4731-8258-0469c873a277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:39.241668 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ceee8f-72ab-4731-8258-0469c873a277 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:39.257072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db7525-3c4c-4131-a87e-abe4a8ccf4ba None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:39.289733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c783e-5367-4327-91e5-3ac0626bd2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:39.290413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c783e-5367-4327-91e5-3ac0626bd2b9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:39.290698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c783e-5367-4327-91e5-3ac0626bd2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:39.290971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c783e-5367-4327-91e5-3ac0626bd2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:39.291692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c783e-5367-4327-91e5-3ac0626bd2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:39.291991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c783e-5367-4327-91e5-3ac0626bd2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:39.293337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c783e-5367-4327-91e5-3ac0626bd2b9 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:39.308962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 333/666] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:39.308962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c783e-5367-4327-91e5-3ac0626bd2b9 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.345448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 334/667] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:39.345448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceee8f-72ab-4731-8258-0469c873a277 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.400526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c783e-5367-4327-91e5-3ac0626bd2b9 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:39.436698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc44ac-d49b-4184-b764-805466c2b1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:39.437404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc44ac-d49b-4184-b764-805466c2b1d3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:39.437686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc44ac-d49b-4184-b764-805466c2b1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:39.437964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc44ac-d49b-4184-b764-805466c2b1d3 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:39.438710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc44ac-d49b-4184-b764-805466c2b1d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:39.439007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc44ac-d49b-4184-b764-805466c2b1d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:39.440358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc44ac-d49b-4184-b764-805466c2b1d3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:39.441156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ceee8f-72ab-4731-8258-0469c873a277 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:39.451529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 334/668] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:39.452337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc44ac-d49b-4184-b764-805466c2b1d3 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.483327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa3a54-8715-469b-9c2c-d16c653075a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:39.484103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3a54-8715-469b-9c2c-d16c653075a7 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:39.484392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3a54-8715-469b-9c2c-d16c653075a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:39.484667 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa3a54-8715-469b-9c2c-d16c653075a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:39.485431 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa3a54-8715-469b-9c2c-d16c653075a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:39.485739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa3a54-8715-469b-9c2c-d16c653075a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:39.487153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa3a54-8715-469b-9c2c-d16c653075a7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:39.495362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 335/669] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:39.496174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa3a54-8715-469b-9c2c-d16c653075a7 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.562958 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc44ac-d49b-4184-b764-805466c2b1d3 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:39.595345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a3e37-720a-43b7-a5ff-3b563bfbb6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:39.595859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa3a54-8715-469b-9c2c-d16c653075a7 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:39.596140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a3e37-720a-43b7-a5ff-3b563bfbb6ac None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:39.596419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a3e37-720a-43b7-a5ff-3b563bfbb6ac None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:39.596690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a3e37-720a-43b7-a5ff-3b563bfbb6ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:39.605119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a3e37-720a-43b7-a5ff-3b563bfbb6ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:39.606579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a3e37-720a-43b7-a5ff-3b563bfbb6ac None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-4e1a3e37-720a-43b7-a5ff-3b563bfbb6ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:39.620430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:39.621371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:39.622292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:39.622292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:39.622292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:39.622292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:39.622292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:39.622292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:39.622292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:39.622292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:39.622292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 335/670] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:39.622814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a3e37-720a-43b7-a5ff-3b563bfbb6ac None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.634620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8f1c8-d9b0-45cf-8859-bdb2675d5b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:39.635407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8f1c8-d9b0-45cf-8859-bdb2675d5b77 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:39.635687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8f1c8-d9b0-45cf-8859-bdb2675d5b77 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:39.635961 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8f1c8-d9b0-45cf-8859-bdb2675d5b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:39.646061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8f1c8-d9b0-45cf-8859-bdb2675d5b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:39.647607 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8f1c8-d9b0-45cf-8859-bdb2675d5b77 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-3cd8f1c8-d9b0-45cf-8859-bdb2675d5b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:39.664972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:39.666415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:39.667318 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:39.667318 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:39.667318 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:39.667318 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:39.667318 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 336/671] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:39.667611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8f1c8-d9b0-45cf-8859-bdb2675d5b77 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.721860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a3e37-720a-43b7-a5ff-3b563bfbb6ac None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:39.756503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabaa3b-5c50-4b7f-9979-5bfaab8d43dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:39.757281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabaa3b-5c50-4b7f-9979-5bfaab8d43dd None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:39.757565 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabaa3b-5c50-4b7f-9979-5bfaab8d43dd None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:39.757867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabaa3b-5c50-4b7f-9979-5bfaab8d43dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:39.764456 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabaa3b-5c50-4b7f-9979-5bfaab8d43dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:39.765871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabaa3b-5c50-4b7f-9979-5bfaab8d43dd None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:39.767488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8f1c8-d9b0-45cf-8859-bdb2675d5b77 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-4fabaa3b-5c50-4b7f-9979-5bfaab8d43dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:39.779702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:39.780621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:39.781513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:39.781513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:39.781513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:39.781513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:39.781513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:39.781513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:39.781513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:39.781513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:39.781513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 336/672] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:39.782075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabaa3b-5c50-4b7f-9979-5bfaab8d43dd None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.806625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d034c-d67b-4384-9f67-8a024f6cc180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:39.807417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d034c-d67b-4384-9f67-8a024f6cc180 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:39.807699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d034c-d67b-4384-9f67-8a024f6cc180 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:39.807978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d034c-d67b-4384-9f67-8a024f6cc180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:39.818585 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d034c-d67b-4384-9f67-8a024f6cc180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:39.820022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d034c-d67b-4384-9f67-8a024f6cc180 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-f29d034c-d67b-4384-9f67-8a024f6cc180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:39.837672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:39.838580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:39.840039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:39.840039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:39.840039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:39.840039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:39.840039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 337/673] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:39.840320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d034c-d67b-4384-9f67-8a024f6cc180 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.890589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabaa3b-5c50-4b7f-9979-5bfaab8d43dd None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:39.923814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056d380-446c-4d65-8101-7d94e1ef4da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:39.924427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056d380-446c-4d65-8101-7d94e1ef4da4 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:39.924679 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056d380-446c-4d65-8101-7d94e1ef4da4 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:39.924951 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056d380-446c-4d65-8101-7d94e1ef4da4 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:39.925745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056d380-446c-4d65-8101-7d94e1ef4da4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:39.926049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056d380-446c-4d65-8101-7d94e1ef4da4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:39.927509 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056d380-446c-4d65-8101-7d94e1ef4da4 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:39.944017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 337/674] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:39.944183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d034c-d67b-4384-9f67-8a024f6cc180 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:39.944297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056d380-446c-4d65-8101-7d94e1ef4da4 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:39.977301 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c1b05-47c7-46cb-b106-33b9d6726d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:39.978222 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1b05-47c7-46cb-b106-33b9d6726d7c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:39.978532 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1b05-47c7-46cb-b106-33b9d6726d7c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:39.978804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1b05-47c7-46cb-b106-33b9d6726d7c None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:39.979538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c1b05-47c7-46cb-b106-33b9d6726d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:39.979835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c1b05-47c7-46cb-b106-33b9d6726d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:39.981194 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c1b05-47c7-46cb-b106-33b9d6726d7c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:39.997325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 338/675] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:39.997325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c1b05-47c7-46cb-b106-33b9d6726d7c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:40.042375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056d380-446c-4d65-8101-7d94e1ef4da4 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:40.076090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7b886-5767-4ffc-9dd3-bc8363a835f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:40.076748 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b886-5767-4ffc-9dd3-bc8363a835f1 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.077037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b886-5767-4ffc-9dd3-bc8363a835f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.077312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7b886-5767-4ffc-9dd3-bc8363a835f1 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.078160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7b886-5767-4ffc-9dd3-bc8363a835f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:40.078533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7b886-5767-4ffc-9dd3-bc8363a835f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:40.079973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7b886-5767-4ffc-9dd3-bc8363a835f1 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:40.091395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 338/676] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:40.092196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7b886-5767-4ffc-9dd3-bc8363a835f1 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:40.098280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c1b05-47c7-46cb-b106-33b9d6726d7c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:40.131981 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4934d60-6f2b-49c7-aa6b-6311d07f0edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:40.132641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934d60-6f2b-49c7-aa6b-6311d07f0edf None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.133462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934d60-6f2b-49c7-aa6b-6311d07f0edf None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.133791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934d60-6f2b-49c7-aa6b-6311d07f0edf None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.134539 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4934d60-6f2b-49c7-aa6b-6311d07f0edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:40.134839 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4934d60-6f2b-49c7-aa6b-6311d07f0edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:40.136223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4934d60-6f2b-49c7-aa6b-6311d07f0edf None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:40.148207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 339/677] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:40.149881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4934d60-6f2b-49c7-aa6b-6311d07f0edf None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:40.194131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7b886-5767-4ffc-9dd3-bc8363a835f1 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:40.227324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85547-8b40-4176-83cd-7304a1e20394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:40.228241 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85547-8b40-4176-83cd-7304a1e20394 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.228519 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85547-8b40-4176-83cd-7304a1e20394 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.228788 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85547-8b40-4176-83cd-7304a1e20394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.229625 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd85547-8b40-4176-83cd-7304a1e20394 None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=b9b7a0202f394b16800af94487a21ef0) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:40.229934 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd85547-8b40-4176-83cd-7304a1e20394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:40.231392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd85547-8b40-4176-83cd-7304a1e20394 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:40.243040 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 339/678] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:40 2022] GET /identity/v3/role_assignments?user.id=b9b7a0202f394b16800af94487a21ef0&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:40.244192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85547-8b40-4176-83cd-7304a1e20394 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:40.251691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4934d60-6f2b-49c7-aa6b-6311d07f0edf None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:40.290025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195da42a-cffc-4deb-82c9-3c415fcb2dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:40.290861 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da42a-cffc-4deb-82c9-3c415fcb2dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.291142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da42a-cffc-4deb-82c9-3c415fcb2dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.291413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da42a-cffc-4deb-82c9-3c415fcb2dd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.299065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195da42a-cffc-4deb-82c9-3c415fcb2dd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:40.300554 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195da42a-cffc-4deb-82c9-3c415fcb2dd7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-195da42a-cffc-4deb-82c9-3c415fcb2dd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:40.316057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:40.317089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:40.317972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:40.317972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:40.317972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:40.317972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:40.317972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:40.317972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:40.317972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:40.317972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:40.317972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 340/679] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:40.318537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195da42a-cffc-4deb-82c9-3c415fcb2dd7 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:40.365096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85547-8b40-4176-83cd-7304a1e20394 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:40.402358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758e31-49a2-44d3-97d6-8a08a0ec5ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:40.403843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758e31-49a2-44d3-97d6-8a08a0ec5ed5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.404371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758e31-49a2-44d3-97d6-8a08a0ec5ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.404850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758e31-49a2-44d3-97d6-8a08a0ec5ed5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.405954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a758e31-49a2-44d3-97d6-8a08a0ec5ed5 None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=d346be1ef7604f1f87371f5d322fd010) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:40.406510 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a758e31-49a2-44d3-97d6-8a08a0ec5ed5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:40.408203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a758e31-49a2-44d3-97d6-8a08a0ec5ed5 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:40.416431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 340/680] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:40 2022] GET /identity/v3/role_assignments?user.id=d346be1ef7604f1f87371f5d322fd010&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:40.417666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758e31-49a2-44d3-97d6-8a08a0ec5ed5 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:40.425164 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195da42a-cffc-4deb-82c9-3c415fcb2dd7 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:40.464299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b147b-305d-4fb8-b63c-1ea96cd9d4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:40.465051 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b147b-305d-4fb8-b63c-1ea96cd9d4cf None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.465335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b147b-305d-4fb8-b63c-1ea96cd9d4cf None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.466207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b147b-305d-4fb8-b63c-1ea96cd9d4cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.474226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b147b-305d-4fb8-b63c-1ea96cd9d4cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:40.475895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b147b-305d-4fb8-b63c-1ea96cd9d4cf None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-d83b147b-305d-4fb8-b63c-1ea96cd9d4cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:40.493342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:40.494400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:40.495370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:40.495370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:40.495370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:40.495370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:40.495370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:40.495370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:40.495370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:40.495370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:40.495370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:40.495370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:40.495370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 341/681] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:40.501321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b147b-305d-4fb8-b63c-1ea96cd9d4cf None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:40.539527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758e31-49a2-44d3-97d6-8a08a0ec5ed5 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:40.577157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a777567-f0d6-491b-a287-dac1914574c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:40.578210 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777567-f0d6-491b-a287-dac1914574c5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.578717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777567-f0d6-491b-a287-dac1914574c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.579218 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a777567-f0d6-491b-a287-dac1914574c5 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.580233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a777567-f0d6-491b-a287-dac1914574c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:40.580770 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a777567-f0d6-491b-a287-dac1914574c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:40.582646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a777567-f0d6-491b-a287-dac1914574c5 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:40.597202 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 341/682] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:40.603613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a777567-f0d6-491b-a287-dac1914574c5 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:40.612002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b147b-305d-4fb8-b63c-1ea96cd9d4cf None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:40.648786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f43d0-08c4-4fc1-bd87-5eb3153765f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:40.649469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f43d0-08c4-4fc1-bd87-5eb3153765f7 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.649752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f43d0-08c4-4fc1-bd87-5eb3153765f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.650029 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f43d0-08c4-4fc1-bd87-5eb3153765f7 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.651270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f43d0-08c4-4fc1-bd87-5eb3153765f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:40.651582 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f43d0-08c4-4fc1-bd87-5eb3153765f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:40.653383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f43d0-08c4-4fc1-bd87-5eb3153765f7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:40.675082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 342/683] 10.222.0.61 () {56 vars in 1135 bytes} [Sat May 14 15:33:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:40.676405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38797443-033b-47cb-9c11-a9eac4a8b68e None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.676694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38797443-033b-47cb-9c11-a9eac4a8b68e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.676970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38797443-033b-47cb-9c11-a9eac4a8b68e None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.678493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 343/684] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:40.683434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38797443-033b-47cb-9c11-a9eac4a8b68e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:40.725865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a777567-f0d6-491b-a287-dac1914574c5 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:40.769275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028321e2-e13a-48c6-b051-2efec5e22b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:40.769941 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028321e2-e13a-48c6-b051-2efec5e22b41 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.770224 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028321e2-e13a-48c6-b051-2efec5e22b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.770535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028321e2-e13a-48c6-b051-2efec5e22b41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.771376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028321e2-e13a-48c6-b051-2efec5e22b41 None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=abfc1e35362a4495a05475878db260f2) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:40.771688 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028321e2-e13a-48c6-b051-2efec5e22b41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:40.773118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028321e2-e13a-48c6-b051-2efec5e22b41 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:40.783492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 342/685] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:40 2022] GET /identity/v3/role_assignments?user.id=abfc1e35362a4495a05475878db260f2&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:40.783492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27a54-e8be-4509-866f-19b77949794c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.783492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27a54-e8be-4509-866f-19b77949794c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.783492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27a54-e8be-4509-866f-19b77949794c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.809776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d3b27a54-e8be-4509-866f-19b77949794c None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:40.811037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d3b27a54-e8be-4509-866f-19b77949794c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:40.854609 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38797443-033b-47cb-9c11-a9eac4a8b68e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:40.907692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75012c71-e385-4140-8c44-ce014966072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:40.908416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75012c71-e385-4140-8c44-ce014966072d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:40.908701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75012c71-e385-4140-8c44-ce014966072d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:40.908972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75012c71-e385-4140-8c44-ce014966072d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:40.959805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 343/686] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:40.997859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b27a54-e8be-4509-866f-19b77949794c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:41.026531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75012c71-e385-4140-8c44-ce014966072d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:41.028007 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75012c71-e385-4140-8c44-ce014966072d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:41.108132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b27a54-e8be-4509-866f-19b77949794c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:41.134807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 344/687] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:41.140345 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75012c71-e385-4140-8c44-ce014966072d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:41.143370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc549af-5e8c-4374-b5fa-b1f19204d9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:41.144577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc549af-5e8c-4374-b5fa-b1f19204d9d4 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:41.145054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc549af-5e8c-4374-b5fa-b1f19204d9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:41.145561 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc549af-5e8c-4374-b5fa-b1f19204d9d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:41.157010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc549af-5e8c-4374-b5fa-b1f19204d9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-edc549af-5e8c-4374-b5fa-b1f19204d9d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:41.165336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:41.166254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:41.167126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:41.169857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 344/688] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:41.175753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc549af-5e8c-4374-b5fa-b1f19204d9d4 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:41.269687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75012c71-e385-4140-8c44-ce014966072d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:41.308757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8a9b0-8916-4f18-a291-3d5252dbc3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:41.309558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a9b0-8916-4f18-a291-3d5252dbc3a6 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:41.309841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a9b0-8916-4f18-a291-3d5252dbc3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:41.310132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8a9b0-8916-4f18-a291-3d5252dbc3a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:41.322802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8a9b0-8916-4f18-a291-3d5252dbc3a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:41.324260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea8a9b0-8916-4f18-a291-3d5252dbc3a6 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:41.324921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc549af-5e8c-4374-b5fa-b1f19204d9d4 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-9ea8a9b0-8916-4f18-a291-3d5252dbc3a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:41.346138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:41.347264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:41.348489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:41.348489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:41.348489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:41.348489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:41.348489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 345/689] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:41.354685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8a9b0-8916-4f18-a291-3d5252dbc3a6 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:41.411611 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7614d29-be27-4780-b0af-22440188060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:41.412304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7614d29-be27-4780-b0af-22440188060d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:41.412571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7614d29-be27-4780-b0af-22440188060d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:41.412847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7614d29-be27-4780-b0af-22440188060d None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:41.413609 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7614d29-be27-4780-b0af-22440188060d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:41.413915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7614d29-be27-4780-b0af-22440188060d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:41.416031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7614d29-be27-4780-b0af-22440188060d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:41.440832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 345/690] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:41.448630 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7614d29-be27-4780-b0af-22440188060d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:41.475416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8a9b0-8916-4f18-a291-3d5252dbc3a6 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:41.515287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebe7e7-319c-4324-95da-662781f492d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:41.516116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebe7e7-319c-4324-95da-662781f492d0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:41.516405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebe7e7-319c-4324-95da-662781f492d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:41.516681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebe7e7-319c-4324-95da-662781f492d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:41.517411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebe7e7-319c-4324-95da-662781f492d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:41.517717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebe7e7-319c-4324-95da-662781f492d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:41.519468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebe7e7-319c-4324-95da-662781f492d0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:41.533995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 346/691] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:41.540888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebe7e7-319c-4324-95da-662781f492d0 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:41.651674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebe7e7-319c-4324-95da-662781f492d0 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:41.697718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a82b1-29d2-4dbd-8e1d-5df2a7f9d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:41.698555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a82b1-29d2-4dbd-8e1d-5df2a7f9d010 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:41.698843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a82b1-29d2-4dbd-8e1d-5df2a7f9d010 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:41.699069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7614d29-be27-4780-b0af-22440188060d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:41.699238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a82b1-29d2-4dbd-8e1d-5df2a7f9d010 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:41.709312 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a82b1-29d2-4dbd-8e1d-5df2a7f9d010 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:41.711420 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a82b1-29d2-4dbd-8e1d-5df2a7f9d010 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-037a82b1-29d2-4dbd-8e1d-5df2a7f9d010 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:41.728171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:41.730250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:41.732615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:41.732615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:41.732615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:41.732615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:41.732615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:41.732615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:41.732615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:41.732615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:41.732615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 347/692] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:41.738415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a82b1-29d2-4dbd-8e1d-5df2a7f9d010 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:41.766179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f490f-a753-4a9f-a3e1-7e8a50c025b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:41.767050 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f490f-a753-4a9f-a3e1-7e8a50c025b3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:41.767332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f490f-a753-4a9f-a3e1-7e8a50c025b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:41.767604 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f490f-a753-4a9f-a3e1-7e8a50c025b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:41.790815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f490f-a753-4a9f-a3e1-7e8a50c025b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:41.794380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f490f-a753-4a9f-a3e1-7e8a50c025b3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-7a0f490f-a753-4a9f-a3e1-7e8a50c025b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:41.824078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:41.826180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:41.828281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:41.828281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:41.828281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:41.828281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:41.840476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 346/693] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:41.845299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f490f-a753-4a9f-a3e1-7e8a50c025b3 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:41.888821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a82b1-29d2-4dbd-8e1d-5df2a7f9d010 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:41.939913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69bd1f-571d-4544-97b0-5f6c1f363ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:41.940589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69bd1f-571d-4544-97b0-5f6c1f363ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:41.940875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69bd1f-571d-4544-97b0-5f6c1f363ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:41.941152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69bd1f-571d-4544-97b0-5f6c1f363ee0 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:41.941949 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69bd1f-571d-4544-97b0-5f6c1f363ee0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:41.942257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69bd1f-571d-4544-97b0-5f6c1f363ee0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:41.943723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69bd1f-571d-4544-97b0-5f6c1f363ee0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:41.963199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 348/694] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:41.969324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69bd1f-571d-4544-97b0-5f6c1f363ee0 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:41.979501 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f490f-a753-4a9f-a3e1-7e8a50c025b3 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:42.013775 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb03df-efd6-411f-ba7d-9995f9e3a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:42.014929 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb03df-efd6-411f-ba7d-9995f9e3a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:42.015407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb03df-efd6-411f-ba7d-9995f9e3a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:42.015873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb03df-efd6-411f-ba7d-9995f9e3a9d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:42.016788 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb03df-efd6-411f-ba7d-9995f9e3a9d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:42.017284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb03df-efd6-411f-ba7d-9995f9e3a9d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:42.019064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb03df-efd6-411f-ba7d-9995f9e3a9d0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:42.033604 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 347/695] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:42.040401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb03df-efd6-411f-ba7d-9995f9e3a9d0 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:42.151275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb03df-efd6-411f-ba7d-9995f9e3a9d0 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:42.188405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d87d9-7a2a-4d1f-bf95-c5c568d64021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:42.189524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d87d9-7a2a-4d1f-bf95-c5c568d64021 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:42.190001 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d87d9-7a2a-4d1f-bf95-c5c568d64021 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:42.190496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d87d9-7a2a-4d1f-bf95-c5c568d64021 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:42.192996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69bd1f-571d-4544-97b0-5f6c1f363ee0 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:42.198337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d87d9-7a2a-4d1f-bf95-c5c568d64021 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:42.200743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d87d9-7a2a-4d1f-bf95-c5c568d64021 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-8d5d87d9-7a2a-4d1f-bf95-c5c568d64021 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:42.216107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:42.217037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:42.217962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:42.217962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:42.217962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:42.217962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:42.217962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:42.217962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:42.217962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:42.217962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:42.217962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:42.217962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:42.220099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 348/696] 10.222.0.61 () {56 vars in 1093 bytes} [Sat May 14 15:33:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:42.228554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d87d9-7a2a-4d1f-bf95-c5c568d64021 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:42.253342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b586a-fa11-4aea-b31e-da5c39fe897e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:42.254145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b586a-fa11-4aea-b31e-da5c39fe897e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:42.254515 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b586a-fa11-4aea-b31e-da5c39fe897e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:42.254856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b586a-fa11-4aea-b31e-da5c39fe897e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:42.256129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b586a-fa11-4aea-b31e-da5c39fe897e None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=1713718ff95744b9bd42f21d4ec8bb91) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:42.256442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b586a-fa11-4aea-b31e-da5c39fe897e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:42.258224 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b586a-fa11-4aea-b31e-da5c39fe897e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:42.264927 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 349/697] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:41 2022] GET /identity/v3/role_assignments?user.id=1713718ff95744b9bd42f21d4ec8bb91&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:42.407161 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d87d9-7a2a-4d1f-bf95-c5c568d64021 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:42.463141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed067-4132-475e-ac0e-66d833f0b04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:42.463937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed067-4132-475e-ac0e-66d833f0b04b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:42.464126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed067-4132-475e-ac0e-66d833f0b04b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:42.464405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed067-4132-475e-ac0e-66d833f0b04b None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:42.465275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed067-4132-475e-ac0e-66d833f0b04b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:42.465583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed067-4132-475e-ac0e-66d833f0b04b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:42.467086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed067-4132-475e-ac0e-66d833f0b04b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:42.492605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 349/698] 10.222.0.61 () {56 vars in 1133 bytes} [Sat May 14 15:33:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:42.498367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b586a-fa11-4aea-b31e-da5c39fe897e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:42.608756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b586a-fa11-4aea-b31e-da5c39fe897e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:42.641452 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7173e6-8b9f-4161-9c6e-98980454b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:42.642167 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7173e6-8b9f-4161-9c6e-98980454b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:42.642482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7173e6-8b9f-4161-9c6e-98980454b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:42.642756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7173e6-8b9f-4161-9c6e-98980454b5c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:42.714931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7173e6-8b9f-4161-9c6e-98980454b5c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:42.716301 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7173e6-8b9f-4161-9c6e-98980454b5c5 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:42.812988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 350/699] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:42.818866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed067-4132-475e-ac0e-66d833f0b04b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:42.932453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed067-4132-475e-ac0e-66d833f0b04b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:42.971460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253af0ab-82d0-4f83-b483-2a31ef53d7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:42.972608 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af0ab-82d0-4f83-b483-2a31ef53d7d4 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:42.973095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af0ab-82d0-4f83-b483-2a31ef53d7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:42.973561 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af0ab-82d0-4f83-b483-2a31ef53d7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:42.990193 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253af0ab-82d0-4f83-b483-2a31ef53d7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:42.991949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253af0ab-82d0-4f83-b483-2a31ef53d7d4 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-253af0ab-82d0-4f83-b483-2a31ef53d7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:43.014027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:43.015206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:43.016304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:43.016304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:43.016304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:43.016304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:43.024745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 350/700] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:43.030108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7173e6-8b9f-4161-9c6e-98980454b5c5 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:43.127616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be38da9-206d-4fd1-936d-fe2bff823958 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.128132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be38da9-206d-4fd1-936d-fe2bff823958 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.128553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be38da9-206d-4fd1-936d-fe2bff823958 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.130039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 351/701] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:33:43.136025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d501-5e38-49ab-8b47-e26cfd7955d1 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.136314 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d501-5e38-49ab-8b47-e26cfd7955d1 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.136595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d501-5e38-49ab-8b47-e26cfd7955d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.152088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7173e6-8b9f-4161-9c6e-98980454b5c5 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:43.165633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9d61d501-5e38-49ab-8b47-e26cfd7955d1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:43.166926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9d61d501-5e38-49ab-8b47-e26cfd7955d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:43.194177 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9302951-67bb-46f6-b9c3-97b77c81f4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:43.195110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9302951-67bb-46f6-b9c3-97b77c81f4e0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.195563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9302951-67bb-46f6-b9c3-97b77c81f4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.196062 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9302951-67bb-46f6-b9c3-97b77c81f4e0 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.196949 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9302951-67bb-46f6-b9c3-97b77c81f4e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:43.197416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9302951-67bb-46f6-b9c3-97b77c81f4e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:43.198944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9302951-67bb-46f6-b9c3-97b77c81f4e0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:43.218140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 351/702] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:43.223527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9302951-67bb-46f6-b9c3-97b77c81f4e0 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:43.264483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 352/703] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:43.266084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49216f02-51e2-4fc8-99c2-859976c02d63 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.266556 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49216f02-51e2-4fc8-99c2-859976c02d63 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.266973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49216f02-51e2-4fc8-99c2-859976c02d63 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.268594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 353/704] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:43.281336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af30cd-cabf-4d64-8c1c-548af81c2d0e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.281858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af30cd-cabf-4d64-8c1c-548af81c2d0e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.282274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af30cd-cabf-4d64-8c1c-548af81c2d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.300767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c8af30cd-cabf-4d64-8c1c-548af81c2d0e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:43.302150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c8af30cd-cabf-4d64-8c1c-548af81c2d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:43.348527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9302951-67bb-46f6-b9c3-97b77c81f4e0 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:43.372336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 354/705] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:43.379462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af30cd-cabf-4d64-8c1c-548af81c2d0e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:43.401016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66962b7-1d0f-46cd-8089-cdafd637daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:43.402360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66962b7-1d0f-46cd-8089-cdafd637daf6 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.402360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66962b7-1d0f-46cd-8089-cdafd637daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.402360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66962b7-1d0f-46cd-8089-cdafd637daf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.409705 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66962b7-1d0f-46cd-8089-cdafd637daf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:43.415730 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66962b7-1d0f-46cd-8089-cdafd637daf6 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-e66962b7-1d0f-46cd-8089-cdafd637daf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:43.431897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:43.433016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:43.434087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:43.434087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:43.434087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:43.434087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:43.434087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:43.434087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:43.434087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:43.434087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:43.434087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 352/706] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:43.434675 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66962b7-1d0f-46cd-8089-cdafd637daf6 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:43.486428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af30cd-cabf-4d64-8c1c-548af81c2d0e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:43.522186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cfec4-d215-486d-ae94-adafc687c1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:43.523343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cfec4-d215-486d-ae94-adafc687c1bc None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.523792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cfec4-d215-486d-ae94-adafc687c1bc None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.524209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cfec4-d215-486d-ae94-adafc687c1bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.525032 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cfec4-d215-486d-ae94-adafc687c1bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:43.526649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cfec4-d215-486d-ae94-adafc687c1bc None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:43.542737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66962b7-1d0f-46cd-8089-cdafd637daf6 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-db6cfec4-d215-486d-ae94-adafc687c1bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:43.544261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:43.545416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 15:33:43.546470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:43.548199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 355/707] 10.222.0.61 () {56 vars in 1129 bytes} [Sat May 14 15:33:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:43.548498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cfec4-d215-486d-ae94-adafc687c1bc None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:43.586783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c260d-2e14-4d99-8cd1-6268ebcecfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:43.587587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c260d-2e14-4d99-8cd1-6268ebcecfa2 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.587870 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c260d-2e14-4d99-8cd1-6268ebcecfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.588144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c260d-2e14-4d99-8cd1-6268ebcecfa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.598289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c260d-2e14-4d99-8cd1-6268ebcecfa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:43.599758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c260d-2e14-4d99-8cd1-6268ebcecfa2 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-9d1c260d-2e14-4d99-8cd1-6268ebcecfa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:43.619986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:43.621173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:43.622069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:43.622069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:43.622069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:43.622069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:43.622069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 353/708] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:43.622069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c260d-2e14-4d99-8cd1-6268ebcecfa2 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:43.655785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cfec4-d215-486d-ae94-adafc687c1bc None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:43.690071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597acf2-41c4-477d-ad0f-8043bf6fc06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:43.690762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597acf2-41c4-477d-ad0f-8043bf6fc06e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.691045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597acf2-41c4-477d-ad0f-8043bf6fc06e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.691323 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597acf2-41c4-477d-ad0f-8043bf6fc06e None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.692110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597acf2-41c4-477d-ad0f-8043bf6fc06e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:43.692419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597acf2-41c4-477d-ad0f-8043bf6fc06e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:43.693861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597acf2-41c4-477d-ad0f-8043bf6fc06e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:43.712467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 356/709] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:43.712467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8ecb-3fb5-4fb2-a16f-14fbb6e3770c None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.712467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8ecb-3fb5-4fb2-a16f-14fbb6e3770c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.712467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b8ecb-3fb5-4fb2-a16f-14fbb6e3770c None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.712467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 357/710] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:43.712467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b8ecb-3fb5-4fb2-a16f-14fbb6e3770c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:43.733853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c260d-2e14-4d99-8cd1-6268ebcecfa2 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:43.767388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8fc25-4232-4b9e-ab5f-6bbcdb52ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:43.768080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8fc25-4232-4b9e-ab5f-6bbcdb52ab39 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.768360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8fc25-4232-4b9e-ab5f-6bbcdb52ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.768629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8fc25-4232-4b9e-ab5f-6bbcdb52ab39 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.769332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8fc25-4232-4b9e-ab5f-6bbcdb52ab39 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:43.769632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8fc25-4232-4b9e-ab5f-6bbcdb52ab39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:43.771019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8fc25-4232-4b9e-ab5f-6bbcdb52ab39 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:43.775747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 354/711] 10.222.0.61 () {56 vars in 1124 bytes} [Sat May 14 15:33:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:43.776636 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8fc25-4232-4b9e-ab5f-6bbcdb52ab39 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:43.819543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b8ecb-3fb5-4fb2-a16f-14fbb6e3770c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:43.857569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1ff67-89f1-468c-a532-2904489dd2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:43.858234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1ff67-89f1-468c-a532-2904489dd2b7 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.858541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1ff67-89f1-468c-a532-2904489dd2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.858814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1ff67-89f1-468c-a532-2904489dd2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.859533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1ff67-89f1-468c-a532-2904489dd2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:43.859832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1ff67-89f1-468c-a532-2904489dd2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:43.861200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1ff67-89f1-468c-a532-2904489dd2b7 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:43.873298 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 358/712] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:43.874614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139b5d5-23ee-43e8-92f8-c2b03f0fb91b None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.874902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139b5d5-23ee-43e8-92f8-c2b03f0fb91b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.875175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139b5d5-23ee-43e8-92f8-c2b03f0fb91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.887259 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8fc25-4232-4b9e-ab5f-6bbcdb52ab39 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:43.890762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9139b5d5-23ee-43e8-92f8-c2b03f0fb91b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:43.891930 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9139b5d5-23ee-43e8-92f8-c2b03f0fb91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:43.920743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e7d05-889a-40b1-a889-38263a7a048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:43.921393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e7d05-889a-40b1-a889-38263a7a048c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:43.921676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e7d05-889a-40b1-a889-38263a7a048c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:43.921950 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e7d05-889a-40b1-a889-38263a7a048c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:43.922858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e7d05-889a-40b1-a889-38263a7a048c None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=ebefa53d595b4e6486ce409f2ac47ff1) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:43.923124 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e7d05-889a-40b1-a889-38263a7a048c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:43.924577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e7d05-889a-40b1-a889-38263a7a048c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:43.936016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 355/713] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:43 2022] GET /identity/v3/role_assignments?user.id=ebefa53d595b4e6486ce409f2ac47ff1&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:43.936805 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e7d05-889a-40b1-a889-38263a7a048c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:43.972664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 359/714] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:43.973604 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139b5d5-23ee-43e8-92f8-c2b03f0fb91b None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:44.056432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e7d05-889a-40b1-a889-38263a7a048c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:44.091159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139b5d5-23ee-43e8-92f8-c2b03f0fb91b None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:44.097383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4f5aa-8abe-41b3-90e8-c85186f18b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:44.098066 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4f5aa-8abe-41b3-90e8-c85186f18b73 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:44.098374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4f5aa-8abe-41b3-90e8-c85186f18b73 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:44.098654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4f5aa-8abe-41b3-90e8-c85186f18b73 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:44.099379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4f5aa-8abe-41b3-90e8-c85186f18b73 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:44.099681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4f5aa-8abe-41b3-90e8-c85186f18b73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:44.101171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d4f5aa-8abe-41b3-90e8-c85186f18b73 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:44.108496 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 356/715] 10.222.0.61 () {56 vars in 1124 bytes} [Sat May 14 15:33:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:44.109362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4f5aa-8abe-41b3-90e8-c85186f18b73 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:44.131934 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee9b8d-273f-4cf5-bdfa-ac86db3b1d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:44.133248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9b8d-273f-4cf5-bdfa-ac86db3b1d56 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:44.133724 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9b8d-273f-4cf5-bdfa-ac86db3b1d56 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:44.134181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9b8d-273f-4cf5-bdfa-ac86db3b1d56 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:44.135169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee9b8d-273f-4cf5-bdfa-ac86db3b1d56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:44.136847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee9b8d-273f-4cf5-bdfa-ac86db3b1d56 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:44.174064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 360/716] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:33:43 2022] POST /identity/v3/users => generated 254 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:33:44.222404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4f5aa-8abe-41b3-90e8-c85186f18b73 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:44.284283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b59947-ff9e-42ad-8abb-f522700f1fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:44.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b59947-ff9e-42ad-8abb-f522700f1fe9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:44.285386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b59947-ff9e-42ad-8abb-f522700f1fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:44.285656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b59947-ff9e-42ad-8abb-f522700f1fe9 None admin] PATH_INFO: `/v3/services/network` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:44.286334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b59947-ff9e-42ad-8abb-f522700f1fe9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:44.287722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b59947-ff9e-42ad-8abb-f522700f1fe9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-63b59947-ff9e-42ad-8abb-f522700f1fe9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:44.318487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:44.319538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:44.320998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 357/717] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:44 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:44.327862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee9b8d-273f-4cf5-bdfa-ac86db3b1d56 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:44.456059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee9b8d-273f-4cf5-bdfa-ac86db3b1d56 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:44.492041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d156f5-5102-4e51-9ebb-28c015316cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:44.493575 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d156f5-5102-4e51-9ebb-28c015316cf0 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:44.494056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d156f5-5102-4e51-9ebb-28c015316cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:44.494588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d156f5-5102-4e51-9ebb-28c015316cf0 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:44.495498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d156f5-5102-4e51-9ebb-28c015316cf0 None admin] RBAC: Adding query filter params (name=network) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:44.495996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d156f5-5102-4e51-9ebb-28c015316cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:44.497557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d156f5-5102-4e51-9ebb-28c015316cf0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:44.502628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 361/718] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:33:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:44.509189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b59947-ff9e-42ad-8abb-f522700f1fe9 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:44.620909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b59947-ff9e-42ad-8abb-f522700f1fe9 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:44.654898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc9d49-5d83-4f1c-8d03-f2e7d56604c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:44.655565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc9d49-5d83-4f1c-8d03-f2e7d56604c9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:44.655847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc9d49-5d83-4f1c-8d03-f2e7d56604c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:44.656121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc9d49-5d83-4f1c-8d03-f2e7d56604c9 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:44.656834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc9d49-5d83-4f1c-8d03-f2e7d56604c9 None admin] RBAC: Adding query filter params (type=network) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:44.657138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc9d49-5d83-4f1c-8d03-f2e7d56604c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:44.658532 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc9d49-5d83-4f1c-8d03-f2e7d56604c9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:44.663435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 358/719] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:33:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:45.224782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f587aeb-bd8e-4478-87d1-0bb672f8ea98 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:45.225165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f587aeb-bd8e-4478-87d1-0bb672f8ea98 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:45.225359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f587aeb-bd8e-4478-87d1-0bb672f8ea98 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:45.227201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 362/720] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:45.233148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de2a3-d91c-471b-8872-5be263c58293 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:45.233610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de2a3-d91c-471b-8872-5be263c58293 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:45.233686 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953de2a3-d91c-471b-8872-5be263c58293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:45.253775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-953de2a3-d91c-471b-8872-5be263c58293 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:45.254977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-953de2a3-d91c-471b-8872-5be263c58293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:45.343882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 359/721] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:45.380556 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f587aeb-bd8e-4478-87d1-0bb672f8ea98 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:45.515462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f587aeb-bd8e-4478-87d1-0bb672f8ea98 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:45.561855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a9fa1-7720-4671-8a83-116a2e9cd516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:45.562669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a9fa1-7720-4671-8a83-116a2e9cd516 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:45.562950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a9fa1-7720-4671-8a83-116a2e9cd516 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:45.563221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a9fa1-7720-4671-8a83-116a2e9cd516 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:45.581082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a9fa1-7720-4671-8a83-116a2e9cd516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-303a9fa1-7720-4671-8a83-116a2e9cd516 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:45.589284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:45.590329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:45.591196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 363/722] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:45.600116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953de2a3-d91c-471b-8872-5be263c58293 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:45.733266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953de2a3-d91c-471b-8872-5be263c58293 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:45.782155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab5ab8-9f52-4899-8bbc-758d9449159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:45.782848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab5ab8-9f52-4899-8bbc-758d9449159f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:45.783136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab5ab8-9f52-4899-8bbc-758d9449159f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:45.783410 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab5ab8-9f52-4899-8bbc-758d9449159f None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:45.784178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab5ab8-9f52-4899-8bbc-758d9449159f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:45.784483 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab5ab8-9f52-4899-8bbc-758d9449159f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:45.785879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab5ab8-9f52-4899-8bbc-758d9449159f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:45.797407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 360/723] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:45.802466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a9fa1-7720-4671-8a83-116a2e9cd516 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:45.943371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a9fa1-7720-4671-8a83-116a2e9cd516 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:45.992935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41e03d-3ae2-4525-bebf-d1826f4156cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:45.993730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41e03d-3ae2-4525-bebf-d1826f4156cf None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:45.994010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41e03d-3ae2-4525-bebf-d1826f4156cf None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:45.994279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41e03d-3ae2-4525-bebf-d1826f4156cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:46.009873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41e03d-3ae2-4525-bebf-d1826f4156cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:46.011357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41e03d-3ae2-4525-bebf-d1826f4156cf None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-cc41e03d-3ae2-4525-bebf-d1826f4156cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:46.033163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:46.034079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:46.035009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:46.035009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:46.035009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:46.035009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:46.038677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 364/724] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:46.040292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab5ab8-9f52-4899-8bbc-758d9449159f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:46.161312 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab5ab8-9f52-4899-8bbc-758d9449159f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:46.194489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c315f-de86-4cc3-b83d-8138ba68725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:46.195201 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c315f-de86-4cc3-b83d-8138ba68725b None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:46.195486 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c315f-de86-4cc3-b83d-8138ba68725b None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:46.195763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c315f-de86-4cc3-b83d-8138ba68725b None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:46.196482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c315f-de86-4cc3-b83d-8138ba68725b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:46.196783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c315f-de86-4cc3-b83d-8138ba68725b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:46.198141 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c315f-de86-4cc3-b83d-8138ba68725b None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:46.211277 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 361/725] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:46.216728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41e03d-3ae2-4525-bebf-d1826f4156cf None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:46.411516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41e03d-3ae2-4525-bebf-d1826f4156cf None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:46.460480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa58e62-e9ed-4462-8524-cc326d60b69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:46.462202 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa58e62-e9ed-4462-8524-cc326d60b69e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:46.462570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa58e62-e9ed-4462-8524-cc326d60b69e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:46.462850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa58e62-e9ed-4462-8524-cc326d60b69e None admin] PATH_INFO: `/v3/users/swift` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:46.473993 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa58e62-e9ed-4462-8524-cc326d60b69e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:46.474253 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049338fa-5964-402f-83b3-7824b6c152d9 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:46.474698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049338fa-5964-402f-83b3-7824b6c152d9 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:46.474872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049338fa-5964-402f-83b3-7824b6c152d9 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:46.475484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa58e62-e9ed-4462-8524-cc326d60b69e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:46.476603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 362/726] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:46.481947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37d7e-1549-4894-8dca-640adfea9efd None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:46.482230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37d7e-1549-4894-8dca-640adfea9efd None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:46.482538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37d7e-1549-4894-8dca-640adfea9efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-5fa58e62-e9ed-4462-8524-cc326d60b69e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:46.496022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:46.497020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:46.497952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:46.497952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:46.497952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:46.497952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:46.497952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:46.497952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:46.497952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:46.497952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:46.497952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:46.497952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:46.497952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 365/727] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:46.504030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-32c37d7e-1549-4894-8dca-640adfea9efd None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:46.505220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-32c37d7e-1549-4894-8dca-640adfea9efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:46.507636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa58e62-e9ed-4462-8524-cc326d60b69e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:46.612663 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 363/728] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 14 15:33:46.647006 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c37d7e-1549-4894-8dca-640adfea9efd None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:46.662112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa58e62-e9ed-4462-8524-cc326d60b69e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:46.725258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6469469-d7d6-42c2-ad2a-d6a8eea54fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:46.726207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6469469-d7d6-42c2-ad2a-d6a8eea54fbc None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:46.727227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6469469-d7d6-42c2-ad2a-d6a8eea54fbc None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:46.727958 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6469469-d7d6-42c2-ad2a-d6a8eea54fbc None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:46.729729 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6469469-d7d6-42c2-ad2a-d6a8eea54fbc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:46.730674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6469469-d7d6-42c2-ad2a-d6a8eea54fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:46.732875 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6469469-d7d6-42c2-ad2a-d6a8eea54fbc None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:46.764958 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 366/729] 10.222.0.61 () {56 vars in 1135 bytes} [Sat May 14 15:33:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:46.772370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6469469-d7d6-42c2-ad2a-d6a8eea54fbc None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:46.840817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c37d7e-1549-4894-8dca-640adfea9efd None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:46.904663 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f62745-76a2-468c-9bea-726ae9d59e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:46.905519 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f62745-76a2-468c-9bea-726ae9d59e2c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:46.905806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f62745-76a2-468c-9bea-726ae9d59e2c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:46.906081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f62745-76a2-468c-9bea-726ae9d59e2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:46.918529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f62745-76a2-468c-9bea-726ae9d59e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-48f62745-76a2-468c-9bea-726ae9d59e2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:46.927618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:46.928562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:46.929412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 364/730] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:46.935368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f62745-76a2-468c-9bea-726ae9d59e2c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:46.937046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6469469-d7d6-42c2-ad2a-d6a8eea54fbc None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:47.021305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06428a-5df3-43fc-94a2-00cdc3bbc37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:47.021954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06428a-5df3-43fc-94a2-00cdc3bbc37e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.022233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06428a-5df3-43fc-94a2-00cdc3bbc37e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.022526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06428a-5df3-43fc-94a2-00cdc3bbc37e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.102077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f62745-76a2-468c-9bea-726ae9d59e2c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:47.106281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06428a-5df3-43fc-94a2-00cdc3bbc37e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:47.107778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06428a-5df3-43fc-94a2-00cdc3bbc37e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:47.137489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab292fb-6348-493b-ae11-d779d6df36ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:47.138817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab292fb-6348-493b-ae11-d779d6df36ee None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.139022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab292fb-6348-493b-ae11-d779d6df36ee None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.139299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab292fb-6348-493b-ae11-d779d6df36ee None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.140047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab292fb-6348-493b-ae11-d779d6df36ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:47.140347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab292fb-6348-493b-ae11-d779d6df36ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:47.141714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab292fb-6348-493b-ae11-d779d6df36ee None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:47.150534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 365/731] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:47.151870 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4322c7-eaf7-40cf-9c50-0ef7a42d31ce None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.152159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4322c7-eaf7-40cf-9c50-0ef7a42d31ce None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.152432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4322c7-eaf7-40cf-9c50-0ef7a42d31ce None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.153791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 366/732] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:47.155541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa9845-4082-420d-8365-c1bdde069d4e None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.156009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa9845-4082-420d-8365-c1bdde069d4e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.156440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa9845-4082-420d-8365-c1bdde069d4e None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.158146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 367/733] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:47.159073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa9845-4082-420d-8365-c1bdde069d4e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:47.215888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 367/734] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 14 15:33:47.215888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709c867-1031-46f0-b701-be897b729ff9 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.215888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709c867-1031-46f0-b701-be897b729ff9 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.215888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709c867-1031-46f0-b701-be897b729ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.228844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-6709c867-1031-46f0-b701-be897b729ff9 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:47.230009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6709c867-1031-46f0-b701-be897b729ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:47.263067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa9845-4082-420d-8365-c1bdde069d4e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:47.295881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98920d3d-1d2f-4dc3-b283-7f621650d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:47.296672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98920d3d-1d2f-4dc3-b283-7f621650d534 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.302428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98920d3d-1d2f-4dc3-b283-7f621650d534 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.302553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 368/735] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:47.302648 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98920d3d-1d2f-4dc3-b283-7f621650d534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.302733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61763-ada6-4cf7-a4c5-013fd1639476 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.302733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61763-ada6-4cf7-a4c5-013fd1639476 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.302733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61763-ada6-4cf7-a4c5-013fd1639476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.320150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98920d3d-1d2f-4dc3-b283-7f621650d534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:47.321802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98920d3d-1d2f-4dc3-b283-7f621650d534 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:47.325462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b6a61763-ada6-4cf7-a4c5-013fd1639476 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:47.326641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b6a61763-ada6-4cf7-a4c5-013fd1639476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-98920d3d-1d2f-4dc3-b283-7f621650d534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:47.339666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:47.340600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:47.341540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:47.341540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:47.341540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:47.341540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:47.345385 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 368/736] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:47.346207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98920d3d-1d2f-4dc3-b283-7f621650d534 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:47.400436 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 369/737] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:47.401625 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a61763-ada6-4cf7-a4c5-013fd1639476 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:47.456550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98920d3d-1d2f-4dc3-b283-7f621650d534 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:47.495725 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405bd30-1bf7-4c20-9d07-1fc9b662078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:47.496642 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405bd30-1bf7-4c20-9d07-1fc9b662078d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.496753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405bd30-1bf7-4c20-9d07-1fc9b662078d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.496978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405bd30-1bf7-4c20-9d07-1fc9b662078d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.501758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a61763-ada6-4cf7-a4c5-013fd1639476 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:47.506865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405bd30-1bf7-4c20-9d07-1fc9b662078d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:47.508985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405bd30-1bf7-4c20-9d07-1fc9b662078d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-9405bd30-1bf7-4c20-9d07-1fc9b662078d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:47.527036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:47.528019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:47.528948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:47.528948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:47.528948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:47.528948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:47.528948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 369/738] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:47.529232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405bd30-1bf7-4c20-9d07-1fc9b662078d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:47.544818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef1b48-fd8b-4228-b2ee-76677c56c696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:47.545505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef1b48-fd8b-4228-b2ee-76677c56c696 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.545781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef1b48-fd8b-4228-b2ee-76677c56c696 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.546044 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef1b48-fd8b-4228-b2ee-76677c56c696 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.546823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef1b48-fd8b-4228-b2ee-76677c56c696 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:47.548277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef1b48-fd8b-4228-b2ee-76677c56c696 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:47.564481 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 370/739] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:33:47 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:33:47.565665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef1b48-fd8b-4228-b2ee-76677c56c696 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:47.669371 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405bd30-1bf7-4c20-9d07-1fc9b662078d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:47.686744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef1b48-fd8b-4228-b2ee-76677c56c696 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:47.718522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a7235-f9de-4f62-a989-57d1709c9b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:47.719914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a7235-f9de-4f62-a989-57d1709c9b3d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.720355 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a7235-f9de-4f62-a989-57d1709c9b3d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.721019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a7235-f9de-4f62-a989-57d1709c9b3d None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.722062 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a7235-f9de-4f62-a989-57d1709c9b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:47.722541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a7235-f9de-4f62-a989-57d1709c9b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:47.724304 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a7235-f9de-4f62-a989-57d1709c9b3d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:47.725120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458955d-b0ae-4377-ae1b-792a4f9648f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:47.726013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458955d-b0ae-4377-ae1b-792a4f9648f7 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.727092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458955d-b0ae-4377-ae1b-792a4f9648f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.728256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458955d-b0ae-4377-ae1b-792a4f9648f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.740328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458955d-b0ae-4377-ae1b-792a4f9648f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:47.741305 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 370/740] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:47.742668 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a7235-f9de-4f62-a989-57d1709c9b3d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-5458955d-b0ae-4377-ae1b-792a4f9648f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:47.749621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:47.750743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 371/741] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:47.756037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097f6d9-388a-4f2e-9009-a92b47dfb987 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.756805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097f6d9-388a-4f2e-9009-a92b47dfb987 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.756805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097f6d9-388a-4f2e-9009-a92b47dfb987 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.756805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 372/742] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:47.756805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097f6d9-388a-4f2e-9009-a92b47dfb987 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:47.861226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a7235-f9de-4f62-a989-57d1709c9b3d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:47.871613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097f6d9-388a-4f2e-9009-a92b47dfb987 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:47.897021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d0b5-63b0-4b0d-8e05-7f51d4e991a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:47.897679 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d0b5-63b0-4b0d-8e05-7f51d4e991a1 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.897958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d0b5-63b0-4b0d-8e05-7f51d4e991a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.898881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7d0b5-63b0-4b0d-8e05-7f51d4e991a1 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.899736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7d0b5-63b0-4b0d-8e05-7f51d4e991a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:47.900036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7d0b5-63b0-4b0d-8e05-7f51d4e991a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:47.901397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7d0b5-63b0-4b0d-8e05-7f51d4e991a1 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:47.905342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84538562-eb23-413f-b9ed-bce2a405c2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:47.906133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84538562-eb23-413f-b9ed-bce2a405c2ad None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.906449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84538562-eb23-413f-b9ed-bce2a405c2ad None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.906725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84538562-eb23-413f-b9ed-bce2a405c2ad None admin] PATH_INFO: `/v3/users/nova` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.912520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 371/743] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:47.914661 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d0b5-63b0-4b0d-8e05-7f51d4e991a1 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:47.915014 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84538562-eb23-413f-b9ed-bce2a405c2ad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:47.916472 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84538562-eb23-413f-b9ed-bce2a405c2ad None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-84538562-eb23-413f-b9ed-bce2a405c2ad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:47.930678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:47.931767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:47.932723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:47.932723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:47.932723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:47.932723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:47.932723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:47.932723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:47.932723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:47.932723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:47.932723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:47.932723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:47.932723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 373/744] 10.222.0.61 () {56 vars in 1093 bytes} [Sat May 14 15:33:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:47.933812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c69de-04c8-4709-a3bf-75a390dedaed None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:47.933812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c69de-04c8-4709-a3bf-75a390dedaed None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:47.933812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c69de-04c8-4709-a3bf-75a390dedaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:47.949583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c99c69de-04c8-4709-a3bf-75a390dedaed None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:47.950778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c99c69de-04c8-4709-a3bf-75a390dedaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:48.019937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 374/745] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:47 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 14 15:33:48.020904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c69de-04c8-4709-a3bf-75a390dedaed None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:48.034921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7d0b5-63b0-4b0d-8e05-7f51d4e991a1 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:48.072911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b54bb-cc88-4857-ad1a-99ab9de98c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:48.073911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b54bb-cc88-4857-ad1a-99ab9de98c77 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:48.074428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b54bb-cc88-4857-ad1a-99ab9de98c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:48.074895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b54bb-cc88-4857-ad1a-99ab9de98c77 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:48.075901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b54bb-cc88-4857-ad1a-99ab9de98c77 None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:48.076437 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b54bb-cc88-4857-ad1a-99ab9de98c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:48.078112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b54bb-cc88-4857-ad1a-99ab9de98c77 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:48.092537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 372/746] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:48.092537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b54bb-cc88-4857-ad1a-99ab9de98c77 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:48.194483 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b54bb-cc88-4857-ad1a-99ab9de98c77 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:48.229411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636b427-41b8-48ab-999e-0d84f08d8199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:48.230089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636b427-41b8-48ab-999e-0d84f08d8199 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:48.230398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636b427-41b8-48ab-999e-0d84f08d8199 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:48.230681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636b427-41b8-48ab-999e-0d84f08d8199 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:48.231513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636b427-41b8-48ab-999e-0d84f08d8199 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:48.231816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636b427-41b8-48ab-999e-0d84f08d8199 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:48.233233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636b427-41b8-48ab-999e-0d84f08d8199 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:48.246051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c69de-04c8-4709-a3bf-75a390dedaed None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:48.249808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 373/747] 10.222.0.61 () {56 vars in 1133 bytes} [Sat May 14 15:33:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:48.250614 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636b427-41b8-48ab-999e-0d84f08d8199 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:48.280502 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d5f0e-71c8-42d8-9a0e-aa7f4dae0656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:48.281248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d5f0e-71c8-42d8-9a0e-aa7f4dae0656 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:48.281487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d5f0e-71c8-42d8-9a0e-aa7f4dae0656 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:48.281756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d5f0e-71c8-42d8-9a0e-aa7f4dae0656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:48.288294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d5f0e-71c8-42d8-9a0e-aa7f4dae0656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:48.290669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d5f0e-71c8-42d8-9a0e-aa7f4dae0656 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f08d5f0e-71c8-42d8-9a0e-aa7f4dae0656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:48.306997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:48.308211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:48.309580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:48.309580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:48.309580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:48.309580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:48.309580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:48.309580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:48.309580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:48.309580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:48.310963 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 375/748] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:48.311300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d5f0e-71c8-42d8-9a0e-aa7f4dae0656 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:48.375982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636b427-41b8-48ab-999e-0d84f08d8199 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:48.416435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca729f52-c609-4b65-bea7-b72c514182ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:48.417037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d5f0e-71c8-42d8-9a0e-aa7f4dae0656 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:48.417214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca729f52-c609-4b65-bea7-b72c514182ad None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:48.417456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca729f52-c609-4b65-bea7-b72c514182ad None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:48.417691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca729f52-c609-4b65-bea7-b72c514182ad None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:48.418448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca729f52-c609-4b65-bea7-b72c514182ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:48.420754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca729f52-c609-4b65-bea7-b72c514182ad None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:48.437035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 374/749] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:33:48 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:33:48.437865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca729f52-c609-4b65-bea7-b72c514182ad None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:48.482374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ac972-d773-4320-9609-452ebfc6a5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:48.483694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ac972-d773-4320-9609-452ebfc6a5cd None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:48.484173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ac972-d773-4320-9609-452ebfc6a5cd None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:48.484685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ac972-d773-4320-9609-452ebfc6a5cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:48.496948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ac972-d773-4320-9609-452ebfc6a5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:48.498899 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ac972-d773-4320-9609-452ebfc6a5cd None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-730ac972-d773-4320-9609-452ebfc6a5cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:48.518901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:48.519901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:48.520785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:48.520785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:48.520785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:48.520785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:48.523343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 376/750] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:48.525090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ac972-d773-4320-9609-452ebfc6a5cd None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:48.550444 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca729f52-c609-4b65-bea7-b72c514182ad None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:48.589054 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4adfb9-4291-4b78-b504-ea9996dd0640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:48.589866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4adfb9-4291-4b78-b504-ea9996dd0640 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:48.590147 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4adfb9-4291-4b78-b504-ea9996dd0640 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:48.590460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4adfb9-4291-4b78-b504-ea9996dd0640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:48.601788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4adfb9-4291-4b78-b504-ea9996dd0640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:48.603597 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4adfb9-4291-4b78-b504-ea9996dd0640 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-5a4adfb9-4291-4b78-b504-ea9996dd0640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:48.622142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:48.623154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:48.624043 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:48.624043 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:48.624043 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:48.624043 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:48.628046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 375/751] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:48.628919 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4adfb9-4291-4b78-b504-ea9996dd0640 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:48.646902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ac972-d773-4320-9609-452ebfc6a5cd None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:48.691440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6253b0-10e2-4708-81d6-a1c7b6b1ea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:48.693222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6253b0-10e2-4708-81d6-a1c7b6b1ea88 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:48.693753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6253b0-10e2-4708-81d6-a1c7b6b1ea88 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:48.694181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6253b0-10e2-4708-81d6-a1c7b6b1ea88 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:48.695771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6253b0-10e2-4708-81d6-a1c7b6b1ea88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:48.696506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6253b0-10e2-4708-81d6-a1c7b6b1ea88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:48.698245 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6253b0-10e2-4708-81d6-a1c7b6b1ea88 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:48.718399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 377/752] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:48.720152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6253b0-10e2-4708-81d6-a1c7b6b1ea88 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:48.741175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4adfb9-4291-4b78-b504-ea9996dd0640 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:48.778037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118eb35-5f0c-4a59-9551-21e7b050b14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:48.778732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118eb35-5f0c-4a59-9551-21e7b050b14f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:48.779303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118eb35-5f0c-4a59-9551-21e7b050b14f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:48.779588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118eb35-5f0c-4a59-9551-21e7b050b14f None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:48.780346 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118eb35-5f0c-4a59-9551-21e7b050b14f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:48.780648 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118eb35-5f0c-4a59-9551-21e7b050b14f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:48.782010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118eb35-5f0c-4a59-9551-21e7b050b14f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:48.795138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 376/753] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:48.795980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118eb35-5f0c-4a59-9551-21e7b050b14f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:48.844994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6253b0-10e2-4708-81d6-a1c7b6b1ea88 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:48.881682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78e0e0-ea53-438f-9661-98729e52f5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:48.882368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78e0e0-ea53-438f-9661-98729e52f5a5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:48.883197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78e0e0-ea53-438f-9661-98729e52f5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:48.883473 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78e0e0-ea53-438f-9661-98729e52f5a5 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:48.884331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78e0e0-ea53-438f-9661-98729e52f5a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:48.884637 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78e0e0-ea53-438f-9661-98729e52f5a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:48.886010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78e0e0-ea53-438f-9661-98729e52f5a5 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:48.898044 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 378/754] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:48.899372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78e0e0-ea53-438f-9661-98729e52f5a5 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:48.915091 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118eb35-5f0c-4a59-9551-21e7b050b14f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:48.959727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0de4f6-2ad5-45f3-86b7-71639ec6783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:48.961039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0de4f6-2ad5-45f3-86b7-71639ec6783e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:48.961465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0de4f6-2ad5-45f3-86b7-71639ec6783e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:48.962031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0de4f6-2ad5-45f3-86b7-71639ec6783e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:48.963596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0de4f6-2ad5-45f3-86b7-71639ec6783e None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=1713718ff95744b9bd42f21d4ec8bb91) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:48.964078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0de4f6-2ad5-45f3-86b7-71639ec6783e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:48.965852 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0de4f6-2ad5-45f3-86b7-71639ec6783e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:48.975938 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 377/755] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:48 2022] GET /identity/v3/role_assignments?user.id=1713718ff95744b9bd42f21d4ec8bb91&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:48.977917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0de4f6-2ad5-45f3-86b7-71639ec6783e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:49.037082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78e0e0-ea53-438f-9661-98729e52f5a5 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:49.090140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fe56c-7014-4d8b-9811-6bae26f120af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:49.091433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fe56c-7014-4d8b-9811-6bae26f120af None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:49.091716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fe56c-7014-4d8b-9811-6bae26f120af None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:49.091990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fe56c-7014-4d8b-9811-6bae26f120af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:49.103261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fe56c-7014-4d8b-9811-6bae26f120af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:49.104739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fe56c-7014-4d8b-9811-6bae26f120af None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-8e2fe56c-7014-4d8b-9811-6bae26f120af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:49.122108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:49.123143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:49.124082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:49.124082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:49.124082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:49.124082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:49.124082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:49.124082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:49.124082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:49.124082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:49.124082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:33:49.124082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:49.124082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 379/756] 10.222.0.61 () {56 vars in 1117 bytes} [Sat May 14 15:33:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:49.129052 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fe56c-7014-4d8b-9811-6bae26f120af None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:49.186734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0de4f6-2ad5-45f3-86b7-71639ec6783e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:49.222021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c6707-4afc-4ad3-aaf5-97b4159c9e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:49.222871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c6707-4afc-4ad3-aaf5-97b4159c9e54 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:49.223151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c6707-4afc-4ad3-aaf5-97b4159c9e54 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:49.223423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c6707-4afc-4ad3-aaf5-97b4159c9e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:49.230946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c6707-4afc-4ad3-aaf5-97b4159c9e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:49.232372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c6707-4afc-4ad3-aaf5-97b4159c9e54 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:49.245385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fe56c-7014-4d8b-9811-6bae26f120af None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-681c6707-4afc-4ad3-aaf5-97b4159c9e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:49.246946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:49.247817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:49.248700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:49.248700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:49.248700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:49.248700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:49.248700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:49.248700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:49.248700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:49.248700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:49.248700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 378/757] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:49.253697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c6707-4afc-4ad3-aaf5-97b4159c9e54 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:49.284838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0a6b8-83ae-48a1-a6b0-3dc78c388bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:49.285521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0a6b8-83ae-48a1-a6b0-3dc78c388bb9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:49.285805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0a6b8-83ae-48a1-a6b0-3dc78c388bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:49.286077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0a6b8-83ae-48a1-a6b0-3dc78c388bb9 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:49.287008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0a6b8-83ae-48a1-a6b0-3dc78c388bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:49.287369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0a6b8-83ae-48a1-a6b0-3dc78c388bb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:49.288935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0a6b8-83ae-48a1-a6b0-3dc78c388bb9 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:49.309792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 380/758] 10.222.0.61 () {56 vars in 1149 bytes} [Sat May 14 15:33:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:49.316218 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0a6b8-83ae-48a1-a6b0-3dc78c388bb9 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:49.425774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0a6b8-83ae-48a1-a6b0-3dc78c388bb9 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:49.464070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361cc50-e5aa-4686-ab6b-0d201267c339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:49.464728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361cc50-e5aa-4686-ab6b-0d201267c339 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:49.465006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361cc50-e5aa-4686-ab6b-0d201267c339 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:49.465279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361cc50-e5aa-4686-ab6b-0d201267c339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:49.468235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c6707-4afc-4ad3-aaf5-97b4159c9e54 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:49.513910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff55cfd-6cd3-4d2d-94ad-6dbf6fa52851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:49.514599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55cfd-6cd3-4d2d-94ad-6dbf6fa52851 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:49.514880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55cfd-6cd3-4d2d-94ad-6dbf6fa52851 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:49.515155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff55cfd-6cd3-4d2d-94ad-6dbf6fa52851 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:49.515941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff55cfd-6cd3-4d2d-94ad-6dbf6fa52851 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:49.516244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff55cfd-6cd3-4d2d-94ad-6dbf6fa52851 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:49.517719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff55cfd-6cd3-4d2d-94ad-6dbf6fa52851 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:49.530046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 379/759] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:49.538716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361cc50-e5aa-4686-ab6b-0d201267c339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:49.539592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff55cfd-6cd3-4d2d-94ad-6dbf6fa52851 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:49.540720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361cc50-e5aa-4686-ab6b-0d201267c339 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:49.640866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 381/760] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:33:49.646212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361cc50-e5aa-4686-ab6b-0d201267c339 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:49.697251 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff55cfd-6cd3-4d2d-94ad-6dbf6fa52851 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:49.753852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361cc50-e5aa-4686-ab6b-0d201267c339 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:49.791022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0386d-944a-4cbe-97b0-306f3ef98abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:49.792135 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0386d-944a-4cbe-97b0-306f3ef98abd None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:49.792501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0386d-944a-4cbe-97b0-306f3ef98abd None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:49.792793 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0386d-944a-4cbe-97b0-306f3ef98abd None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/ebefa53d595b4e6486ce409f2ac47ff1/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:49.794410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9ac1b-a47e-4ea7-b2b2-1a53fe1cc491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:49.794901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0386d-944a-4cbe-97b0-306f3ef98abd None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=ebefa53d595b4e6486ce409f2ac47ff1, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:49.795196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9ac1b-a47e-4ea7-b2b2-1a53fe1cc491 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:49.795476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9ac1b-a47e-4ea7-b2b2-1a53fe1cc491 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:49.795749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9ac1b-a47e-4ea7-b2b2-1a53fe1cc491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:49.796543 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0386d-944a-4cbe-97b0-306f3ef98abd None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:49.806613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9ac1b-a47e-4ea7-b2b2-1a53fe1cc491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:49.808175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9ac1b-a47e-4ea7-b2b2-1a53fe1cc491 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-def9ac1b-a47e-4ea7-b2b2-1a53fe1cc491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:49.828344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:49.829277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:49.830645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:49.830645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:49.830645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:49.830645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:49.830879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 380/761] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:33:49 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/ebefa53d595b4e6486ce409f2ac47ff1/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:49.830952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 382/762] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:49.835249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0386d-944a-4cbe-97b0-306f3ef98abd None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:49.960035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0386d-944a-4cbe-97b0-306f3ef98abd None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:49.994286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec3da3-37ec-4bf7-af15-ebb6158eeba2 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:49.994646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec3da3-37ec-4bf7-af15-ebb6158eeba2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:49.994967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec3da3-37ec-4bf7-af15-ebb6158eeba2 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:49.998168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 383/763] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:33:50.002741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96449c-d96c-4f15-bb72-978d1a3581b5 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:50.003332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96449c-d96c-4f15-bb72-978d1a3581b5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:50.003690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96449c-d96c-4f15-bb72-978d1a3581b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:50.012823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd1321-e648-4d05-b8ec-4bb8bd20c2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:50.015591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd1321-e648-4d05-b8ec-4bb8bd20c2b7 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:50.016082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd1321-e648-4d05-b8ec-4bb8bd20c2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:50.016531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd1321-e648-4d05-b8ec-4bb8bd20c2b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:50.020449 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd1321-e648-4d05-b8ec-4bb8bd20c2b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:50.021017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd1321-e648-4d05-b8ec-4bb8bd20c2b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:50.022743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd1321-e648-4d05-b8ec-4bb8bd20c2b7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:50.036857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-1b96449c-d96c-4f15-bb72-978d1a3581b5 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:50.038380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1b96449c-d96c-4f15-bb72-978d1a3581b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:50.048702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 381/764] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:50.054303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd1321-e648-4d05-b8ec-4bb8bd20c2b7 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:50.147756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 384/765] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:33:50.171650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96449c-d96c-4f15-bb72-978d1a3581b5 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:50.190889 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd1321-e648-4d05-b8ec-4bb8bd20c2b7 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:50.238793 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd479585-bdaa-4ffb-b8b0-2561a584788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:50.239514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd479585-bdaa-4ffb-b8b0-2561a584788a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:50.239795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd479585-bdaa-4ffb-b8b0-2561a584788a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:50.242796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd479585-bdaa-4ffb-b8b0-2561a584788a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:50.260292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd479585-bdaa-4ffb-b8b0-2561a584788a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:50.261761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd479585-bdaa-4ffb-b8b0-2561a584788a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-cd479585-bdaa-4ffb-b8b0-2561a584788a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:50.284189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:50.285107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:50.286000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:50.286000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:50.286000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:50.286000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:50.286000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:50.286000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:50.286000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:50.286000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:50.290342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 382/766] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:50.295241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd479585-bdaa-4ffb-b8b0-2561a584788a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:50.304241 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96449c-d96c-4f15-bb72-978d1a3581b5 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:50.356160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5360e1a-e0fa-4353-9709-52d9ddd929ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:50.356964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360e1a-e0fa-4353-9709-52d9ddd929ac None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:50.357240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360e1a-e0fa-4353-9709-52d9ddd929ac None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:50.357508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360e1a-e0fa-4353-9709-52d9ddd929ac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:50.358162 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5360e1a-e0fa-4353-9709-52d9ddd929ac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:50.359546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5360e1a-e0fa-4353-9709-52d9ddd929ac None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f5360e1a-e0fa-4353-9709-52d9ddd929ac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:50.382119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:50.383744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 15:33:50.384614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:50.385701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 385/767] 10.222.0.61 () {56 vars in 1129 bytes} [Sat May 14 15:33:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:50.395318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5360e1a-e0fa-4353-9709-52d9ddd929ac None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:50.487386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd479585-bdaa-4ffb-b8b0-2561a584788a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:50.550885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4685431-2965-4b51-91f4-c0624a7a99ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:50.550885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4685431-2965-4b51-91f4-c0624a7a99ad None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:50.551160 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4685431-2965-4b51-91f4-c0624a7a99ad None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:50.551240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4685431-2965-4b51-91f4-c0624a7a99ad None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:50.552117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4685431-2965-4b51-91f4-c0624a7a99ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:50.552423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4685431-2965-4b51-91f4-c0624a7a99ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:50.553850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4685431-2965-4b51-91f4-c0624a7a99ad None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:50.569100 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5360e1a-e0fa-4353-9709-52d9ddd929ac None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:50.580218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 383/768] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:50.585590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4685431-2965-4b51-91f4-c0624a7a99ad None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:50.626477 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58184a-d297-4af8-8276-c7499b84d1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:50.627612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58184a-d297-4af8-8276-c7499b84d1ea None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:50.628112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58184a-d297-4af8-8276-c7499b84d1ea None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:50.628736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58184a-d297-4af8-8276-c7499b84d1ea None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:50.629658 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58184a-d297-4af8-8276-c7499b84d1ea None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:50.631365 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58184a-d297-4af8-8276-c7499b84d1ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:50.634161 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58184a-d297-4af8-8276-c7499b84d1ea None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:50.649622 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 386/769] 10.222.0.61 () {56 vars in 1124 bytes} [Sat May 14 15:33:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:50.651976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58184a-d297-4af8-8276-c7499b84d1ea None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:50.740494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4685431-2965-4b51-91f4-c0624a7a99ad None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:50.780736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d95a4-b45e-4c31-a8d0-9dbb3b2a5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:50.781404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d95a4-b45e-4c31-a8d0-9dbb3b2a5fb7 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:50.781687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d95a4-b45e-4c31-a8d0-9dbb3b2a5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:50.781961 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d95a4-b45e-4c31-a8d0-9dbb3b2a5fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:50.782826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d95a4-b45e-4c31-a8d0-9dbb3b2a5fb7 None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=579cb64ce191482eb4ae03d099e8635d) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:50.783132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d95a4-b45e-4c31-a8d0-9dbb3b2a5fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:50.784557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d95a4-b45e-4c31-a8d0-9dbb3b2a5fb7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:50.795930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 384/770] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:50 2022] GET /identity/v3/role_assignments?user.id=579cb64ce191482eb4ae03d099e8635d&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:50.855505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58184a-d297-4af8-8276-c7499b84d1ea None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:50.911446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffd80b-8e45-4f71-9c3a-0664de8480a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:50.912127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffd80b-8e45-4f71-9c3a-0664de8480a9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:50.912412 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffd80b-8e45-4f71-9c3a-0664de8480a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:50.912691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffd80b-8e45-4f71-9c3a-0664de8480a9 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:50.913410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffd80b-8e45-4f71-9c3a-0664de8480a9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:50.913850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffd80b-8e45-4f71-9c3a-0664de8480a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:50.916008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffd80b-8e45-4f71-9c3a-0664de8480a9 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:50.928103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 387/771] 10.222.0.61 () {56 vars in 1124 bytes} [Sat May 14 15:33:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:50.935373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d95a4-b45e-4c31-a8d0-9dbb3b2a5fb7 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:51.067897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d95a4-b45e-4c31-a8d0-9dbb3b2a5fb7 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:51.118732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6897e-ab53-4c93-a7ca-68bcb0735333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:51.119325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6897e-ab53-4c93-a7ca-68bcb0735333 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:51.119619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6897e-ab53-4c93-a7ca-68bcb0735333 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:51.119901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6897e-ab53-4c93-a7ca-68bcb0735333 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:51.120705 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6897e-ab53-4c93-a7ca-68bcb0735333 None admin] RBAC: Adding query filter params (interface=public, service_id=16bb5d994c3c4bf6bb58c9f91efbe5c9, region_id=RegionOne) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:51.121014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6897e-ab53-4c93-a7ca-68bcb0735333 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:51.122412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6897e-ab53-4c93-a7ca-68bcb0735333 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:51.136665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 385/772] 10.222.0.61 () {56 vars in 1251 bytes} [Sat May 14 15:33:50 2022] GET /identity/v3/endpoints?service_id=16bb5d994c3c4bf6bb58c9f91efbe5c9&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:51.142396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffd80b-8e45-4f71-9c3a-0664de8480a9 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:51.237358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575a2f4-5045-44cb-b8e1-55ab90c42142 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:51.237700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575a2f4-5045-44cb-b8e1-55ab90c42142 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:51.237911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575a2f4-5045-44cb-b8e1-55ab90c42142 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:51.239468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 386/773] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:51.246482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50d9f1-4fda-42b6-9810-b5d21b2e1be1 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:51.246819 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50d9f1-4fda-42b6-9810-b5d21b2e1be1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:51.247047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50d9f1-4fda-42b6-9810-b5d21b2e1be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:51.259221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffd80b-8e45-4f71-9c3a-0664de8480a9 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:51.277366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6f50d9f1-4fda-42b6-9810-b5d21b2e1be1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:51.278648 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6f50d9f1-4fda-42b6-9810-b5d21b2e1be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:51.320820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5875f68-13b9-4715-b84d-428adcedd5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:51.321757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5875f68-13b9-4715-b84d-428adcedd5b8 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:51.321757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5875f68-13b9-4715-b84d-428adcedd5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:51.322036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5875f68-13b9-4715-b84d-428adcedd5b8 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:51.322767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5875f68-13b9-4715-b84d-428adcedd5b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:51.324139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5875f68-13b9-4715-b84d-428adcedd5b8 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:51.336036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 388/774] 10.222.0.61 () {56 vars in 1087 bytes} [Sat May 14 15:33:51 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:51.377088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 387/775] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:33:51.412471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5875f68-13b9-4715-b84d-428adcedd5b8 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:51.556819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5875f68-13b9-4715-b84d-428adcedd5b8 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:51.600405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e5c03-b3c3-49e0-8aec-57de1cc6de00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:51.601269 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e5c03-b3c3-49e0-8aec-57de1cc6de00 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:51.601731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e5c03-b3c3-49e0-8aec-57de1cc6de00 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:51.601979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e5c03-b3c3-49e0-8aec-57de1cc6de00 None admin] PATH_INFO: `/v3/services/network` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:51.603087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e5c03-b3c3-49e0-8aec-57de1cc6de00 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:51.604460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e5c03-b3c3-49e0-8aec-57de1cc6de00 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-572e5c03-b3c3-49e0-8aec-57de1cc6de00 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:51.619652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:51.620720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:51.622085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 389/776] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:51 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:51.632688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50d9f1-4fda-42b6-9810-b5d21b2e1be1 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:51.734113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dfc82-5050-48d2-a913-d2a645cd6160 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:51.734446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dfc82-5050-48d2-a913-d2a645cd6160 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:51.734691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966dfc82-5050-48d2-a913-d2a645cd6160 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:51.736305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 390/777] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:51.741345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ddde1-8e3f-4b3c-a3cd-f1f1270c59ce None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:51.741626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ddde1-8e3f-4b3c-a3cd-f1f1270c59ce None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:51.741983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ddde1-8e3f-4b3c-a3cd-f1f1270c59ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:51.759599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50d9f1-4fda-42b6-9810-b5d21b2e1be1 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:51.765933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-487ddde1-8e3f-4b3c-a3cd-f1f1270c59ce None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:51.768261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-487ddde1-8e3f-4b3c-a3cd-f1f1270c59ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:51.795392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a1ae9-0f57-459a-a0eb-6e7031ab3c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:51.796065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a1ae9-0f57-459a-a0eb-6e7031ab3c8a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:51.796353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a1ae9-0f57-459a-a0eb-6e7031ab3c8a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:51.796628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a1ae9-0f57-459a-a0eb-6e7031ab3c8a None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:51.797343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a1ae9-0f57-459a-a0eb-6e7031ab3c8a None admin] RBAC: Adding query filter params (name=network) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:51.797652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a1ae9-0f57-459a-a0eb-6e7031ab3c8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:51.799053 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a1ae9-0f57-459a-a0eb-6e7031ab3c8a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:51.804243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 388/778] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:33:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:51.809656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a1ae9-0f57-459a-a0eb-6e7031ab3c8a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:51.850328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 391/779] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:33:51.893168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ddde1-8e3f-4b3c-a3cd-f1f1270c59ce None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:51.911992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a1ae9-0f57-459a-a0eb-6e7031ab3c8a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:51.947400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e070f-e8e9-4697-a00b-e1c6b7697efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:51.947909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e070f-e8e9-4697-a00b-e1c6b7697efb None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:51.948225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e070f-e8e9-4697-a00b-e1c6b7697efb None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:51.948495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e070f-e8e9-4697-a00b-e1c6b7697efb None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:51.949166 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e070f-e8e9-4697-a00b-e1c6b7697efb None admin] RBAC: Adding query filter params (type=network) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:51.949469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e070f-e8e9-4697-a00b-e1c6b7697efb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:51.950868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e070f-e8e9-4697-a00b-e1c6b7697efb None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:51.956180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 389/780] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:33:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:51.961586 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e070f-e8e9-4697-a00b-e1c6b7697efb None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:52.073514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e070f-e8e9-4697-a00b-e1c6b7697efb None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:52.111113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3afe7b-69e6-4e67-bd9c-d07911e440f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:52.111779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3afe7b-69e6-4e67-bd9c-d07911e440f3 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:52.112064 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3afe7b-69e6-4e67-bd9c-d07911e440f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:52.112348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3afe7b-69e6-4e67-bd9c-d07911e440f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:52.113298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3afe7b-69e6-4e67-bd9c-d07911e440f3 None admin] RBAC: Adding query filter params (interface=public, service_id=87fc74b7d82a47b19dc32090654e5374, region_id=RegionOne) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:52.113611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3afe7b-69e6-4e67-bd9c-d07911e440f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:52.115321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3afe7b-69e6-4e67-bd9c-d07911e440f3 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:52.121282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 390/781] 10.222.0.61 () {56 vars in 1251 bytes} [Sat May 14 15:33:51 2022] GET /identity/v3/endpoints?service_id=87fc74b7d82a47b19dc32090654e5374&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:52.123356 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ddde1-8e3f-4b3c-a3cd-f1f1270c59ce None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:52.130982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3afe7b-69e6-4e67-bd9c-d07911e440f3 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:52.200647 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09491069-caa7-4303-992d-0f352033decf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:52.201786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09491069-caa7-4303-992d-0f352033decf None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:52.202282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09491069-caa7-4303-992d-0f352033decf None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:52.202771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09491069-caa7-4303-992d-0f352033decf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:52.232444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09491069-caa7-4303-992d-0f352033decf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:52.238762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3afe7b-69e6-4e67-bd9c-d07911e440f3 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-09491069-caa7-4303-992d-0f352033decf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:52.250333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:52.251278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:52.252114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:52.253510 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 392/782] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:52.257670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09491069-caa7-4303-992d-0f352033decf None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:52.303028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94188501-6e18-4ff5-942b-c068c5df0cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:52.304066 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94188501-6e18-4ff5-942b-c068c5df0cc7 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:52.305149 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94188501-6e18-4ff5-942b-c068c5df0cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:52.305803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94188501-6e18-4ff5-942b-c068c5df0cc7 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:52.306759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94188501-6e18-4ff5-942b-c068c5df0cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:52.308312 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94188501-6e18-4ff5-942b-c068c5df0cc7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:52.319116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 391/783] 10.222.0.61 () {56 vars in 1087 bytes} [Sat May 14 15:33:52 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:52.380581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09491069-caa7-4303-992d-0f352033decf None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:52.420547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807e318-856b-44c0-a7d4-7e663e97da93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:52.421235 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807e318-856b-44c0-a7d4-7e663e97da93 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:52.421517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807e318-856b-44c0-a7d4-7e663e97da93 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:52.421792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807e318-856b-44c0-a7d4-7e663e97da93 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:52.422649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807e318-856b-44c0-a7d4-7e663e97da93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:52.422964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807e318-856b-44c0-a7d4-7e663e97da93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:52.424385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807e318-856b-44c0-a7d4-7e663e97da93 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:52.434976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 393/784] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:52.440480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94188501-6e18-4ff5-942b-c068c5df0cc7 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:52.568696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48e18-34d1-4785-b4c2-76ce61e07a15 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:52.569042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48e18-34d1-4785-b4c2-76ce61e07a15 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:52.569256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48e18-34d1-4785-b4c2-76ce61e07a15 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:52.571565 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 394/785] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:52.576875 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436fe7e-3493-40ad-ab06-9c34f08db4b3 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:52.577446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436fe7e-3493-40ad-ab06-9c34f08db4b3 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:52.577727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436fe7e-3493-40ad-ab06-9c34f08db4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:52.603464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f436fe7e-3493-40ad-ab06-9c34f08db4b3 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:52.604392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94188501-6e18-4ff5-942b-c068c5df0cc7 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:52.604647 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f436fe7e-3493-40ad-ab06-9c34f08db4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:52.639282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba9dee-e8da-489e-9ee5-1095c5c2b4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:52.640426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9dee-e8da-489e-9ee5-1095c5c2b4fa None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:52.640904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9dee-e8da-489e-9ee5-1095c5c2b4fa None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:52.641386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba9dee-e8da-489e-9ee5-1095c5c2b4fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:52.652998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba9dee-e8da-489e-9ee5-1095c5c2b4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:52.654815 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba9dee-e8da-489e-9ee5-1095c5c2b4fa None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-59ba9dee-e8da-489e-9ee5-1095c5c2b4fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:52.672817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:52.673713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:52.674620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:52.674620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:52.674620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:52.674620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:52.676877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 392/786] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:52.686100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba9dee-e8da-489e-9ee5-1095c5c2b4fa None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:52.740629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 395/787] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:33:52.780468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436fe7e-3493-40ad-ab06-9c34f08db4b3 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:52.786177 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba9dee-e8da-489e-9ee5-1095c5c2b4fa None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:52.819643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee3b20-90c7-4d93-8c9d-83f170b78910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:52.821314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee3b20-90c7-4d93-8c9d-83f170b78910 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:52.821794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee3b20-90c7-4d93-8c9d-83f170b78910 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:52.822259 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee3b20-90c7-4d93-8c9d-83f170b78910 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:52.823204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee3b20-90c7-4d93-8c9d-83f170b78910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:52.823697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee3b20-90c7-4d93-8c9d-83f170b78910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:52.825437 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee3b20-90c7-4d93-8c9d-83f170b78910 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:52.839094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 393/788] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:52.845036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee3b20-90c7-4d93-8c9d-83f170b78910 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:52.919618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436fe7e-3493-40ad-ab06-9c34f08db4b3 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:52.956473 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bb9bd-88ed-4292-bcc3-8f90171032bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:52.957268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb9bd-88ed-4292-bcc3-8f90171032bd None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:52.957546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb9bd-88ed-4292-bcc3-8f90171032bd None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:52.958092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447bb9bd-88ed-4292-bcc3-8f90171032bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:52.969259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447bb9bd-88ed-4292-bcc3-8f90171032bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-447bb9bd-88ed-4292-bcc3-8f90171032bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:52.977614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:52.978903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:52.979743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:52.980367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 396/789] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:52.986231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bb9bd-88ed-4292-bcc3-8f90171032bd None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:53.065054 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee3b20-90c7-4d93-8c9d-83f170b78910 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:53.103732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259feb2-f242-43d8-887f-ce730e942e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:53.104860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259feb2-f242-43d8-887f-ce730e942e7f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:53.105337 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259feb2-f242-43d8-887f-ce730e942e7f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:53.105818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259feb2-f242-43d8-887f-ce730e942e7f None admin] PATH_INFO: `/v3/users/swift` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:53.113461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259feb2-f242-43d8-887f-ce730e942e7f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:53.115212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259feb2-f242-43d8-887f-ce730e942e7f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-7259feb2-f242-43d8-887f-ce730e942e7f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:53.130023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:53.131014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:53.131957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:53.131957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:53.131957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:53.131957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:53.131957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:53.131957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:53.131957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:53.131957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:53.131957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:53.131957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:53.134660 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 394/790] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:53.136872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447bb9bd-88ed-4292-bcc3-8f90171032bd None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:53.139945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259feb2-f242-43d8-887f-ce730e942e7f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:53.211083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0a87f-e1f6-49c4-a9a3-0a95fe7f37eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:53.212125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0a87f-e1f6-49c4-a9a3-0a95fe7f37eb None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:53.212598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0a87f-e1f6-49c4-a9a3-0a95fe7f37eb None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:53.213086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0a87f-e1f6-49c4-a9a3-0a95fe7f37eb None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:53.214027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0a87f-e1f6-49c4-a9a3-0a95fe7f37eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:53.214549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0a87f-e1f6-49c4-a9a3-0a95fe7f37eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:53.216099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0a87f-e1f6-49c4-a9a3-0a95fe7f37eb None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:53.236002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 397/791] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:53.241427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0a87f-e1f6-49c4-a9a3-0a95fe7f37eb None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:53.294645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259feb2-f242-43d8-887f-ce730e942e7f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:53.334928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdf0c6-90e7-4712-9cf9-efa97ecb82d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:53.336225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdf0c6-90e7-4712-9cf9-efa97ecb82d4 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:53.336511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdf0c6-90e7-4712-9cf9-efa97ecb82d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:53.336788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdf0c6-90e7-4712-9cf9-efa97ecb82d4 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:53.337631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdf0c6-90e7-4712-9cf9-efa97ecb82d4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:53.337936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdf0c6-90e7-4712-9cf9-efa97ecb82d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:53.339399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdf0c6-90e7-4712-9cf9-efa97ecb82d4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:53.370902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 395/792] 10.222.0.61 () {56 vars in 1135 bytes} [Sat May 14 15:33:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:53.376441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdf0c6-90e7-4712-9cf9-efa97ecb82d4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:53.411726 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0a87f-e1f6-49c4-a9a3-0a95fe7f37eb None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:53.472134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6113fe-4c2f-4b8d-a7f7-4b0c078dac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:53.473278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6113fe-4c2f-4b8d-a7f7-4b0c078dac10 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:53.473785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6113fe-4c2f-4b8d-a7f7-4b0c078dac10 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:53.474259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6113fe-4c2f-4b8d-a7f7-4b0c078dac10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:53.493891 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6113fe-4c2f-4b8d-a7f7-4b0c078dac10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:53.497429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6113fe-4c2f-4b8d-a7f7-4b0c078dac10 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-1d6113fe-4c2f-4b8d-a7f7-4b0c078dac10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:53.541344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:53.542338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:53.543254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:53.543254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:53.543254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:53.543254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:53.547407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 398/793] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:53.552959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6113fe-4c2f-4b8d-a7f7-4b0c078dac10 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:53.566510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdf0c6-90e7-4712-9cf9-efa97ecb82d4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:53.623147 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b60469-47a6-4b5d-ac1e-4bf9ea8dafc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:53.624318 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b60469-47a6-4b5d-ac1e-4bf9ea8dafc0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:53.624793 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b60469-47a6-4b5d-ac1e-4bf9ea8dafc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:53.625249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b60469-47a6-4b5d-ac1e-4bf9ea8dafc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:53.643252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b60469-47a6-4b5d-ac1e-4bf9ea8dafc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:53.644698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b60469-47a6-4b5d-ac1e-4bf9ea8dafc0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-44b60469-47a6-4b5d-ac1e-4bf9ea8dafc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:53.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:53.684219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:53.685125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:53.685125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:53.685125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:53.685125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:53.685820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 396/794] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:53.691528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b60469-47a6-4b5d-ac1e-4bf9ea8dafc0 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:53.720625 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6113fe-4c2f-4b8d-a7f7-4b0c078dac10 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:53.756671 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d34b20-e2e8-4d5c-80a4-a84254dd5a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:53.757433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34b20-e2e8-4d5c-80a4-a84254dd5a75 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:53.757779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34b20-e2e8-4d5c-80a4-a84254dd5a75 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:53.758055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d34b20-e2e8-4d5c-80a4-a84254dd5a75 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:53.758965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d34b20-e2e8-4d5c-80a4-a84254dd5a75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:53.759273 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d34b20-e2e8-4d5c-80a4-a84254dd5a75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:53.760647 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d34b20-e2e8-4d5c-80a4-a84254dd5a75 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:53.773634 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 399/795] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:53.775354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30cfd2-fbd6-4ae0-86fa-06a67ec7d1ad None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:53.775641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30cfd2-fbd6-4ae0-86fa-06a67ec7d1ad None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:53.775919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30cfd2-fbd6-4ae0-86fa-06a67ec7d1ad None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:53.781254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 400/796] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:53.782060 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30cfd2-fbd6-4ae0-86fa-06a67ec7d1ad None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:53.803415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b60469-47a6-4b5d-ac1e-4bf9ea8dafc0 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:53.846363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315d1a5-2fa0-49ff-ac14-45bb5c861aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:53.846363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315d1a5-2fa0-49ff-ac14-45bb5c861aab None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:53.846363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315d1a5-2fa0-49ff-ac14-45bb5c861aab None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:53.846363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315d1a5-2fa0-49ff-ac14-45bb5c861aab None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:53.847289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315d1a5-2fa0-49ff-ac14-45bb5c861aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:53.847289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315d1a5-2fa0-49ff-ac14-45bb5c861aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:53.847289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315d1a5-2fa0-49ff-ac14-45bb5c861aab None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:53.855455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 397/797] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:53.856723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac3542-3ecb-4910-aa1b-af80ee469748 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:53.857013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac3542-3ecb-4910-aa1b-af80ee469748 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:53.857288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac3542-3ecb-4910-aa1b-af80ee469748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:53.873462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-4fac3542-3ecb-4910-aa1b-af80ee469748 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:53.874609 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4fac3542-3ecb-4910-aa1b-af80ee469748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:53.887272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30cfd2-fbd6-4ae0-86fa-06a67ec7d1ad None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:53.921918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0db25f-cfdf-40e1-9e92-6354c87659c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:53.922774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0db25f-cfdf-40e1-9e92-6354c87659c0 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:53.923035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0db25f-cfdf-40e1-9e92-6354c87659c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:53.923306 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0db25f-cfdf-40e1-9e92-6354c87659c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:53.931168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0db25f-cfdf-40e1-9e92-6354c87659c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:53.932616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0db25f-cfdf-40e1-9e92-6354c87659c0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:53.943468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 398/798] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:33:53.944319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac3542-3ecb-4910-aa1b-af80ee469748 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-4c0db25f-cfdf-40e1-9e92-6354c87659c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:53.954008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:53.954991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:53.955928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:53.955928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:53.955928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:53.955928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:53.955928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:53.955928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:53.955928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:53.955928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:53.955928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 15:33:53.955928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:53.955928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 401/799] 10.222.0.61 () {56 vars in 1093 bytes} [Sat May 14 15:33:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:53.960682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0db25f-cfdf-40e1-9e92-6354c87659c0 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:54.043408 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac3542-3ecb-4910-aa1b-af80ee469748 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:54.072954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0db25f-cfdf-40e1-9e92-6354c87659c0 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:54.077297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a917bb-d6b3-4610-adca-c928c44938cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:54.078283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a917bb-d6b3-4610-adca-c928c44938cd None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.078589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a917bb-d6b3-4610-adca-c928c44938cd None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.078858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a917bb-d6b3-4610-adca-c928c44938cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.086979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a917bb-d6b3-4610-adca-c928c44938cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:54.088464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a917bb-d6b3-4610-adca-c928c44938cd None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-15a917bb-d6b3-4610-adca-c928c44938cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:54.103954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:54.105983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:54.108190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:54.108190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:54.108190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:54.108190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:54.108190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:54.108190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:54.108190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:54.108190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:54.108190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 399/800] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:54.108190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a917bb-d6b3-4610-adca-c928c44938cd None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:54.113063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b5523-c505-409f-a59c-2926e80deadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:54.113744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b5523-c505-409f-a59c-2926e80deadb None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.114026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b5523-c505-409f-a59c-2926e80deadb None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.114301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b5523-c505-409f-a59c-2926e80deadb None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.115184 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b5523-c505-409f-a59c-2926e80deadb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:54.115491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b5523-c505-409f-a59c-2926e80deadb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:54.117594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b5523-c505-409f-a59c-2926e80deadb None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:54.136114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 402/801] 10.222.0.61 () {56 vars in 1133 bytes} [Sat May 14 15:33:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:54.136993 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b5523-c505-409f-a59c-2926e80deadb None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:54.206401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a917bb-d6b3-4610-adca-c928c44938cd None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:54.236222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b5523-c505-409f-a59c-2926e80deadb None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:54.240455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeba03-ba41-415b-b5fa-471aedaa6c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:54.241254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeba03-ba41-415b-b5fa-471aedaa6c3b None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.241531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeba03-ba41-415b-b5fa-471aedaa6c3b None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.241842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeba03-ba41-415b-b5fa-471aedaa6c3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.252208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eeba03-ba41-415b-b5fa-471aedaa6c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-b7eeba03-ba41-415b-b5fa-471aedaa6c3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:54.260498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:54.262634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 400/802] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:54.264613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeba03-ba41-415b-b5fa-471aedaa6c3b None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:54.275878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad008ee2-b424-4d53-9255-255f216db5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:54.276545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad008ee2-b424-4d53-9255-255f216db5bd None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.276881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad008ee2-b424-4d53-9255-255f216db5bd None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.277159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad008ee2-b424-4d53-9255-255f216db5bd None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.278005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad008ee2-b424-4d53-9255-255f216db5bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:54.278332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad008ee2-b424-4d53-9255-255f216db5bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:54.279767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad008ee2-b424-4d53-9255-255f216db5bd None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:54.293184 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 403/803] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:54.294166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad008ee2-b424-4d53-9255-255f216db5bd None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:54.371388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeba03-ba41-415b-b5fa-471aedaa6c3b None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:54.399301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad008ee2-b424-4d53-9255-255f216db5bd None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:54.405177 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01b2bb-1536-4ae0-b362-3d56da9c7194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:54.405832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01b2bb-1536-4ae0-b362-3d56da9c7194 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.406113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01b2bb-1536-4ae0-b362-3d56da9c7194 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.406414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01b2bb-1536-4ae0-b362-3d56da9c7194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.435232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b6566-d697-4cb1-bb7f-8165723ee161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:54.435925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6566-d697-4cb1-bb7f-8165723ee161 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.436222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6566-d697-4cb1-bb7f-8165723ee161 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.436478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6566-d697-4cb1-bb7f-8165723ee161 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.437227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b6566-d697-4cb1-bb7f-8165723ee161 None admin] RBAC: Adding query filter params (name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:54.437537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b6566-d697-4cb1-bb7f-8165723ee161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:54.438932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b6566-d697-4cb1-bb7f-8165723ee161 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:54.447664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 404/804] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:54.451669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbedb4-06a5-452b-ba2b-22a3fc0ec1e7 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.452195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbedb4-06a5-452b-ba2b-22a3fc0ec1e7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.452300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbedb4-06a5-452b-ba2b-22a3fc0ec1e7 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.453486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 405/805] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:54.454157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbedb4-06a5-452b-ba2b-22a3fc0ec1e7 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:54.482579 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01b2bb-1536-4ae0-b362-3d56da9c7194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:54.484031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01b2bb-1536-4ae0-b362-3d56da9c7194 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:54.557824 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbedb4-06a5-452b-ba2b-22a3fc0ec1e7 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:54.583509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 401/806] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:33:54.584191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01b2bb-1536-4ae0-b362-3d56da9c7194 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:54.595362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784c04e-2f4e-45dd-a6e5-16f7ef64a183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:54.596594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784c04e-2f4e-45dd-a6e5-16f7ef64a183 None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.597023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784c04e-2f4e-45dd-a6e5-16f7ef64a183 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.597443 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784c04e-2f4e-45dd-a6e5-16f7ef64a183 None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/1713718ff95744b9bd42f21d4ec8bb91/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.599588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784c04e-2f4e-45dd-a6e5-16f7ef64a183 None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=1713718ff95744b9bd42f21d4ec8bb91, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:54.601814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784c04e-2f4e-45dd-a6e5-16f7ef64a183 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:54.616395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 406/807] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:33:54 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/1713718ff95744b9bd42f21d4ec8bb91/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:54.618058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a6ad-b0df-42bf-8e5d-7a53b9f2daa9 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.618361 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a6ad-b0df-42bf-8e5d-7a53b9f2daa9 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.618644 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a6ad-b0df-42bf-8e5d-7a53b9f2daa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.642156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-1f10a6ad-b0df-42bf-8e5d-7a53b9f2daa9 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:54.643439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1f10a6ad-b0df-42bf-8e5d-7a53b9f2daa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:54.697431 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01b2bb-1536-4ae0-b362-3d56da9c7194 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:54.739944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7493722-89ba-487d-9146-7a021d27057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:54.741028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7493722-89ba-487d-9146-7a021d27057c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.741541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7493722-89ba-487d-9146-7a021d27057c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.742135 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7493722-89ba-487d-9146-7a021d27057c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.746706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 407/808] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:33:54.747714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a6ad-b0df-42bf-8e5d-7a53b9f2daa9 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:54.754687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7493722-89ba-487d-9146-7a021d27057c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:54.756417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7493722-89ba-487d-9146-7a021d27057c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-a7493722-89ba-487d-9146-7a021d27057c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:54.780917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:54.782086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:54.783131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:54.783131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:54.783131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:54.783131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:54.784817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 402/809] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:54.785678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7493722-89ba-487d-9146-7a021d27057c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:54.884268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a6ad-b0df-42bf-8e5d-7a53b9f2daa9 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:54.912106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7493722-89ba-487d-9146-7a021d27057c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:54.918373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ee040-a29f-4f94-9f75-78435ff52a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:54.919170 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee040-a29f-4f94-9f75-78435ff52a16 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.919449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee040-a29f-4f94-9f75-78435ff52a16 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.919720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ee040-a29f-4f94-9f75-78435ff52a16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.931467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ee040-a29f-4f94-9f75-78435ff52a16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:54.933668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ee040-a29f-4f94-9f75-78435ff52a16 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:54.948279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30efad-edb6-41c6-82ee-d99830490388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:54.949026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30efad-edb6-41c6-82ee-d99830490388 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.949309 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30efad-edb6-41c6-82ee-d99830490388 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.949589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30efad-edb6-41c6-82ee-d99830490388 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.950243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30efad-edb6-41c6-82ee-d99830490388 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:54.951635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30efad-edb6-41c6-82ee-d99830490388 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-1a7ee040-a29f-4f94-9f75-78435ff52a16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:54.953225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:54.954301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:54.955252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:54.955252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:54.955252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:54.955252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:54.955252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 408/810] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:54.955811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ee040-a29f-4f94-9f75-78435ff52a16 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-bb30efad-edb6-41c6-82ee-d99830490388 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:54.969528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:54.970549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:54.971973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 403/811] 10.222.0.61 () {56 vars in 1129 bytes} [Sat May 14 15:33:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:54.972834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f5c9-cb12-42bc-a37f-ba3498283d11 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:54.972834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f5c9-cb12-42bc-a37f-ba3498283d11 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:54.972834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f5c9-cb12-42bc-a37f-ba3498283d11 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:54.976723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 404/812] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:54.978806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f5c9-cb12-42bc-a37f-ba3498283d11 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.065685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ee040-a29f-4f94-9f75-78435ff52a16 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:55.078450 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f5c9-cb12-42bc-a37f-ba3498283d11 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:55.099402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58146a-2a8b-4fbc-b5b5-ee149e5f9646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:55.100063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58146a-2a8b-4fbc-b5b5-ee149e5f9646 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.100343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58146a-2a8b-4fbc-b5b5-ee149e5f9646 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.100619 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58146a-2a8b-4fbc-b5b5-ee149e5f9646 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.101925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58146a-2a8b-4fbc-b5b5-ee149e5f9646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:55.102230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58146a-2a8b-4fbc-b5b5-ee149e5f9646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:55.103875 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58146a-2a8b-4fbc-b5b5-ee149e5f9646 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:55.113644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a624c23-12bc-469d-a56d-b95b4ee49a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:55.114330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624c23-12bc-469d-a56d-b95b4ee49a07 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.114630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624c23-12bc-469d-a56d-b95b4ee49a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.114907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a624c23-12bc-469d-a56d-b95b4ee49a07 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.119892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 409/813] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:55.120045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624c23-12bc-469d-a56d-b95b4ee49a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:55.120045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624c23-12bc-469d-a56d-b95b4ee49a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:55.120183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58146a-2a8b-4fbc-b5b5-ee149e5f9646 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.120268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a624c23-12bc-469d-a56d-b95b4ee49a07 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:55.134268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 405/814] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:55.134268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b9ad-91ac-42fa-a4b2-402cb3c12e0d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.134268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b9ad-91ac-42fa-a4b2-402cb3c12e0d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.134268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b9ad-91ac-42fa-a4b2-402cb3c12e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.148457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-1434b9ad-91ac-42fa-a4b2-402cb3c12e0d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:55.149630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1434b9ad-91ac-42fa-a4b2-402cb3c12e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:55.230414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 406/815] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:33:55.230414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434b9ad-91ac-42fa-a4b2-402cb3c12e0d None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.237617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58146a-2a8b-4fbc-b5b5-ee149e5f9646 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:55.275071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed309ac-3727-428f-a695-6051a57a168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:55.275745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed309ac-3727-428f-a695-6051a57a168e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.276027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed309ac-3727-428f-a695-6051a57a168e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.276303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed309ac-3727-428f-a695-6051a57a168e None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.277005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed309ac-3727-428f-a695-6051a57a168e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:55.277309 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed309ac-3727-428f-a695-6051a57a168e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:55.278687 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed309ac-3727-428f-a695-6051a57a168e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:55.283222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 410/816] 10.222.0.61 () {56 vars in 1124 bytes} [Sat May 14 15:33:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:55.283816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed309ac-3727-428f-a695-6051a57a168e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.327020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434b9ad-91ac-42fa-a4b2-402cb3c12e0d None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:55.359453 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75a8b5-974c-4506-a592-e6325035d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:55.360260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75a8b5-974c-4506-a592-e6325035d9b8 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.360543 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75a8b5-974c-4506-a592-e6325035d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.360813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75a8b5-974c-4506-a592-e6325035d9b8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.368477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75a8b5-974c-4506-a592-e6325035d9b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:55.369907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75a8b5-974c-4506-a592-e6325035d9b8 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:55.383099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed309ac-3727-428f-a695-6051a57a168e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-4a75a8b5-974c-4506-a592-e6325035d9b8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:55.385488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:55.386479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 407/817] 10.222.0.61 () {56 vars in 1117 bytes} [Sat May 14 15:33:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:55.392455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75a8b5-974c-4506-a592-e6325035d9b8 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.417493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c6fd0-125f-44cb-a0d0-f2be4b428297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:55.418299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c6fd0-125f-44cb-a0d0-f2be4b428297 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.418612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c6fd0-125f-44cb-a0d0-f2be4b428297 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.418894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c6fd0-125f-44cb-a0d0-f2be4b428297 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.425715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c6fd0-125f-44cb-a0d0-f2be4b428297 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:55.427190 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c6fd0-125f-44cb-a0d0-f2be4b428297 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-c12c6fd0-125f-44cb-a0d0-f2be4b428297 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:55.441926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:55.443072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:55.449383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:55.449383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:55.449383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:55.449383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:55.449383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:55.449383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:55.449383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:55.449383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:55.449383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 411/818] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:55.449383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c6fd0-125f-44cb-a0d0-f2be4b428297 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.497379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75a8b5-974c-4506-a592-e6325035d9b8 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:55.530809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f5550-3c33-4b0f-8631-b87eb839c416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:55.531763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5550-3c33-4b0f-8631-b87eb839c416 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.532059 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5550-3c33-4b0f-8631-b87eb839c416 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.532315 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5550-3c33-4b0f-8631-b87eb839c416 None admin] PATH_INFO: `/v3/services/network` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.532972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f5550-3c33-4b0f-8631-b87eb839c416 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:55.534357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f5550-3c33-4b0f-8631-b87eb839c416 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-c86f5550-3c33-4b0f-8631-b87eb839c416 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:55.546547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:55.547563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 14 15:33:55.553434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:55.554216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c6fd0-125f-44cb-a0d0-f2be4b428297 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:55.554336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 408/819] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:55 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:55.554336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f5550-3c33-4b0f-8631-b87eb839c416 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.581670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e382-79ca-45bc-b80d-a3249aadf998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:55.582363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e382-79ca-45bc-b80d-a3249aadf998 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.582698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e382-79ca-45bc-b80d-a3249aadf998 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.582971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e382-79ca-45bc-b80d-a3249aadf998 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.583669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1e382-79ca-45bc-b80d-a3249aadf998 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:55.583977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1e382-79ca-45bc-b80d-a3249aadf998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:55.585319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1e382-79ca-45bc-b80d-a3249aadf998 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:55.590534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 412/820] 10.222.0.61 () {56 vars in 1124 bytes} [Sat May 14 15:33:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:55.591303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e382-79ca-45bc-b80d-a3249aadf998 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.653473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f5550-3c33-4b0f-8631-b87eb839c416 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:55.685184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362e32-0bbd-4b43-a0d2-3b81d3bb8d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:55.686095 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362e32-0bbd-4b43-a0d2-3b81d3bb8d8a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.686557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362e32-0bbd-4b43-a0d2-3b81d3bb8d8a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.686829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362e32-0bbd-4b43-a0d2-3b81d3bb8d8a None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.687652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd362e32-0bbd-4b43-a0d2-3b81d3bb8d8a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:55.687952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd362e32-0bbd-4b43-a0d2-3b81d3bb8d8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:55.689257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e382-79ca-45bc-b80d-a3249aadf998 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:55.689380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd362e32-0bbd-4b43-a0d2-3b81d3bb8d8a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:55.707226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 409/821] 10.222.0.61 () {56 vars in 1149 bytes} [Sat May 14 15:33:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:55.708050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362e32-0bbd-4b43-a0d2-3b81d3bb8d8a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.732257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5975-9cd2-41cc-b554-0102a8116b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:55.732914 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5975-9cd2-41cc-b554-0102a8116b84 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.733193 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5975-9cd2-41cc-b554-0102a8116b84 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.733462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e5975-9cd2-41cc-b554-0102a8116b84 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.734248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e5975-9cd2-41cc-b554-0102a8116b84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:55.734579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e5975-9cd2-41cc-b554-0102a8116b84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:55.736029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e5975-9cd2-41cc-b554-0102a8116b84 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:55.752301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 413/822] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:55.752301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5975-9cd2-41cc-b554-0102a8116b84 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.808560 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362e32-0bbd-4b43-a0d2-3b81d3bb8d8a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:55.846448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ade4b-1e6b-4246-802e-b3ad31719284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:55.847111 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ade4b-1e6b-4246-802e-b3ad31719284 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.847390 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ade4b-1e6b-4246-802e-b3ad31719284 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.847660 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ade4b-1e6b-4246-802e-b3ad31719284 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.848358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ade4b-1e6b-4246-802e-b3ad31719284 None admin] RBAC: Adding query filter params (name=network) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:55.848655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ade4b-1e6b-4246-802e-b3ad31719284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:55.850002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ade4b-1e6b-4246-802e-b3ad31719284 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:55.855590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 410/823] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:33:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:55.860357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e5975-9cd2-41cc-b554-0102a8116b84 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:55.860911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ade4b-1e6b-4246-802e-b3ad31719284 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.895858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853cb29-36d5-4ecf-b5e2-eca4f6235c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:55.896527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853cb29-36d5-4ecf-b5e2-eca4f6235c6e None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:55.896811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853cb29-36d5-4ecf-b5e2-eca4f6235c6e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:55.897085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853cb29-36d5-4ecf-b5e2-eca4f6235c6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:55.897891 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853cb29-36d5-4ecf-b5e2-eca4f6235c6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:55.899340 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853cb29-36d5-4ecf-b5e2-eca4f6235c6e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:55.921707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 414/824] 10.222.0.61 () {60 vars in 1144 bytes} [Sat May 14 15:33:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:33:55.923024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853cb29-36d5-4ecf-b5e2-eca4f6235c6e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:55.977583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ade4b-1e6b-4246-802e-b3ad31719284 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:56.029172 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351f95e-34c8-4110-994e-dac0af5ed019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:56.030000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351f95e-34c8-4110-994e-dac0af5ed019 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:56.030436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351f95e-34c8-4110-994e-dac0af5ed019 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:56.030777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351f95e-34c8-4110-994e-dac0af5ed019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:56.045897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351f95e-34c8-4110-994e-dac0af5ed019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:56.048306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351f95e-34c8-4110-994e-dac0af5ed019 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:56.057210 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853cb29-36d5-4ecf-b5e2-eca4f6235c6e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-2351f95e-34c8-4110-994e-dac0af5ed019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:56.071747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:56.072727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:56.073639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:56.073639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:56.073639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:56.073639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:56.077922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 411/825] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:56.078972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351f95e-34c8-4110-994e-dac0af5ed019 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:56.106725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade0c1b-5e20-4979-ad5a-58647a60bf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:56.108174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade0c1b-5e20-4979-ad5a-58647a60bf06 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:56.108897 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade0c1b-5e20-4979-ad5a-58647a60bf06 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:56.109368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade0c1b-5e20-4979-ad5a-58647a60bf06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:56.110570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade0c1b-5e20-4979-ad5a-58647a60bf06 None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=ebefa53d595b4e6486ce409f2ac47ff1) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:56.111340 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade0c1b-5e20-4979-ad5a-58647a60bf06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:56.113237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade0c1b-5e20-4979-ad5a-58647a60bf06 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:56.126496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 415/826] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:55 2022] GET /identity/v3/role_assignments?user.id=ebefa53d595b4e6486ce409f2ac47ff1&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:56.126496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade0c1b-5e20-4979-ad5a-58647a60bf06 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:56.204010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351f95e-34c8-4110-994e-dac0af5ed019 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:56.233586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade0c1b-5e20-4979-ad5a-58647a60bf06 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:56.242762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adb161-2575-4095-9917-fc9e322de3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:56.243244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adb161-2575-4095-9917-fc9e322de3ed None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:56.243528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adb161-2575-4095-9917-fc9e322de3ed None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:56.243805 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adb161-2575-4095-9917-fc9e322de3ed None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:56.244531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adb161-2575-4095-9917-fc9e322de3ed None admin] RBAC: Adding query filter params (type=network) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:56.244837 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adb161-2575-4095-9917-fc9e322de3ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:56.246477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adb161-2575-4095-9917-fc9e322de3ed None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:56.254521 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 412/827] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:33:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:56.258842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adb161-2575-4095-9917-fc9e322de3ed None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:56.280192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff319-d642-4c90-bb64-fb695dd89906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:56.280957 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff319-d642-4c90-bb64-fb695dd89906 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:56.281380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff319-d642-4c90-bb64-fb695dd89906 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:56.281752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff319-d642-4c90-bb64-fb695dd89906 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:56.282639 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff319-d642-4c90-bb64-fb695dd89906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:56.283049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff319-d642-4c90-bb64-fb695dd89906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:56.284571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff319-d642-4c90-bb64-fb695dd89906 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:56.302355 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 416/828] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:56.303875 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff319-d642-4c90-bb64-fb695dd89906 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:56.373782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adb161-2575-4095-9917-fc9e322de3ed None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:56.412054 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bea2f-fa6c-49fa-b8fa-144bfacb8e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:56.412973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bea2f-fa6c-49fa-b8fa-144bfacb8e81 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:56.413402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bea2f-fa6c-49fa-b8fa-144bfacb8e81 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:56.414487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bea2f-fa6c-49fa-b8fa-144bfacb8e81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:56.415547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bea2f-fa6c-49fa-b8fa-144bfacb8e81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:56.417213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bea2f-fa6c-49fa-b8fa-144bfacb8e81 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:56.423497 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff319-d642-4c90-bb64-fb695dd89906 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:56.441320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 413/829] 10.222.0.61 () {60 vars in 1144 bytes} [Sat May 14 15:33:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:33:56.479350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43051fe-f9b5-4dd8-9e8d-b36245eb57c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:56.480551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43051fe-f9b5-4dd8-9e8d-b36245eb57c5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:56.481069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43051fe-f9b5-4dd8-9e8d-b36245eb57c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:56.481545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43051fe-f9b5-4dd8-9e8d-b36245eb57c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:56.490164 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43051fe-f9b5-4dd8-9e8d-b36245eb57c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:56.492964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43051fe-f9b5-4dd8-9e8d-b36245eb57c5 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f43051fe-f9b5-4dd8-9e8d-b36245eb57c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:56.509176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:56.510195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:56.511118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:56.511118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:56.511118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:56.511118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:56.511118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:56.511118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:56.511118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:56.511118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:56.513875 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 417/830] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:56.519591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bea2f-fa6c-49fa-b8fa-144bfacb8e81 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:56.633984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bea2f-fa6c-49fa-b8fa-144bfacb8e81 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:56.669170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d62a0-f1f5-4f8f-b5b5-edce7eacbc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:56.670189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d62a0-f1f5-4f8f-b5b5-edce7eacbc1c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:56.670759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d62a0-f1f5-4f8f-b5b5-edce7eacbc1c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:56.671254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d62a0-f1f5-4f8f-b5b5-edce7eacbc1c None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:56.672253 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d62a0-f1f5-4f8f-b5b5-edce7eacbc1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:56.672759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d62a0-f1f5-4f8f-b5b5-edce7eacbc1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:56.674443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d62a0-f1f5-4f8f-b5b5-edce7eacbc1c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:56.688689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 414/831] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:56.694215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43051fe-f9b5-4dd8-9e8d-b36245eb57c5 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:56.798671 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43051fe-f9b5-4dd8-9e8d-b36245eb57c5 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:56.845404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d5a51-0c6a-4a72-8452-6038bb719031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:56.846666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d5a51-0c6a-4a72-8452-6038bb719031 None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:56.847175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d5a51-0c6a-4a72-8452-6038bb719031 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:56.847657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d5a51-0c6a-4a72-8452-6038bb719031 None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/579cb64ce191482eb4ae03d099e8635d/roles/28455344d2b44d699796e0163a62e252` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:56.869353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d5a51-0c6a-4a72-8452-6038bb719031 None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=579cb64ce191482eb4ae03d099e8635d, role_id=28455344d2b44d699796e0163a62e252)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:56.871167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d5a51-0c6a-4a72-8452-6038bb719031 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:56.890498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 418/832] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:33:56 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/579cb64ce191482eb4ae03d099e8635d/roles/28455344d2b44d699796e0163a62e252 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:33:56.988978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b1db2-7614-49ce-80ca-8ec843362641 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:56.989528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b1db2-7614-49ce-80ca-8ec843362641 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:56.989604 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b1db2-7614-49ce-80ca-8ec843362641 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:56.991347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 415/833] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:56.997682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574ba81-1c3e-427f-80ac-d9af0bcb9c51 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:56.998023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574ba81-1c3e-427f-80ac-d9af0bcb9c51 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:56.998330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574ba81-1c3e-427f-80ac-d9af0bcb9c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:57.019807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-1574ba81-1c3e-427f-80ac-d9af0bcb9c51 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:57.021042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1574ba81-1c3e-427f-80ac-d9af0bcb9c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:57.096840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 419/834] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:33:57.121860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b1db2-7614-49ce-80ca-8ec843362641 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:57.224160 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b1db2-7614-49ce-80ca-8ec843362641 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:57.259430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f40e88-34ba-4c5a-ac15-f666bd8e8d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:57.260221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f40e88-34ba-4c5a-ac15-f666bd8e8d51 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:57.260503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f40e88-34ba-4c5a-ac15-f666bd8e8d51 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:57.260778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f40e88-34ba-4c5a-ac15-f666bd8e8d51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:57.270888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f40e88-34ba-4c5a-ac15-f666bd8e8d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-65f40e88-34ba-4c5a-ac15-f666bd8e8d51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:57.278951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:57.279899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:57.280732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 416/835] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:57.287893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574ba81-1c3e-427f-80ac-d9af0bcb9c51 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:57.389063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574ba81-1c3e-427f-80ac-d9af0bcb9c51 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:57.426013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd055c66-8556-4c8f-af09-3c17452b4467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:57.427058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055c66-8556-4c8f-af09-3c17452b4467 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:57.427572 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055c66-8556-4c8f-af09-3c17452b4467 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:57.428056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd055c66-8556-4c8f-af09-3c17452b4467 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:57.429016 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd055c66-8556-4c8f-af09-3c17452b4467 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:57.429580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd055c66-8556-4c8f-af09-3c17452b4467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:57.431172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd055c66-8556-4c8f-af09-3c17452b4467 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:57.440065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 420/836] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:57.445856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f40e88-34ba-4c5a-ac15-f666bd8e8d51 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:57.545122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f40e88-34ba-4c5a-ac15-f666bd8e8d51 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:57.583626 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329400-e242-47b6-a4fe-f09c2954a88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:57.584427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329400-e242-47b6-a4fe-f09c2954a88f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:57.584708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329400-e242-47b6-a4fe-f09c2954a88f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:57.584981 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329400-e242-47b6-a4fe-f09c2954a88f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:57.596454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12329400-e242-47b6-a4fe-f09c2954a88f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:57.597908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12329400-e242-47b6-a4fe-f09c2954a88f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-12329400-e242-47b6-a4fe-f09c2954a88f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:57.615934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:57.616964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:57.617929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:57.617929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:57.617929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:57.617929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:57.617929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 417/837] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:57.624605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd055c66-8556-4c8f-af09-3c17452b4467 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:57.726246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd055c66-8556-4c8f-af09-3c17452b4467 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:57.760708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22059a26-9d94-45ed-bb81-2a96c1a9593d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:57.761750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22059a26-9d94-45ed-bb81-2a96c1a9593d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:57.762232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22059a26-9d94-45ed-bb81-2a96c1a9593d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:57.762730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22059a26-9d94-45ed-bb81-2a96c1a9593d None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:57.763654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22059a26-9d94-45ed-bb81-2a96c1a9593d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:57.764157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22059a26-9d94-45ed-bb81-2a96c1a9593d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:57.765750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22059a26-9d94-45ed-bb81-2a96c1a9593d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:57.778870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 421/838] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:57.784515 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329400-e242-47b6-a4fe-f09c2954a88f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:57.884390 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329400-e242-47b6-a4fe-f09c2954a88f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:57.917503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ca1a1-6b32-4725-8153-75edd650f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:57.918299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca1a1-6b32-4725-8153-75edd650f2da None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:57.918611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca1a1-6b32-4725-8153-75edd650f2da None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:57.918884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ca1a1-6b32-4725-8153-75edd650f2da None admin] PATH_INFO: `/v3/users/swift` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:57.926643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ca1a1-6b32-4725-8153-75edd650f2da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:57.928078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ca1a1-6b32-4725-8153-75edd650f2da None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-366ca1a1-6b32-4725-8153-75edd650f2da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:33:57.941868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:57.942848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:57.943913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:57.943913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:57.943913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:33:57.943913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:33:57.943913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:33:57.943913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:33:57.943913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:33:57.943913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:33:57.943913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 14 15:33:57.943913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:57.943913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 418/839] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:33:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:57.949616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22059a26-9d94-45ed-bb81-2a96c1a9593d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:58.051116 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22059a26-9d94-45ed-bb81-2a96c1a9593d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:58.087612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b7c9-fd33-4439-8508-a63f31c26ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:58.088210 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b7c9-fd33-4439-8508-a63f31c26ccd None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:58.088491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b7c9-fd33-4439-8508-a63f31c26ccd None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:58.088764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5b7c9-fd33-4439-8508-a63f31c26ccd None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:58.089613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5b7c9-fd33-4439-8508-a63f31c26ccd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:58.089924 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5b7c9-fd33-4439-8508-a63f31c26ccd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:58.091397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5b7c9-fd33-4439-8508-a63f31c26ccd None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:58.109846 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 422/840] 10.222.0.61 () {56 vars in 1135 bytes} [Sat May 14 15:33:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:58.115368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ca1a1-6b32-4725-8153-75edd650f2da None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:58.217203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ca1a1-6b32-4725-8153-75edd650f2da None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:58.251094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fd746-2d91-4392-b5bd-341cd2357324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:58.251752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd746-2d91-4392-b5bd-341cd2357324 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:58.252034 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd746-2d91-4392-b5bd-341cd2357324 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:58.252306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd746-2d91-4392-b5bd-341cd2357324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:58.320088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fd746-2d91-4392-b5bd-341cd2357324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:58.321795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fd746-2d91-4392-b5bd-341cd2357324 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:58.424415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 419/841] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:33:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:33:58.430451 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b7c9-fd33-4439-8508-a63f31c26ccd None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:58.536525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5b7c9-fd33-4439-8508-a63f31c26ccd None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:58.571250 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20370dfa-a766-4abd-ba2f-3a13858c8f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:58.572059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370dfa-a766-4abd-ba2f-3a13858c8f11 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:58.572337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370dfa-a766-4abd-ba2f-3a13858c8f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:58.572615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370dfa-a766-4abd-ba2f-3a13858c8f11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:58.580980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e19e-9dbf-42cc-9ece-bf1ea12a4da6 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:58.581316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e19e-9dbf-42cc-9ece-bf1ea12a4da6 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:58.581530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e19e-9dbf-42cc-9ece-bf1ea12a4da6 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:58.583266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 420/842] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:58.584391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20370dfa-a766-4abd-ba2f-3a13858c8f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:58.586106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20370dfa-a766-4abd-ba2f-3a13858c8f11 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:58.589173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77274afe-7684-466a-af30-a9cb71f10182 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:58.589461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77274afe-7684-466a-af30-a9cb71f10182 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:58.589741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77274afe-7684-466a-af30-a9cb71f10182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-20370dfa-a766-4abd-ba2f-3a13858c8f11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:33:58.607376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:58.609302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:58.610580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:33:58.610580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:33:58.610580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:33:58.610580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:58.610865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-77274afe-7684-466a-af30-a9cb71f10182 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:58.610953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 423/843] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:58.611033 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-77274afe-7684-466a-af30-a9cb71f10182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:58.614167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20370dfa-a766-4abd-ba2f-3a13858c8f11 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:58.682639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 421/844] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:33:58.699880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77274afe-7684-466a-af30-a9cb71f10182 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:58.734071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20370dfa-a766-4abd-ba2f-3a13858c8f11 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:58.768679 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee7a02-3c0f-4f40-9f9b-757f2c90ee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:58.769346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee7a02-3c0f-4f40-9f9b-757f2c90ee1c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:58.769628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee7a02-3c0f-4f40-9f9b-757f2c90ee1c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:58.769904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee7a02-3c0f-4f40-9f9b-757f2c90ee1c None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:58.770661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee7a02-3c0f-4f40-9f9b-757f2c90ee1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:58.770964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee7a02-3c0f-4f40-9f9b-757f2c90ee1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:58.772331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee7a02-3c0f-4f40-9f9b-757f2c90ee1c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:58.784430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 424/845] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:58.785675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a045c7-66b3-4146-a721-ebed81e8f45a None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:58.785967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a045c7-66b3-4146-a721-ebed81e8f45a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:58.786243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a045c7-66b3-4146-a721-ebed81e8f45a None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:58.787721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 425/846] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:58.791521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a045c7-66b3-4146-a721-ebed81e8f45a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:58.813778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77274afe-7684-466a-af30-a9cb71f10182 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:58.848598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16980db5-c66f-4d68-acb7-94861811f2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:58.849396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980db5-c66f-4d68-acb7-94861811f2e1 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:58.849674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980db5-c66f-4d68-acb7-94861811f2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:58.849943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16980db5-c66f-4d68-acb7-94861811f2e1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:58.850622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16980db5-c66f-4d68-acb7-94861811f2e1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:58.852688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16980db5-c66f-4d68-acb7-94861811f2e1 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-16980db5-c66f-4d68-acb7-94861811f2e1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:58.864605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:58.865592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:58.866482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 422/847] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:33:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:58.867924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bcbeb-b29a-4c22-8791-b7ec3906a59a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:58.867924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bcbeb-b29a-4c22-8791-b7ec3906a59a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:58.868716 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bcbeb-b29a-4c22-8791-b7ec3906a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:58.885159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e63bcbeb-b29a-4c22-8791-b7ec3906a59a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:58.886361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e63bcbeb-b29a-4c22-8791-b7ec3906a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:58.905093 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a045c7-66b3-4146-a721-ebed81e8f45a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:58.939198 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc97cc3-db29-4d5f-a6ba-2a5aad40af2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:58.939909 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc97cc3-db29-4d5f-a6ba-2a5aad40af2c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:58.940189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc97cc3-db29-4d5f-a6ba-2a5aad40af2c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:58.940464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc97cc3-db29-4d5f-a6ba-2a5aad40af2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:58.947100 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc97cc3-db29-4d5f-a6ba-2a5aad40af2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:58.948533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc97cc3-db29-4d5f-a6ba-2a5aad40af2c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:58.955640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 423/848] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:33:58.956753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bcbeb-b29a-4c22-8791-b7ec3906a59a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-7cc97cc3-db29-4d5f-a6ba-2a5aad40af2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:33:58.963912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:58.964807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:58.965712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:33:58.965712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:33:58.965712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:33:58.965712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:33:58.965712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:33:58.965712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:33:58.965712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:33:58.965712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:33:58.969386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 426/849] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:33:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:58.970178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc97cc3-db29-4d5f-a6ba-2a5aad40af2c None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:59.072577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bcbeb-b29a-4c22-8791-b7ec3906a59a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:59.077324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc97cc3-db29-4d5f-a6ba-2a5aad40af2c None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:59.107281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a1c1-0ac4-427c-a785-9dcae7927854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:59.107946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a1c1-0ac4-427c-a785-9dcae7927854 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:59.108230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a1c1-0ac4-427c-a785-9dcae7927854 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:59.108508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a1c1-0ac4-427c-a785-9dcae7927854 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:59.109208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a1c1-0ac4-427c-a785-9dcae7927854 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:59.109515 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a1c1-0ac4-427c-a785-9dcae7927854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:59.110960 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a1c1-0ac4-427c-a785-9dcae7927854 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:59.114084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbe684-9fc6-46bf-b6c1-d2521ccf6e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:59.115319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 424/850] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:33:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:59.115664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe684-9fc6-46bf-b6c1-d2521ccf6e88 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:59.116087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a1c1-0ac4-427c-a785-9dcae7927854 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:59.116729 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe684-9fc6-46bf-b6c1-d2521ccf6e88 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:59.117247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbe684-9fc6-46bf-b6c1-d2521ccf6e88 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:59.118243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbe684-9fc6-46bf-b6c1-d2521ccf6e88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:59.118768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbe684-9fc6-46bf-b6c1-d2521ccf6e88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:59.120430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbe684-9fc6-46bf-b6c1-d2521ccf6e88 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:59.132358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 427/851] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:33:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:33:59.133364 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbe684-9fc6-46bf-b6c1-d2521ccf6e88 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:59.223136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a1c1-0ac4-427c-a785-9dcae7927854 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:59.240995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbe684-9fc6-46bf-b6c1-d2521ccf6e88 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:59.255735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ac87e-b0e7-4e61-b70d-dec52228be1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:59.256540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ac87e-b0e7-4e61-b70d-dec52228be1f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:59.256824 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ac87e-b0e7-4e61-b70d-dec52228be1f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:59.257099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ac87e-b0e7-4e61-b70d-dec52228be1f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:59.258146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ac87e-b0e7-4e61-b70d-dec52228be1f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:59.259539 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ac87e-b0e7-4e61-b70d-dec52228be1f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-514ac87e-b0e7-4e61-b70d-dec52228be1f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:59.271268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:59.272188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 15:33:59.273565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:59.274813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45028f-7c57-4e08-a577-48139a671477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:59.274813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45028f-7c57-4e08-a577-48139a671477 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:59.274983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 425/852] 10.222.0.61 () {56 vars in 1132 bytes} [Sat May 14 15:33:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:33:59.275081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45028f-7c57-4e08-a577-48139a671477 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:59.275081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45028f-7c57-4e08-a577-48139a671477 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:59.275233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ac87e-b0e7-4e61-b70d-dec52228be1f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:59.275314 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45028f-7c57-4e08-a577-48139a671477 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:59.275314 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45028f-7c57-4e08-a577-48139a671477 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:59.275705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45028f-7c57-4e08-a577-48139a671477 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:59.280164 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 428/853] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:33:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:59.281224 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bb9c6-ed6a-437d-a2fa-c53ba090bc1a None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:59.281510 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bb9c6-ed6a-437d-a2fa-c53ba090bc1a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:59.281981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0bb9c6-ed6a-437d-a2fa-c53ba090bc1a None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:59.287770 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 429/854] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:33:59.287770 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0bb9c6-ed6a-437d-a2fa-c53ba090bc1a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:59.384123 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ac87e-b0e7-4e61-b70d-dec52228be1f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:59.401397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0bb9c6-ed6a-437d-a2fa-c53ba090bc1a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:59.419246 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1daf6ec-2425-4f9c-8cb0-4940f6b5fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:59.419924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daf6ec-2425-4f9c-8cb0-4940f6b5fd4a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:59.420207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daf6ec-2425-4f9c-8cb0-4940f6b5fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:59.420482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daf6ec-2425-4f9c-8cb0-4940f6b5fd4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:59.421330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1daf6ec-2425-4f9c-8cb0-4940f6b5fd4a None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=1713718ff95744b9bd42f21d4ec8bb91) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:59.421640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1daf6ec-2425-4f9c-8cb0-4940f6b5fd4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:59.423150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1daf6ec-2425-4f9c-8cb0-4940f6b5fd4a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:59.438339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 426/855] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:33:59 2022] GET /identity/v3/role_assignments?user.id=1713718ff95744b9bd42f21d4ec8bb91&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:59.438339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c3d33-7e0a-4649-ac53-19ce67e59417 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:59.438339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c3d33-7e0a-4649-ac53-19ce67e59417 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:59.438339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c3d33-7e0a-4649-ac53-19ce67e59417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:59.450001 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61367772-4311-4988-90d7-114492cf0e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:59.450384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-3f2c3d33-7e0a-4649-ac53-19ce67e59417 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:33:59.450739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367772-4311-4988-90d7-114492cf0e3c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:59.451026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367772-4311-4988-90d7-114492cf0e3c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:59.451307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367772-4311-4988-90d7-114492cf0e3c None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:59.451580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3f2c3d33-7e0a-4649-ac53-19ce67e59417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:33:59.452048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61367772-4311-4988-90d7-114492cf0e3c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:59.452360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61367772-4311-4988-90d7-114492cf0e3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:59.454080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61367772-4311-4988-90d7-114492cf0e3c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:59.461279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 430/856] 10.222.0.61 () {56 vars in 1126 bytes} [Sat May 14 15:33:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:59.469690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61367772-4311-4988-90d7-114492cf0e3c None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:59.539984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 427/857] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:33:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:33:59.578868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c3d33-7e0a-4649-ac53-19ce67e59417 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:59.594722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61367772-4311-4988-90d7-114492cf0e3c None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:59.640115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beff0b6-c4ac-4419-ba21-d66276af06e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:59.640783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beff0b6-c4ac-4419-ba21-d66276af06e3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:59.641059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beff0b6-c4ac-4419-ba21-d66276af06e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:59.641331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beff0b6-c4ac-4419-ba21-d66276af06e3 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:59.642036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beff0b6-c4ac-4419-ba21-d66276af06e3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:59.642890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beff0b6-c4ac-4419-ba21-d66276af06e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:59.644263 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beff0b6-c4ac-4419-ba21-d66276af06e3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:59.652649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 431/858] 10.222.0.61 () {56 vars in 1126 bytes} [Sat May 14 15:33:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:59.703387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c3d33-7e0a-4649-ac53-19ce67e59417 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:59.742426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e027bd2-0f1b-4c8c-a3b8-35d8452bd437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:59.743744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e027bd2-0f1b-4c8c-a3b8-35d8452bd437 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:59.744254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e027bd2-0f1b-4c8c-a3b8-35d8452bd437 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:59.744743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e027bd2-0f1b-4c8c-a3b8-35d8452bd437 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:59.757040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e027bd2-0f1b-4c8c-a3b8-35d8452bd437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-2e027bd2-0f1b-4c8c-a3b8-35d8452bd437 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:33:59.766138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:33:59.767183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:33:59.768017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:33:59.770898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 428/859] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:33:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:33:59.777568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beff0b6-c4ac-4419-ba21-d66276af06e3 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:33:59.889995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beff0b6-c4ac-4419-ba21-d66276af06e3 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:33:59.922982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471366-e736-4442-93a3-9d1f4cb6153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:33:59.923652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471366-e736-4442-93a3-9d1f4cb6153f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:33:59.923930 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471366-e736-4442-93a3-9d1f4cb6153f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:33:59.924200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471366-e736-4442-93a3-9d1f4cb6153f None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:33:59.924940 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59471366-e736-4442-93a3-9d1f4cb6153f None admin] RBAC: Adding query filter params (name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:33:59.925237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59471366-e736-4442-93a3-9d1f4cb6153f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:33:59.926615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59471366-e736-4442-93a3-9d1f4cb6153f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:33:59.939928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 432/860] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:33:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:33:59.941292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e027bd2-0f1b-4c8c-a3b8-35d8452bd437 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:00.045321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e027bd2-0f1b-4c8c-a3b8-35d8452bd437 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:00.080943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054f05e-b788-4894-9dd3-1cd7333ba56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:00.081817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054f05e-b788-4894-9dd3-1cd7333ba56e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:00.082094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054f05e-b788-4894-9dd3-1cd7333ba56e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:00.082422 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054f05e-b788-4894-9dd3-1cd7333ba56e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:00.093557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054f05e-b788-4894-9dd3-1cd7333ba56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:00.095086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054f05e-b788-4894-9dd3-1cd7333ba56e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-d054f05e-b788-4894-9dd3-1cd7333ba56e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:00.112747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:00.113646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:00.114570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:00.114570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:00.114570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:00.114570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:00.114570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 429/861] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:00.119688 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471366-e736-4442-93a3-9d1f4cb6153f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:00.217338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471366-e736-4442-93a3-9d1f4cb6153f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:00.251599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad545a6-4076-4e0e-a1c1-108cb4ad14cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:00.252261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad545a6-4076-4e0e-a1c1-108cb4ad14cc None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:00.252539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad545a6-4076-4e0e-a1c1-108cb4ad14cc None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:00.252807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad545a6-4076-4e0e-a1c1-108cb4ad14cc None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:00.253524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad545a6-4076-4e0e-a1c1-108cb4ad14cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:00.253822 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad545a6-4076-4e0e-a1c1-108cb4ad14cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:00.255206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad545a6-4076-4e0e-a1c1-108cb4ad14cc None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:00.267120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 433/862] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:00.272498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054f05e-b788-4894-9dd3-1cd7333ba56e None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:00.374125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054f05e-b788-4894-9dd3-1cd7333ba56e None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:00.407973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8bb56-9215-4d24-8680-0e5dfb02b105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:00.408788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8bb56-9215-4d24-8680-0e5dfb02b105 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:00.409064 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8bb56-9215-4d24-8680-0e5dfb02b105 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:00.409330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8bb56-9215-4d24-8680-0e5dfb02b105 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:00.417606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8bb56-9215-4d24-8680-0e5dfb02b105 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:00.419054 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8bb56-9215-4d24-8680-0e5dfb02b105 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-55d8bb56-9215-4d24-8680-0e5dfb02b105 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:34:00.433701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:00.434704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:00.435653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:00.435653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:00.435653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:34:00.435653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:34:00.435653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:34:00.435653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:34:00.435653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:34:00.435653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:34:00.435653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:34:00.435653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:00.435653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 430/863] 10.222.0.61 () {56 vars in 1117 bytes} [Sat May 14 15:34:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:00.440789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad545a6-4076-4e0e-a1c1-108cb4ad14cc None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:00.543475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad545a6-4076-4e0e-a1c1-108cb4ad14cc None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:00.579217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ae0dc-a880-48bc-98a2-ba779c1061cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:00.579888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae0dc-a880-48bc-98a2-ba779c1061cf None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:00.580171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae0dc-a880-48bc-98a2-ba779c1061cf None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:00.580446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ae0dc-a880-48bc-98a2-ba779c1061cf None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:00.581289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ae0dc-a880-48bc-98a2-ba779c1061cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:00.581591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ae0dc-a880-48bc-98a2-ba779c1061cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:00.583048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ae0dc-a880-48bc-98a2-ba779c1061cf None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:00.601598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 434/864] 10.222.0.61 () {56 vars in 1149 bytes} [Sat May 14 15:34:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:00.607530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8bb56-9215-4d24-8680-0e5dfb02b105 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:00.708725 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8bb56-9215-4d24-8680-0e5dfb02b105 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:00.743621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90043f9d-9e7f-4efb-a341-d2080194b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:00.744645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90043f9d-9e7f-4efb-a341-d2080194b94c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:00.745143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90043f9d-9e7f-4efb-a341-d2080194b94c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:00.745628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90043f9d-9e7f-4efb-a341-d2080194b94c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:00.811787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90043f9d-9e7f-4efb-a341-d2080194b94c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:00.813575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90043f9d-9e7f-4efb-a341-d2080194b94c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:00.925999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 431/865] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:34:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:34:00.935425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ae0dc-a880-48bc-98a2-ba779c1061cf None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:01.033180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ae0dc-a880-48bc-98a2-ba779c1061cf None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:01.066839 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3938da-9b8b-4bdb-8e93-1f9fc03ed2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:01.067984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3938da-9b8b-4bdb-8e93-1f9fc03ed2f8 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:01.068462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3938da-9b8b-4bdb-8e93-1f9fc03ed2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:01.068950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3938da-9b8b-4bdb-8e93-1f9fc03ed2f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:01.080396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3938da-9b8b-4bdb-8e93-1f9fc03ed2f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:01.082368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3938da-9b8b-4bdb-8e93-1f9fc03ed2f8 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-7e3938da-9b8b-4bdb-8e93-1f9fc03ed2f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:01.105505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:01.106638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:01.107616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:01.107616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:01.107616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:01.107616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:01.107616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 435/866] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:01.113902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90043f9d-9e7f-4efb-a341-d2080194b94c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:01.213350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90043f9d-9e7f-4efb-a341-d2080194b94c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:01.249768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78184614-7191-43fc-8995-505f1d7fb1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:01.250842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184614-7191-43fc-8995-505f1d7fb1f2 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:01.251337 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184614-7191-43fc-8995-505f1d7fb1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:01.251836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184614-7191-43fc-8995-505f1d7fb1f2 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:01.252754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78184614-7191-43fc-8995-505f1d7fb1f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:01.253257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78184614-7191-43fc-8995-505f1d7fb1f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:01.254845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78184614-7191-43fc-8995-505f1d7fb1f2 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:01.266911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 432/867] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:01.272527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3938da-9b8b-4bdb-8e93-1f9fc03ed2f8 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:01.372445 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3938da-9b8b-4bdb-8e93-1f9fc03ed2f8 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:01.408136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c096d7-e1bf-49ca-801c-8bfb7273de67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:01.409365 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c096d7-e1bf-49ca-801c-8bfb7273de67 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:01.409877 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c096d7-e1bf-49ca-801c-8bfb7273de67 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:01.410397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c096d7-e1bf-49ca-801c-8bfb7273de67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:01.418704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c096d7-e1bf-49ca-801c-8bfb7273de67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:01.420537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c096d7-e1bf-49ca-801c-8bfb7273de67 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f9c096d7-e1bf-49ca-801c-8bfb7273de67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:34:01.436375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:01.437345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:01.438230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:34:01.438230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:34:01.438230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:34:01.438230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:34:01.438230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:34:01.438230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:34:01.438230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:01.438230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:01.440965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 436/868] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:01.447094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78184614-7191-43fc-8995-505f1d7fb1f2 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:01.548768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78184614-7191-43fc-8995-505f1d7fb1f2 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:01.582876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccb616-26aa-4700-a22e-e5bc39797caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:01.583923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccb616-26aa-4700-a22e-e5bc39797caf None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:01.584412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccb616-26aa-4700-a22e-e5bc39797caf None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:01.584906 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccb616-26aa-4700-a22e-e5bc39797caf None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:01.586118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccb616-26aa-4700-a22e-e5bc39797caf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:01.586690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccb616-26aa-4700-a22e-e5bc39797caf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:01.588402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccb616-26aa-4700-a22e-e5bc39797caf None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:01.595851 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4753e-bc30-4e50-9a86-f5978a17c1fd None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:01.596199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4753e-bc30-4e50-9a86-f5978a17c1fd None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:01.596421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4753e-bc30-4e50-9a86-f5978a17c1fd None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:01.598649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 437/869] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:01.605347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d43fa-ea2a-40e3-9f79-33aa083daf87 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:01.605689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d43fa-ea2a-40e3-9f79-33aa083daf87 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:01.605910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d43fa-ea2a-40e3-9f79-33aa083daf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:01.606644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 433/870] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:01.613654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccb616-26aa-4700-a22e-e5bc39797caf None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:01.629577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-119d43fa-ea2a-40e3-9f79-33aa083daf87 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:01.630754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-119d43fa-ea2a-40e3-9f79-33aa083daf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:01.703313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 438/871] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:01.725768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d43fa-ea2a-40e3-9f79-33aa083daf87 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:01.728599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccb616-26aa-4700-a22e-e5bc39797caf None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:01.764025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f700209b-db91-4d63-9966-5c4d016528db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:01.764749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700209b-db91-4d63-9966-5c4d016528db None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:01.765036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700209b-db91-4d63-9966-5c4d016528db None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:01.765316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f700209b-db91-4d63-9966-5c4d016528db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:01.766154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700209b-db91-4d63-9966-5c4d016528db None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=579cb64ce191482eb4ae03d099e8635d) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:01.766501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700209b-db91-4d63-9966-5c4d016528db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:01.767935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f700209b-db91-4d63-9966-5c4d016528db None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:01.775052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 434/872] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:34:01 2022] GET /identity/v3/role_assignments?user.id=579cb64ce191482eb4ae03d099e8635d&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:01.797112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55425ca-8b68-4b8c-b06d-57efc52c7def None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:01.797755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55425ca-8b68-4b8c-b06d-57efc52c7def None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:01.798223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55425ca-8b68-4b8c-b06d-57efc52c7def None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:01.804563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 435/873] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:34:01.806405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dde5f-7bb2-4bd4-b705-a77471376b54 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:01.806934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dde5f-7bb2-4bd4-b705-a77471376b54 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:01.807417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dde5f-7bb2-4bd4-b705-a77471376b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:01.825302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-056dde5f-7bb2-4bd4-b705-a77471376b54 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:01.826886 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-056dde5f-7bb2-4bd4-b705-a77471376b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:01.840343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d43fa-ea2a-40e3-9f79-33aa083daf87 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:01.896485 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f39fc-69d4-44aa-9838-b06a9363e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:01.897081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f39fc-69d4-44aa-9838-b06a9363e359 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:01.897366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f39fc-69d4-44aa-9838-b06a9363e359 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:01.897645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f39fc-69d4-44aa-9838-b06a9363e359 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:01.899178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f39fc-69d4-44aa-9838-b06a9363e359 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:01.901399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f39fc-69d4-44aa-9838-b06a9363e359 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:01.922652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 436/874] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:01.924728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 439/875] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:34:01 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:34:01.941632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dde5f-7bb2-4bd4-b705-a77471376b54 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:02.056960 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dde5f-7bb2-4bd4-b705-a77471376b54 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:02.092131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a886bed-4652-4350-b70b-aa1a05675678 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:02.092486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a886bed-4652-4350-b70b-aa1a05675678 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:02.092690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a886bed-4652-4350-b70b-aa1a05675678 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:02.094058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 440/876] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:34:02.100280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f808-fd03-4f5f-b9f1-5822390c8713 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:02.100923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f808-fd03-4f5f-b9f1-5822390c8713 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:02.101243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25f808-fd03-4f5f-b9f1-5822390c8713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:02.103787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab610af-8991-4e9e-bd30-68e46a428457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:02.104710 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab610af-8991-4e9e-bd30-68e46a428457 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:02.104990 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab610af-8991-4e9e-bd30-68e46a428457 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:02.105349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab610af-8991-4e9e-bd30-68e46a428457 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:02.106025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab610af-8991-4e9e-bd30-68e46a428457 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:02.107506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab610af-8991-4e9e-bd30-68e46a428457 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-4ab610af-8991-4e9e-bd30-68e46a428457 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:02.120583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:02.121704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:02.122628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 437/877] 10.222.0.61 () {56 vars in 1126 bytes} [Sat May 14 15:34:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:02.127749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab610af-8991-4e9e-bd30-68e46a428457 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:02.129995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-1d25f808-fd03-4f5f-b9f1-5822390c8713 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:02.132478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1d25f808-fd03-4f5f-b9f1-5822390c8713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:02.215155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 441/878] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:02.240067 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f808-fd03-4f5f-b9f1-5822390c8713 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:02.249575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab610af-8991-4e9e-bd30-68e46a428457 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:02.295702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e4748-d5cb-48b4-b40e-3c36800beb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:02.297045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e4748-d5cb-48b4-b40e-3c36800beb23 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:02.297553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e4748-d5cb-48b4-b40e-3c36800beb23 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:02.298044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e4748-d5cb-48b4-b40e-3c36800beb23 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:02.299439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e4748-d5cb-48b4-b40e-3c36800beb23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:02.299970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e4748-d5cb-48b4-b40e-3c36800beb23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:02.301952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e4748-d5cb-48b4-b40e-3c36800beb23 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:02.309125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 438/879] 10.222.0.61 () {56 vars in 1122 bytes} [Sat May 14 15:34:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:02.314505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e4748-d5cb-48b4-b40e-3c36800beb23 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:02.357316 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25f808-fd03-4f5f-b9f1-5822390c8713 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:02.400716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafda4d-e2c9-4bd2-afd1-ee8289ebbf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:02.401533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafda4d-e2c9-4bd2-afd1-ee8289ebbf56 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:02.401815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafda4d-e2c9-4bd2-afd1-ee8289ebbf56 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:02.402090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafda4d-e2c9-4bd2-afd1-ee8289ebbf56 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:02.402854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafda4d-e2c9-4bd2-afd1-ee8289ebbf56 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:02.404717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafda4d-e2c9-4bd2-afd1-ee8289ebbf56 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:02.420620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e4748-d5cb-48b4-b40e-3c36800beb23 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:02.428829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 442/880] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:34:02 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:34:02.472968 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24e478-979f-4181-8cee-852058d94411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:02.473611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e478-979f-4181-8cee-852058d94411 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:02.473930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e478-979f-4181-8cee-852058d94411 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:02.474257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e478-979f-4181-8cee-852058d94411 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:02.475041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24e478-979f-4181-8cee-852058d94411 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:02.475347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24e478-979f-4181-8cee-852058d94411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:02.477231 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24e478-979f-4181-8cee-852058d94411 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:02.483118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 439/881] 10.222.0.61 () {56 vars in 1122 bytes} [Sat May 14 15:34:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:04.211396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52ca50-6110-4516-afa9-a52395686682 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.212404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52ca50-6110-4516-afa9-a52395686682 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.212898 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52ca50-6110-4516-afa9-a52395686682 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.214817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 443/882] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:04.220448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ddb3-3fa3-4c8d-bca8-c6938d1e7e92 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.221342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ddb3-3fa3-4c8d-bca8-c6938d1e7e92 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.221853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3ddb3-3fa3-4c8d-bca8-c6938d1e7e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.240244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-86c3ddb3-3fa3-4c8d-bca8-c6938d1e7e92 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:04.242406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-86c3ddb3-3fa3-4c8d-bca8-c6938d1e7e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:04.258633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c63f7d-68dc-46f4-bf63-782ec427896f None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.259268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c63f7d-68dc-46f4-bf63-782ec427896f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.259768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c63f7d-68dc-46f4-bf63-782ec427896f None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.262911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 444/883] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:04.267373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c2956-4d3f-4a02-847c-ec841e929003 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.267928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c2956-4d3f-4a02-847c-ec841e929003 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.268406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c2956-4d3f-4a02-847c-ec841e929003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.285495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-8a7c2956-4d3f-4a02-847c-ec841e929003 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:04.287033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8a7c2956-4d3f-4a02-847c-ec841e929003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:04.326103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 440/884] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:04.350457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3ddb3-3fa3-4c8d-bca8-c6938d1e7e92 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:04.366401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 445/885] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:04.390228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c2956-4d3f-4a02-847c-ec841e929003 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:04.481260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3ddb3-3fa3-4c8d-bca8-c6938d1e7e92 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:04.496843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c2956-4d3f-4a02-847c-ec841e929003 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:04.515610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d721eb-2e5e-4e42-9681-de747f3bdac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:04.516737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d721eb-2e5e-4e42-9681-de747f3bdac0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.516737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d721eb-2e5e-4e42-9681-de747f3bdac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.517046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d721eb-2e5e-4e42-9681-de747f3bdac0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.530157 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d721eb-2e5e-4e42-9681-de747f3bdac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-47d721eb-2e5e-4e42-9681-de747f3bdac0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:34:04.538546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:04.539596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:04.540441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:04.544916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 441/886] 10.222.0.61 () {56 vars in 1120 bytes} [Sat May 14 15:34:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:04.545700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987117ac-3ee2-4a14-af16-7152f8d18a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:04.545919 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d721eb-2e5e-4e42-9681-de747f3bdac0 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:04.546948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987117ac-3ee2-4a14-af16-7152f8d18a27 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.547443 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987117ac-3ee2-4a14-af16-7152f8d18a27 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.547927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987117ac-3ee2-4a14-af16-7152f8d18a27 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.549072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987117ac-3ee2-4a14-af16-7152f8d18a27 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:04.551611 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987117ac-3ee2-4a14-af16-7152f8d18a27 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-987117ac-3ee2-4a14-af16-7152f8d18a27 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:04.567083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:04.568183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 15:34:04.569106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:04.574361 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 446/887] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:34:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:04.578647 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987117ac-3ee2-4a14-af16-7152f8d18a27 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:04.657337 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d721eb-2e5e-4e42-9681-de747f3bdac0 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:04.698783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987117ac-3ee2-4a14-af16-7152f8d18a27 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:04.703752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d649c51-45c3-42f5-b4e5-0b96c84776e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:04.704624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d649c51-45c3-42f5-b4e5-0b96c84776e9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.705004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d649c51-45c3-42f5-b4e5-0b96c84776e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.705373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d649c51-45c3-42f5-b4e5-0b96c84776e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.706430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d649c51-45c3-42f5-b4e5-0b96c84776e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:04.707182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d649c51-45c3-42f5-b4e5-0b96c84776e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:04.708912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d649c51-45c3-42f5-b4e5-0b96c84776e9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:04.720814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 442/888] 10.222.0.61 () {56 vars in 1115 bytes} [Sat May 14 15:34:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:04.721983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69bd1c-ef4d-4c21-b946-fdaa911ec30a None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.722623 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69bd1c-ef4d-4c21-b946-fdaa911ec30a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.722904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69bd1c-ef4d-4c21-b946-fdaa911ec30a None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.724893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 443/889] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:04.729000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69bd1c-ef4d-4c21-b946-fdaa911ec30a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:04.735035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9588d-5652-4c51-afcc-38ea42206d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:04.735636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9588d-5652-4c51-afcc-38ea42206d89 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.735915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9588d-5652-4c51-afcc-38ea42206d89 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.736189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9588d-5652-4c51-afcc-38ea42206d89 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.736894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9588d-5652-4c51-afcc-38ea42206d89 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:04.737197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9588d-5652-4c51-afcc-38ea42206d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:04.738586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9588d-5652-4c51-afcc-38ea42206d89 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:04.743801 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 447/890] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:34:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:04.744973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9036d-3119-41c8-bcb1-5913f89d4f12 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.745255 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9036d-3119-41c8-bcb1-5913f89d4f12 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.745529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9036d-3119-41c8-bcb1-5913f89d4f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.761741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9bd9036d-3119-41c8-bcb1-5913f89d4f12 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:04.762937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9bd9036d-3119-41c8-bcb1-5913f89d4f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:04.825068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 448/891] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:04.825890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9036d-3119-41c8-bcb1-5913f89d4f12 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:04.843059 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a69bd1c-ef4d-4c21-b946-fdaa911ec30a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:04.877052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacc7cd-835d-4760-8dd4-a71dc901a920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:04.877840 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacc7cd-835d-4760-8dd4-a71dc901a920 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.878121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacc7cd-835d-4760-8dd4-a71dc901a920 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.878428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacc7cd-835d-4760-8dd4-a71dc901a920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.888249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacc7cd-835d-4760-8dd4-a71dc901a920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:04.889683 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacc7cd-835d-4760-8dd4-a71dc901a920 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-acacc7cd-835d-4760-8dd4-a71dc901a920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:04.906985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:04.907872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:04.908766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:04.908766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:04.908766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:04.908766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:04.908766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 444/892] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:04.909393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f1ef-d6d0-4f17-b9da-412eadc02775 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.909628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f1ef-d6d0-4f17-b9da-412eadc02775 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.909903 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f1ef-d6d0-4f17-b9da-412eadc02775 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.911329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 445/893] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:04.911864 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7f1ef-d6d0-4f17-b9da-412eadc02775 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:04.924869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9036d-3119-41c8-bcb1-5913f89d4f12 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:04.957227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0817a-3f1c-407f-bd49-cb2d5bb8c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:04.957896 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0817a-3f1c-407f-bd49-cb2d5bb8c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:04.958181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0817a-3f1c-407f-bd49-cb2d5bb8c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:04.958490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0817a-3f1c-407f-bd49-cb2d5bb8c6f4 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:04.959199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0817a-3f1c-407f-bd49-cb2d5bb8c6f4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:04.959508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0817a-3f1c-407f-bd49-cb2d5bb8c6f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:04.961693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0817a-3f1c-407f-bd49-cb2d5bb8c6f4 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:04.966390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 449/894] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:34:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:04.967338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0817a-3f1c-407f-bd49-cb2d5bb8c6f4 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:05.011477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7f1ef-d6d0-4f17-b9da-412eadc02775 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.044944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22690921-0351-4774-88f4-e4de07e6a07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.045752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22690921-0351-4774-88f4-e4de07e6a07e None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.046035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22690921-0351-4774-88f4-e4de07e6a07e None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.046338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22690921-0351-4774-88f4-e4de07e6a07e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.046993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22690921-0351-4774-88f4-e4de07e6a07e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:05.048350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22690921-0351-4774-88f4-e4de07e6a07e None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-22690921-0351-4774-88f4-e4de07e6a07e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:05.060442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:05.061423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 15:34:05.062281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:05.063320 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0817a-3f1c-407f-bd49-cb2d5bb8c6f4 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.066643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 446/895] 10.222.0.61 () {56 vars in 1132 bytes} [Sat May 14 15:34:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:05.067950 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582385-351f-4171-80e1-1d90d580d7c6 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.068241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582385-351f-4171-80e1-1d90d580d7c6 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.068514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582385-351f-4171-80e1-1d90d580d7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.084823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a5582385-351f-4171-80e1-1d90d580d7c6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:05.086792 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a5582385-351f-4171-80e1-1d90d580d7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:05.094289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bf015-6bce-4a38-b7ac-7cdf04e6be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.094972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bf015-6bce-4a38-b7ac-7cdf04e6be9b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.095258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bf015-6bce-4a38-b7ac-7cdf04e6be9b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.095534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bf015-6bce-4a38-b7ac-7cdf04e6be9b None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.096257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bf015-6bce-4a38-b7ac-7cdf04e6be9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:05.096565 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bf015-6bce-4a38-b7ac-7cdf04e6be9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:05.097922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bf015-6bce-4a38-b7ac-7cdf04e6be9b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:05.109889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 450/896] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:05.110712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bf015-6bce-4a38-b7ac-7cdf04e6be9b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:05.150376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 447/897] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:05.151206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5582385-351f-4171-80e1-1d90d580d7c6 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:05.212172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bf015-6bce-4a38-b7ac-7cdf04e6be9b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.244321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac623fdb-7fe1-4945-b466-8af918577fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.244529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5582385-351f-4171-80e1-1d90d580d7c6 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.244980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac623fdb-7fe1-4945-b466-8af918577fb0 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.245262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac623fdb-7fe1-4945-b466-8af918577fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.245538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac623fdb-7fe1-4945-b466-8af918577fb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.246352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac623fdb-7fe1-4945-b466-8af918577fb0 None admin] RBAC: Adding query filter params (interface=public, service_id=011cd31792b246bca6b6c68df3f9abbb, region_id=RegionOne) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:05.246735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac623fdb-7fe1-4945-b466-8af918577fb0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:05.248101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac623fdb-7fe1-4945-b466-8af918577fb0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:05.255261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 451/898] 10.222.0.61 () {56 vars in 1251 bytes} [Sat May 14 15:34:05 2022] GET /identity/v3/endpoints?service_id=011cd31792b246bca6b6c68df3f9abbb&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:05.256047 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac623fdb-7fe1-4945-b466-8af918577fb0 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:05.276704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b05b5-5034-45f8-8f9f-a6b4caad05dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.277299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b05b5-5034-45f8-8f9f-a6b4caad05dc None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.277574 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b05b5-5034-45f8-8f9f-a6b4caad05dc None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.277846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b05b5-5034-45f8-8f9f-a6b4caad05dc None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.278568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b05b5-5034-45f8-8f9f-a6b4caad05dc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:05.278871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b05b5-5034-45f8-8f9f-a6b4caad05dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:05.281275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b05b5-5034-45f8-8f9f-a6b4caad05dc None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:05.285792 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 448/899] 10.222.0.61 () {56 vars in 1126 bytes} [Sat May 14 15:34:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:05.286571 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b05b5-5034-45f8-8f9f-a6b4caad05dc None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:05.354903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac623fdb-7fe1-4945-b466-8af918577fb0 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.380756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b05b5-5034-45f8-8f9f-a6b4caad05dc None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.386718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fbbc3-1115-445a-aab4-0863886be725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.387520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fbbc3-1115-445a-aab4-0863886be725 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.387809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fbbc3-1115-445a-aab4-0863886be725 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.388086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fbbc3-1115-445a-aab4-0863886be725 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.395665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fbbc3-1115-445a-aab4-0863886be725 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:05.397099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fbbc3-1115-445a-aab4-0863886be725 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-723fbbc3-1115-445a-aab4-0863886be725 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:34:05.411709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:05.412680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:05.414054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:05.414054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:05.414054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:34:05.414054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:34:05.414054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:34:05.414054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:34:05.414054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:34:05.414054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:34:05.414054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:34:05.414054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:05.414054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 452/900] 10.222.0.61 () {56 vars in 1117 bytes} [Sat May 14 15:34:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:05.414782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fbbc3-1115-445a-aab4-0863886be725 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:05.418620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda2fb4-a370-4c40-8418-620b9a55efb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.419301 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda2fb4-a370-4c40-8418-620b9a55efb4 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.419577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda2fb4-a370-4c40-8418-620b9a55efb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.419846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda2fb4-a370-4c40-8418-620b9a55efb4 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.420554 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda2fb4-a370-4c40-8418-620b9a55efb4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:05.421899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda2fb4-a370-4c40-8418-620b9a55efb4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:05.435262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 449/901] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:34:05 2022] POST /identity/v3/services => generated 241 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:34:05.436049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda2fb4-a370-4c40-8418-620b9a55efb4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:05.529939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fbbc3-1115-445a-aab4-0863886be725 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.549688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda2fb4-a370-4c40-8418-620b9a55efb4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.564562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35586f-0c36-4d0a-8324-4a6fdc953fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.565249 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35586f-0c36-4d0a-8324-4a6fdc953fa2 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.565536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35586f-0c36-4d0a-8324-4a6fdc953fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.565813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35586f-0c36-4d0a-8324-4a6fdc953fa2 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.566543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35586f-0c36-4d0a-8324-4a6fdc953fa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:05.567951 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35586f-0c36-4d0a-8324-4a6fdc953fa2 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:05.575242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 453/902] 10.222.0.61 () {56 vars in 1087 bytes} [Sat May 14 15:34:05 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:34:05.576123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35586f-0c36-4d0a-8324-4a6fdc953fa2 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:05.598815 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e5400-f218-4dd8-9f1c-25a23f830f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.599993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e5400-f218-4dd8-9f1c-25a23f830f39 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.600487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e5400-f218-4dd8-9f1c-25a23f830f39 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.601564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e5400-f218-4dd8-9f1c-25a23f830f39 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.602676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e5400-f218-4dd8-9f1c-25a23f830f39 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:05.603497 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e5400-f218-4dd8-9f1c-25a23f830f39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:05.605199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e5400-f218-4dd8-9f1c-25a23f830f39 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:05.611758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 450/903] 10.222.0.61 () {56 vars in 1126 bytes} [Sat May 14 15:34:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:05.618077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e5400-f218-4dd8-9f1c-25a23f830f39 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:05.710964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35586f-0c36-4d0a-8324-4a6fdc953fa2 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.745393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e5400-f218-4dd8-9f1c-25a23f830f39 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.757975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a879ea-d6a2-4e66-8b89-b986b558a82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.759079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a879ea-d6a2-4e66-8b89-b986b558a82d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.759512 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a879ea-d6a2-4e66-8b89-b986b558a82d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.760163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a879ea-d6a2-4e66-8b89-b986b558a82d None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.761637 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a879ea-d6a2-4e66-8b89-b986b558a82d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:05.762431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a879ea-d6a2-4e66-8b89-b986b558a82d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:05.764582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a879ea-d6a2-4e66-8b89-b986b558a82d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:05.785642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 454/904] 10.222.0.61 () {56 vars in 1149 bytes} [Sat May 14 15:34:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:05.793549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47537d4-4d0c-4a47-aa4d-eb93b2d60317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.793549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47537d4-4d0c-4a47-aa4d-eb93b2d60317 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.793549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47537d4-4d0c-4a47-aa4d-eb93b2d60317 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.793549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47537d4-4d0c-4a47-aa4d-eb93b2d60317 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.793989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47537d4-4d0c-4a47-aa4d-eb93b2d60317 None admin] RBAC: Adding query filter params (interface=public, service_id=4f94c0423706480191d856848c4b4e71, region_id=RegionOne) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:05.793989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47537d4-4d0c-4a47-aa4d-eb93b2d60317 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:05.793989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47537d4-4d0c-4a47-aa4d-eb93b2d60317 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:05.795333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a879ea-d6a2-4e66-8b89-b986b558a82d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:05.797039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 451/905] 10.222.0.61 () {56 vars in 1251 bytes} [Sat May 14 15:34:05 2022] GET /identity/v3/endpoints?service_id=4f94c0423706480191d856848c4b4e71&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:05.807360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47537d4-4d0c-4a47-aa4d-eb93b2d60317 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:05.915406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a879ea-d6a2-4e66-8b89-b986b558a82d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.927383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47537d4-4d0c-4a47-aa4d-eb93b2d60317 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:05.949766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823f788-8565-4eb9-bacd-f619926b7e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.950470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823f788-8565-4eb9-bacd-f619926b7e5c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.950758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823f788-8565-4eb9-bacd-f619926b7e5c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.951088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823f788-8565-4eb9-bacd-f619926b7e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.962734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac11501-58d6-427a-8f6c-d4ca58801343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:05.963416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac11501-58d6-427a-8f6c-d4ca58801343 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:05.964018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac11501-58d6-427a-8f6c-d4ca58801343 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:05.964350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac11501-58d6-427a-8f6c-d4ca58801343 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:05.965565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac11501-58d6-427a-8f6c-d4ca58801343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:05.967097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac11501-58d6-427a-8f6c-d4ca58801343 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:05.975755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 452/906] 10.222.0.61 () {56 vars in 1087 bytes} [Sat May 14 15:34:05 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:34:06.031690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823f788-8565-4eb9-bacd-f619926b7e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:06.033151 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823f788-8565-4eb9-bacd-f619926b7e5c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:06.146173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 455/907] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:34:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:34:06.151871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac11501-58d6-427a-8f6c-d4ca58801343 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:06.262342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac11501-58d6-427a-8f6c-d4ca58801343 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:06.298181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93ce5-d9c8-4443-95ae-a05e75359dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:06.299373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93ce5-d9c8-4443-95ae-a05e75359dae None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:06.299862 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93ce5-d9c8-4443-95ae-a05e75359dae None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:06.300363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93ce5-d9c8-4443-95ae-a05e75359dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:06.312062 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93ce5-d9c8-4443-95ae-a05e75359dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:06.313810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93ce5-d9c8-4443-95ae-a05e75359dae None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-b7b93ce5-d9c8-4443-95ae-a05e75359dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:06.332692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:06.333640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:06.334612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:06.334612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:06.334612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:06.334612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:06.338062 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 453/908] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:06.343235 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823f788-8565-4eb9-bacd-f619926b7e5c None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:06.443117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823f788-8565-4eb9-bacd-f619926b7e5c None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:06.478607 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803ed81-332c-40a2-a40a-ab02dffa607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:06.479277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803ed81-332c-40a2-a40a-ab02dffa607d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:06.479559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803ed81-332c-40a2-a40a-ab02dffa607d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:06.479838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803ed81-332c-40a2-a40a-ab02dffa607d None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:06.480566 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803ed81-332c-40a2-a40a-ab02dffa607d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:06.480872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803ed81-332c-40a2-a40a-ab02dffa607d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:06.482240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803ed81-332c-40a2-a40a-ab02dffa607d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:06.494155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 456/909] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:06.499479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93ce5-d9c8-4443-95ae-a05e75359dae None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:06.599999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93ce5-d9c8-4443-95ae-a05e75359dae None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:06.635972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b9cb8-f246-4e6c-a50f-c0760a89cfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:06.637037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b9cb8-f246-4e6c-a50f-c0760a89cfc9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:06.637481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b9cb8-f246-4e6c-a50f-c0760a89cfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:06.637901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b9cb8-f246-4e6c-a50f-c0760a89cfc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:06.644754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b9cb8-f246-4e6c-a50f-c0760a89cfc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:06.646370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b9cb8-f246-4e6c-a50f-c0760a89cfc9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-c15b9cb8-f246-4e6c-a50f-c0760a89cfc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:34:06.661645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:06.662761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:06.664427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:34:06.664427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:34:06.664427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:34:06.664427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:34:06.664427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:34:06.664427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:34:06.664427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:06.664427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:06.666563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 454/910] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:06.675101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803ed81-332c-40a2-a40a-ab02dffa607d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:06.795046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803ed81-332c-40a2-a40a-ab02dffa607d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:06.843399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3b7c6-b2b0-4eda-80be-6b67a7c7501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:06.844165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3b7c6-b2b0-4eda-80be-6b67a7c7501a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:06.844515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3b7c6-b2b0-4eda-80be-6b67a7c7501a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:06.844857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3b7c6-b2b0-4eda-80be-6b67a7c7501a None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:06.845724 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3b7c6-b2b0-4eda-80be-6b67a7c7501a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:06.846095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3b7c6-b2b0-4eda-80be-6b67a7c7501a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:06.847625 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3b7c6-b2b0-4eda-80be-6b67a7c7501a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:06.860955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 457/911] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:06.867267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b9cb8-f246-4e6c-a50f-c0760a89cfc9 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:07.071177 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b9cb8-f246-4e6c-a50f-c0760a89cfc9 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:07.119441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207578e-f525-44c7-bf11-6abfc4e1cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:07.120112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207578e-f525-44c7-bf11-6abfc4e1cec0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:07.120397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207578e-f525-44c7-bf11-6abfc4e1cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:07.120673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207578e-f525-44c7-bf11-6abfc4e1cec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:07.121517 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207578e-f525-44c7-bf11-6abfc4e1cec0 None admin] RBAC: Adding query filter params (role.id=be2d9f91e4cb4dc0ad7bb5589d31739b, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=579cb64ce191482eb4ae03d099e8635d) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:07.121830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207578e-f525-44c7-bf11-6abfc4e1cec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:07.123288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207578e-f525-44c7-bf11-6abfc4e1cec0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:07.137362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 455/912] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:34:06 2022] GET /identity/v3/role_assignments?user.id=579cb64ce191482eb4ae03d099e8635d&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=be2d9f91e4cb4dc0ad7bb5589d31739b => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:07.818139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37acae8-a02f-40d5-b9b0-4e3694acee18 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:07.818942 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37acae8-a02f-40d5-b9b0-4e3694acee18 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:07.818942 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37acae8-a02f-40d5-b9b0-4e3694acee18 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:07.821035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 458/913] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:07.826785 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edda5ad-f04c-4c16-9b85-18597521d58d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:07.827323 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edda5ad-f04c-4c16-9b85-18597521d58d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:07.827425 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edda5ad-f04c-4c16-9b85-18597521d58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:07.845321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-1edda5ad-f04c-4c16-9b85-18597521d58d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:07.846593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1edda5ad-f04c-4c16-9b85-18597521d58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:07.920831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 456/914] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:07.943439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37acae8-a02f-40d5-b9b0-4e3694acee18 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:08.039698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014a779-f192-4bfe-b100-316709d7f24e None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.040479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014a779-f192-4bfe-b100-316709d7f24e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.040955 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014a779-f192-4bfe-b100-316709d7f24e None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.042844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 457/915] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:08.048200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c974-91e7-4bc3-8d0a-c95e364728b1 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.048658 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c974-91e7-4bc3-8d0a-c95e364728b1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.049113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c974-91e7-4bc3-8d0a-c95e364728b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.058337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37acae8-a02f-40d5-b9b0-4e3694acee18 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:08.067309 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-3c90c974-91e7-4bc3-8d0a-c95e364728b1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:08.068566 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3c90c974-91e7-4bc3-8d0a-c95e364728b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:08.095059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e642d-287b-407c-9f86-deb53f206c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:08.095857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e642d-287b-407c-9f86-deb53f206c71 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.096124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e642d-287b-407c-9f86-deb53f206c71 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.096559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e642d-287b-407c-9f86-deb53f206c71 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.097361 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e642d-287b-407c-9f86-deb53f206c71 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:08.098910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e642d-287b-407c-9f86-deb53f206c71 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-6a9e642d-287b-407c-9f86-deb53f206c71 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:08.112763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:08.114002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:08.115002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:08.117867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 459/916] 10.222.0.61 () {56 vars in 1126 bytes} [Sat May 14 15:34:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:08.125285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e642d-287b-407c-9f86-deb53f206c71 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:08.158388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 458/917] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:08.177498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90c974-91e7-4bc3-8d0a-c95e364728b1 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:08.283176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e642d-287b-407c-9f86-deb53f206c71 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:08.285773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90c974-91e7-4bc3-8d0a-c95e364728b1 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:08.323183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fda485-deb3-49f7-870f-f5e079e29668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:08.324333 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fda485-deb3-49f7-870f-f5e079e29668 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.324893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fda485-deb3-49f7-870f-f5e079e29668 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.325364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fda485-deb3-49f7-870f-f5e079e29668 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.326234 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fda485-deb3-49f7-870f-f5e079e29668 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:08.327917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fda485-deb3-49f7-870f-f5e079e29668 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:08.333393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991b0e8-db9c-44ad-9baa-6462601745a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:08.334507 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991b0e8-db9c-44ad-9baa-6462601745a9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.334966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991b0e8-db9c-44ad-9baa-6462601745a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.335978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991b0e8-db9c-44ad-9baa-6462601745a9 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.337258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991b0e8-db9c-44ad-9baa-6462601745a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:08.337787 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991b0e8-db9c-44ad-9baa-6462601745a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:08.339325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991b0e8-db9c-44ad-9baa-6462601745a9 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-26fda485-deb3-49f7-870f-f5e079e29668 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:08.343044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:08.344108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 14 15:34:08.344931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:08.353450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 460/918] 10.222.0.61 () {56 vars in 1122 bytes} [Sat May 14 15:34:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:08.353450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991b0e8-db9c-44ad-9baa-6462601745a9 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:08.354144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 459/919] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:34:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:08.355387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fda485-deb3-49f7-870f-f5e079e29668 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:08.463284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991b0e8-db9c-44ad-9baa-6462601745a9 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:08.485238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fda485-deb3-49f7-870f-f5e079e29668 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:08.507813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fdd4b-5eae-46e0-ba25-a0d5d6da4abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:08.508587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fdd4b-5eae-46e0-ba25-a0d5d6da4abb None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.508868 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fdd4b-5eae-46e0-ba25-a0d5d6da4abb None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.509133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fdd4b-5eae-46e0-ba25-a0d5d6da4abb None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.509859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fdd4b-5eae-46e0-ba25-a0d5d6da4abb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:08.510165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fdd4b-5eae-46e0-ba25-a0d5d6da4abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:08.511578 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284fdd4b-5eae-46e0-ba25-a0d5d6da4abb None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:08.521539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 461/920] 10.222.0.61 () {56 vars in 1122 bytes} [Sat May 14 15:34:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:08.521539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eece2-1165-4dfa-bcff-bd58b9886448 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.521539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eece2-1165-4dfa-bcff-bd58b9886448 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.521539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5eece2-1165-4dfa-bcff-bd58b9886448 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.521539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 462/921] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:08.525543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eece2-1165-4dfa-bcff-bd58b9886448 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:08.525746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436ffce-a7f3-4566-8520-c103b02915e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:08.526232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436ffce-a7f3-4566-8520-c103b02915e8 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.526556 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436ffce-a7f3-4566-8520-c103b02915e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.526807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436ffce-a7f3-4566-8520-c103b02915e8 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.527530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436ffce-a7f3-4566-8520-c103b02915e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:08.527880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436ffce-a7f3-4566-8520-c103b02915e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:08.529480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436ffce-a7f3-4566-8520-c103b02915e8 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:08.539162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 460/922] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:34:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:08.541592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812b0a7-306a-4bdf-b18e-9fa5a85a91e9 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.542071 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812b0a7-306a-4bdf-b18e-9fa5a85a91e9 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.542678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812b0a7-306a-4bdf-b18e-9fa5a85a91e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.561645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6812b0a7-306a-4bdf-b18e-9fa5a85a91e9 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:08.563519 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6812b0a7-306a-4bdf-b18e-9fa5a85a91e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:08.640841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5eece2-1165-4dfa-bcff-bd58b9886448 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:08.654529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 461/923] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:08.654529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812b0a7-306a-4bdf-b18e-9fa5a85a91e9 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:08.691887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7faa4b-e7f6-4a2c-982c-c0942250b4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:08.692992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7faa4b-e7f6-4a2c-982c-c0942250b4a6 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.693493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7faa4b-e7f6-4a2c-982c-c0942250b4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.693999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7faa4b-e7f6-4a2c-982c-c0942250b4a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.695370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7faa4b-e7f6-4a2c-982c-c0942250b4a6 None admin] RBAC: Adding query filter params (interface=public, service_id=cdaa558884034884a188a5a37e064828, region_id=RegionOne) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:08.695686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7faa4b-e7f6-4a2c-982c-c0942250b4a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:08.697069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7faa4b-e7f6-4a2c-982c-c0942250b4a6 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:08.704012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 463/924] 10.222.0.61 () {56 vars in 1251 bytes} [Sat May 14 15:34:08 2022] GET /identity/v3/endpoints?service_id=cdaa558884034884a188a5a37e064828&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:08.704691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7faa4b-e7f6-4a2c-982c-c0942250b4a6 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:08.760467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812b0a7-306a-4bdf-b18e-9fa5a85a91e9 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:08.801564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebec57-d723-4383-9510-f16efbaecbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:08.802227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebec57-d723-4383-9510-f16efbaecbae None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.802727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebec57-d723-4383-9510-f16efbaecbae None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.803218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebec57-d723-4383-9510-f16efbaecbae None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.804774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebec57-d723-4383-9510-f16efbaecbae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:08.805076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebec57-d723-4383-9510-f16efbaecbae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:08.806467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebec57-d723-4383-9510-f16efbaecbae None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:08.817415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 462/925] 10.222.0.61 () {56 vars in 1114 bytes} [Sat May 14 15:34:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:08.817415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebec57-d723-4383-9510-f16efbaecbae None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:08.820649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7faa4b-e7f6-4a2c-982c-c0942250b4a6 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:08.854298 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed06481-cc97-4a10-8b9e-2fb3806f653f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:08.855133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed06481-cc97-4a10-8b9e-2fb3806f653f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.855412 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed06481-cc97-4a10-8b9e-2fb3806f653f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.855685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed06481-cc97-4a10-8b9e-2fb3806f653f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.856331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed06481-cc97-4a10-8b9e-2fb3806f653f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:08.857680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed06481-cc97-4a10-8b9e-2fb3806f653f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-fed06481-cc97-4a10-8b9e-2fb3806f653f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:08.870493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:08.871496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:08.877555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 464/926] 10.222.0.61 () {56 vars in 1132 bytes} [Sat May 14 15:34:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:08.878467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed06481-cc97-4a10-8b9e-2fb3806f653f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:08.932848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebec57-d723-4383-9510-f16efbaecbae None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:08.966915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c0e53-650c-4d26-a5a7-c1864430920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:08.967578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c0e53-650c-4d26-a5a7-c1864430920f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:08.967860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c0e53-650c-4d26-a5a7-c1864430920f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:08.968132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c0e53-650c-4d26-a5a7-c1864430920f None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:08.968813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c0e53-650c-4d26-a5a7-c1864430920f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:08.970170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c0e53-650c-4d26-a5a7-c1864430920f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:08.973285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed06481-cc97-4a10-8b9e-2fb3806f653f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:08.986345 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 463/927] 10.222.0.61 () {56 vars in 1087 bytes} [Sat May 14 15:34:08 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:34:08.986345 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c0e53-650c-4d26-a5a7-c1864430920f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:09.011179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ec241-d12d-49ae-9347-fb24683c5860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:09.011856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec241-d12d-49ae-9347-fb24683c5860 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:09.012136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec241-d12d-49ae-9347-fb24683c5860 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:09.012411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ec241-d12d-49ae-9347-fb24683c5860 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:09.013183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ec241-d12d-49ae-9347-fb24683c5860 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:09.014736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ec241-d12d-49ae-9347-fb24683c5860 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:09.035800 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 465/928] 10.222.0.61 () {60 vars in 1144 bytes} [Sat May 14 15:34:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:34:09.103991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c0e53-650c-4d26-a5a7-c1864430920f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:09.152371 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e56b7-2c8f-414f-ad8a-19d9785d0911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:09.153351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e56b7-2c8f-414f-ad8a-19d9785d0911 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:09.153782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e56b7-2c8f-414f-ad8a-19d9785d0911 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:09.154203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e56b7-2c8f-414f-ad8a-19d9785d0911 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:09.155219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e56b7-2c8f-414f-ad8a-19d9785d0911 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:09.155769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e56b7-2c8f-414f-ad8a-19d9785d0911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:09.157537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e56b7-2c8f-414f-ad8a-19d9785d0911 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:09.164330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 464/929] 10.222.0.61 () {56 vars in 1126 bytes} [Sat May 14 15:34:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:09.172401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ec241-d12d-49ae-9347-fb24683c5860 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:09.283315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ec241-d12d-49ae-9347-fb24683c5860 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:09.322181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051aa9c-901e-4a24-bcf6-e270cde0231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:09.323165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051aa9c-901e-4a24-bcf6-e270cde0231e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:09.323599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051aa9c-901e-4a24-bcf6-e270cde0231e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:09.324024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051aa9c-901e-4a24-bcf6-e270cde0231e None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:09.324925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051aa9c-901e-4a24-bcf6-e270cde0231e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:09.325421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051aa9c-901e-4a24-bcf6-e270cde0231e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:09.327033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051aa9c-901e-4a24-bcf6-e270cde0231e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:09.333351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 466/930] 10.222.0.61 () {56 vars in 1126 bytes} [Sat May 14 15:34:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:09.339644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e56b7-2c8f-414f-ad8a-19d9785d0911 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:09.441842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e56b7-2c8f-414f-ad8a-19d9785d0911 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:09.476246 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e1eb7-8ec8-4109-baca-2c93bd7c4c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:09.477268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e1eb7-8ec8-4109-baca-2c93bd7c4c03 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:09.477549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e1eb7-8ec8-4109-baca-2c93bd7c4c03 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:09.477817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e1eb7-8ec8-4109-baca-2c93bd7c4c03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:09.478846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e1eb7-8ec8-4109-baca-2c93bd7c4c03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:09.480197 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e1eb7-8ec8-4109-baca-2c93bd7c4c03 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:09.501939 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 465/931] 10.222.0.61 () {60 vars in 1144 bytes} [Sat May 14 15:34:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:34:09.502299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a946f1-a517-44a9-b1b0-46ca943b7b02 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:09.503626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a946f1-a517-44a9-b1b0-46ca943b7b02 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:09.503938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a946f1-a517-44a9-b1b0-46ca943b7b02 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:09.505356 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 467/932] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:34:09.511794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e8a69-fd6c-49a5-9fcc-87f336c55f46 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:09.512651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e8a69-fd6c-49a5-9fcc-87f336c55f46 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:09.512651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e8a69-fd6c-49a5-9fcc-87f336c55f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:09.532025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-374e8a69-fd6c-49a5-9fcc-87f336c55f46 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:09.533242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-374e8a69-fd6c-49a5-9fcc-87f336c55f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:09.616000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 466/933] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:09.638729 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a946f1-a517-44a9-b1b0-46ca943b7b02 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:09.751064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a946f1-a517-44a9-b1b0-46ca943b7b02 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:09.785129 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a2ba-03bb-40a9-8c60-9f2daf02c390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:09.786336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a2ba-03bb-40a9-8c60-9f2daf02c390 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:09.786845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a2ba-03bb-40a9-8c60-9f2daf02c390 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:09.787310 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a2ba-03bb-40a9-8c60-9f2daf02c390 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:09.799155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2a2ba-03bb-40a9-8c60-9f2daf02c390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-8aa2a2ba-03bb-40a9-8c60-9f2daf02c390 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:34:09.807522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:09.808444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:09.809288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:09.811993 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 468/934] 10.222.0.61 () {56 vars in 1120 bytes} [Sat May 14 15:34:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:09.818347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e8a69-fd6c-49a5-9fcc-87f336c55f46 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:09.934278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e8a69-fd6c-49a5-9fcc-87f336c55f46 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:09.968426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff589e4b-f2d9-4f79-9913-d8026d202dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:09.969096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff589e4b-f2d9-4f79-9913-d8026d202dc9 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:09.969375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff589e4b-f2d9-4f79-9913-d8026d202dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:09.969650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff589e4b-f2d9-4f79-9913-d8026d202dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:09.970427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff589e4b-f2d9-4f79-9913-d8026d202dc9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:09.970732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff589e4b-f2d9-4f79-9913-d8026d202dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:09.972088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff589e4b-f2d9-4f79-9913-d8026d202dc9 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:09.981363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 467/935] 10.222.0.61 () {56 vars in 1115 bytes} [Sat May 14 15:34:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:09.987381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a2ba-03bb-40a9-8c60-9f2daf02c390 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:10.091568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a2ba-03bb-40a9-8c60-9f2daf02c390 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:10.125109 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178e59b-c3b1-492f-a529-42bb5fae5fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:10.125895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178e59b-c3b1-492f-a529-42bb5fae5fcf None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:10.126172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178e59b-c3b1-492f-a529-42bb5fae5fcf None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:10.126478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178e59b-c3b1-492f-a529-42bb5fae5fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:10.136921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178e59b-c3b1-492f-a529-42bb5fae5fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:10.138382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178e59b-c3b1-492f-a529-42bb5fae5fcf None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-2178e59b-c3b1-492f-a529-42bb5fae5fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:10.155529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:10.156425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:10.157407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:10.157407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:10.157407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:10.157407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:10.157407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 469/936] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:10.164542 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff589e4b-f2d9-4f79-9913-d8026d202dc9 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:10.269720 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff589e4b-f2d9-4f79-9913-d8026d202dc9 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:10.304800 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22b1e8-07e4-4be1-bc41-6b8072c5610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:10.305491 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22b1e8-07e4-4be1-bc41-6b8072c5610f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:10.305769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22b1e8-07e4-4be1-bc41-6b8072c5610f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:10.306042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22b1e8-07e4-4be1-bc41-6b8072c5610f None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:10.306824 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22b1e8-07e4-4be1-bc41-6b8072c5610f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:10.307126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22b1e8-07e4-4be1-bc41-6b8072c5610f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:10.308546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22b1e8-07e4-4be1-bc41-6b8072c5610f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:10.322275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 468/937] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:10.328053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178e59b-c3b1-492f-a529-42bb5fae5fcf None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:10.431589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178e59b-c3b1-492f-a529-42bb5fae5fcf None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:10.466786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f10e16-f184-471e-995e-0d29f5f314b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:10.467937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f10e16-f184-471e-995e-0d29f5f314b8 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:10.468443 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f10e16-f184-471e-995e-0d29f5f314b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:10.468940 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f10e16-f184-471e-995e-0d29f5f314b8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:10.476493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f10e16-f184-471e-995e-0d29f5f314b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:10.478460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f10e16-f184-471e-995e-0d29f5f314b8 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-59f10e16-f184-471e-995e-0d29f5f314b8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:34:10.494300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:10.495343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:10.496286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:10.496286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:10.496286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:34:10.496286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:34:10.496286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:34:10.496286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:34:10.496286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:34:10.496286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:34:10.496286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:34:10.496286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:10.498884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 470/938] 10.222.0.61 () {56 vars in 1117 bytes} [Sat May 14 15:34:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:10.504675 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22b1e8-07e4-4be1-bc41-6b8072c5610f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:10.606782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22b1e8-07e4-4be1-bc41-6b8072c5610f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:10.640180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c5b5-c3fd-4f68-9155-d8f0c0bb68db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:10.640843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c5b5-c3fd-4f68-9155-d8f0c0bb68db None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:10.641122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c5b5-c3fd-4f68-9155-d8f0c0bb68db None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:10.641391 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c11c5b5-c3fd-4f68-9155-d8f0c0bb68db None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:10.642216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11c5b5-c3fd-4f68-9155-d8f0c0bb68db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:10.642547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11c5b5-c3fd-4f68-9155-d8f0c0bb68db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:10.643950 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c11c5b5-c3fd-4f68-9155-d8f0c0bb68db None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:10.662406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 469/939] 10.222.0.61 () {56 vars in 1149 bytes} [Sat May 14 15:34:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:10.668013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f10e16-f184-471e-995e-0d29f5f314b8 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:10.772742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f10e16-f184-471e-995e-0d29f5f314b8 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:10.808144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626d8e-bd4c-4e4b-8e4d-b093983c1543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:10.809330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626d8e-bd4c-4e4b-8e4d-b093983c1543 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:10.809833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626d8e-bd4c-4e4b-8e4d-b093983c1543 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:10.810335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13626d8e-bd4c-4e4b-8e4d-b093983c1543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:10.821805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13626d8e-bd4c-4e4b-8e4d-b093983c1543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:10.823594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13626d8e-bd4c-4e4b-8e4d-b093983c1543 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-13626d8e-bd4c-4e4b-8e4d-b093983c1543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:10.854303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:10.855251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:10.856148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:10.856148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:10.856148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:10.856148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:10.862530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 471/940] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:10.867396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c5b5-c3fd-4f68-9155-d8f0c0bb68db None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:10.967738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c11c5b5-c3fd-4f68-9155-d8f0c0bb68db None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:11.003215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7ab7-5f13-46e3-83fc-824e3666b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:11.003876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7ab7-5f13-46e3-83fc-824e3666b434 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.004154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7ab7-5f13-46e3-83fc-824e3666b434 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.004423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a7ab7-5f13-46e3-83fc-824e3666b434 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.005143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a7ab7-5f13-46e3-83fc-824e3666b434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:11.005439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a7ab7-5f13-46e3-83fc-824e3666b434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:11.006846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a7ab7-5f13-46e3-83fc-824e3666b434 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:11.018725 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 470/941] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:11.025013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626d8e-bd4c-4e4b-8e4d-b093983c1543 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:11.127951 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13626d8e-bd4c-4e4b-8e4d-b093983c1543 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:11.163543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd188d-d574-414e-bc18-4c4849ba2ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:11.164730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd188d-d574-414e-bc18-4c4849ba2ac0 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.165246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd188d-d574-414e-bc18-4c4849ba2ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.165721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd188d-d574-414e-bc18-4c4849ba2ac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.172856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd188d-d574-414e-bc18-4c4849ba2ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:11.174543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd188d-d574-414e-bc18-4c4849ba2ac0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-05fd188d-d574-414e-bc18-4c4849ba2ac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:34:11.188968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:11.189849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:11.190773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:34:11.190773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:34:11.190773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:34:11.190773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:34:11.190773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:34:11.190773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:34:11.190773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:11.190773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:11.193156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 472/942] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:11.199274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7ab7-5f13-46e3-83fc-824e3666b434 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:11.308713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a7ab7-5f13-46e3-83fc-824e3666b434 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:11.343126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746312b-21e5-4088-8a0f-1e05fafc9aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:11.344164 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746312b-21e5-4088-8a0f-1e05fafc9aaa None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.344641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746312b-21e5-4088-8a0f-1e05fafc9aaa None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.345125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746312b-21e5-4088-8a0f-1e05fafc9aaa None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.346115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746312b-21e5-4088-8a0f-1e05fafc9aaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:11.346664 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746312b-21e5-4088-8a0f-1e05fafc9aaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:11.348276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746312b-21e5-4088-8a0f-1e05fafc9aaa None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:11.361420 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 471/943] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:11.367681 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd188d-d574-414e-bc18-4c4849ba2ac0 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:11.446338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcf3be-cd63-4ed7-8011-0e0a7910c008 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.446657 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcf3be-cd63-4ed7-8011-0e0a7910c008 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.446850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcf3be-cd63-4ed7-8011-0e0a7910c008 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.448349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 472/944] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:34:11.453729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ca400-d5ac-4242-8f30-224a4527bd77 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.454020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ca400-d5ac-4242-8f30-224a4527bd77 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.454297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ca400-d5ac-4242-8f30-224a4527bd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.473970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd188d-d574-414e-bc18-4c4849ba2ac0 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:11.479054 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-927ca400-d5ac-4242-8f30-224a4527bd77 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:11.480804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-927ca400-d5ac-4242-8f30-224a4527bd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:11.508843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2a627-83b4-42d2-b316-c2e83ef1e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:11.509725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2a627-83b4-42d2-b316-c2e83ef1e750 None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.510004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2a627-83b4-42d2-b316-c2e83ef1e750 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.510267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2a627-83b4-42d2-b316-c2e83ef1e750 None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/579cb64ce191482eb4ae03d099e8635d/roles/be2d9f91e4cb4dc0ad7bb5589d31739b` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.512657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2a627-83b4-42d2-b316-c2e83ef1e750 None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=579cb64ce191482eb4ae03d099e8635d, role_id=be2d9f91e4cb4dc0ad7bb5589d31739b)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:11.514076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2a627-83b4-42d2-b316-c2e83ef1e750 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:11.534605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 473/945] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:34:11 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/579cb64ce191482eb4ae03d099e8635d/roles/be2d9f91e4cb4dc0ad7bb5589d31739b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:34:11.536225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81429280-0e7a-415e-987a-baa3c6bb8f60 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.536518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81429280-0e7a-415e-987a-baa3c6bb8f60 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.536792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81429280-0e7a-415e-987a-baa3c6bb8f60 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.542348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 474/946] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:11.544893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ec3e-f69b-4b46-b987-c1793902b6b5 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.545443 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ec3e-f69b-4b46-b987-c1793902b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.545681 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ec3e-f69b-4b46-b987-c1793902b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.564582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9ac2ec3e-f69b-4b46-b987-c1793902b6b5 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:11.565243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 473/947] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:11.566008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9ac2ec3e-f69b-4b46-b987-c1793902b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:11.583574 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ca400-d5ac-4242-8f30-224a4527bd77 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:11.641737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 475/948] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:11.666354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2ec3e-f69b-4b46-b987-c1793902b6b5 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:11.701513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ca400-d5ac-4242-8f30-224a4527bd77 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:11.742551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1b9f5-9c92-47a9-acf4-4c10a8232293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:11.743715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1b9f5-9c92-47a9-acf4-4c10a8232293 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.744961 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1b9f5-9c92-47a9-acf4-4c10a8232293 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.745423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1b9f5-9c92-47a9-acf4-4c10a8232293 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.746415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1b9f5-9c92-47a9-acf4-4c10a8232293 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:11.748133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1b9f5-9c92-47a9-acf4-4c10a8232293 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:11.750179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: WARNING keystone.server.flask.common [None req-7fa1b9f5-9c92-47a9-acf4-4c10a8232293 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 14 15:34:11.770787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.sql.core [None req-7fa1b9f5-9c92-47a9-acf4-4c10a8232293 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 14 15:34:11.770787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 14 15:34:11.770787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [parameters: {'id': 'dd5ec05cfe314471a4bb7f54f02117cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 14 15:34:11.770787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86463) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 14 15:34:11.782366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2ec3e-f69b-4b46-b987-c1793902b6b5 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-7fa1b9f5-9c92-47a9-acf4-4c10a8232293 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dd5ec05cfe314471a4bb7f54f02117cc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dd5ec05cfe314471a4bb7f54f02117cc. May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application result = self._query(query) May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application conn.query(q) May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 15:34:11.787932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application result.read() May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 14 15:34:11.788957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return project_ref.to_dict() May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application next(self.gen) May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application yield resource May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application next(self.gen) May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self.session.rollback() May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self.force_reraise() May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise self.value May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application session.commit() May 14 15:34:11.789935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._prepare_impl() May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self.session.flush() May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._flush(objects) May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application compat.raise_( May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application flush_context.execute() May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 15:34:11.790933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rec.execute(self) May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application _emit_insert_statements( May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application c = connection._execute_20( May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ret = self._execute_context( May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 14 15:34:11.791887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application result = self._query(query) May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application conn.query(q) May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application result.read() May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 15:34:11.792699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [parameters: {'id': 'dd5ec05cfe314471a4bb7f54f02117cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:11.793567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:11.803696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:11.806478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:11.806478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 14 15:34:11.806478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 14 15:34:11.806478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:11.806478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:11.806478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 14 15:34:11.806478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.Conflict( May 14 15:34:11.806478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dd5ec05cfe314471a4bb7f54f02117cc. May 14 15:34:11.806478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:11.806478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 474/949] 10.222.0.61 () {60 vars in 1140 bytes} [Sat May 14 15:34:11 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:11.806478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1b9f5-9c92-47a9-acf4-4c10a8232293 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:11.828391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7b3a5-7665-4e8e-907b-686b974e0b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:11.829199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7b3a5-7665-4e8e-907b-686b974e0b05 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.829627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7b3a5-7665-4e8e-907b-686b974e0b05 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.830158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7b3a5-7665-4e8e-907b-686b974e0b05 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.833157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7b3a5-7665-4e8e-907b-686b974e0b05 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:11.833157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7b3a5-7665-4e8e-907b-686b974e0b05 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f8e7b3a5-7665-4e8e-907b-686b974e0b05 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:11.850357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:11.852258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:11.853597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 476/950] 10.222.0.61 () {56 vars in 1126 bytes} [Sat May 14 15:34:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:11.855261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737094a-0294-4d18-a9d0-d58bb5b6fb1a None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.855617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737094a-0294-4d18-a9d0-d58bb5b6fb1a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.856192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737094a-0294-4d18-a9d0-d58bb5b6fb1a None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.857689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 477/951] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:11.858265 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737094a-0294-4d18-a9d0-d58bb5b6fb1a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:11.910686 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1b9f5-9c92-47a9-acf4-4c10a8232293 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:11.945723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796b329-36c5-4f2c-b5b4-70831e7810c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:11.946543 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b329-36c5-4f2c-b5b4-70831e7810c8 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.946824 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b329-36c5-4f2c-b5b4-70831e7810c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.947094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796b329-36c5-4f2c-b5b4-70831e7810c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.954439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796b329-36c5-4f2c-b5b4-70831e7810c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:11.956032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796b329-36c5-4f2c-b5b4-70831e7810c8 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:11.962657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737094a-0294-4d18-a9d0-d58bb5b6fb1a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-d796b329-36c5-4f2c-b5b4-70831e7810c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:34:11.970490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:11.971697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:11.972616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:34:11.972616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:34:11.972616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:34:11.972616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:34:11.972616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:34:11.972616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:34:11.972616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:11.972616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:11.972616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 475/952] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:11.973633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b391-b7eb-49e4-8f1f-63d7cbca0317 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:11.973633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b391-b7eb-49e4-8f1f-63d7cbca0317 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:11.973633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539b391-b7eb-49e4-8f1f-63d7cbca0317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:11.994236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6539b391-b7eb-49e4-8f1f-63d7cbca0317 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:11.996393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6539b391-b7eb-49e4-8f1f-63d7cbca0317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:12.002078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c2344-4840-4949-bbff-f2dd7e0f8d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:12.002783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c2344-4840-4949-bbff-f2dd7e0f8d3d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:12.003066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c2344-4840-4949-bbff-f2dd7e0f8d3d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:12.003341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c2344-4840-4949-bbff-f2dd7e0f8d3d None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:12.004328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c2344-4840-4949-bbff-f2dd7e0f8d3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:12.004328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c2344-4840-4949-bbff-f2dd7e0f8d3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:12.005706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c2344-4840-4949-bbff-f2dd7e0f8d3d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:12.010793 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 478/953] 10.222.0.61 () {56 vars in 1122 bytes} [Sat May 14 15:34:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:12.010793 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c2344-4840-4949-bbff-f2dd7e0f8d3d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:12.068541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 476/954] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:12.070343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b391-b7eb-49e4-8f1f-63d7cbca0317 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:12.125479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c2344-4840-4949-bbff-f2dd7e0f8d3d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:12.159345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3a435-ea19-423d-a576-99b0e9dc7e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:12.159998 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3a435-ea19-423d-a576-99b0e9dc7e01 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:12.160278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3a435-ea19-423d-a576-99b0e9dc7e01 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:12.160550 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3a435-ea19-423d-a576-99b0e9dc7e01 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:12.161290 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3a435-ea19-423d-a576-99b0e9dc7e01 None admin] RBAC: Adding query filter params (name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:12.161597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3a435-ea19-423d-a576-99b0e9dc7e01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:12.163043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3a435-ea19-423d-a576-99b0e9dc7e01 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:12.171623 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539b391-b7eb-49e4-8f1f-63d7cbca0317 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:12.190569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 479/955] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:34:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:12.190569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3a435-ea19-423d-a576-99b0e9dc7e01 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:12.224160 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aba5c-ed1f-4dc4-b261-cd4203ca38de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:12.224912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aba5c-ed1f-4dc4-b261-cd4203ca38de None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:12.225197 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aba5c-ed1f-4dc4-b261-cd4203ca38de None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:12.225467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aba5c-ed1f-4dc4-b261-cd4203ca38de None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:12.226844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aba5c-ed1f-4dc4-b261-cd4203ca38de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:12.227147 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aba5c-ed1f-4dc4-b261-cd4203ca38de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:12.228799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aba5c-ed1f-4dc4-b261-cd4203ca38de None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:12.239212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 477/956] 10.222.0.61 () {56 vars in 1122 bytes} [Sat May 14 15:34:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:12.244964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aba5c-ed1f-4dc4-b261-cd4203ca38de None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:12.311166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3a435-ea19-423d-a576-99b0e9dc7e01 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:12.357841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e753bfe-60f0-4cd3-bf25-2c78fc9da6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:12.359343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e753bfe-60f0-4cd3-bf25-2c78fc9da6b6 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:12.359713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e753bfe-60f0-4cd3-bf25-2c78fc9da6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:12.360058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e753bfe-60f0-4cd3-bf25-2c78fc9da6b6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:12.361051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e753bfe-60f0-4cd3-bf25-2c78fc9da6b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:12.363041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e753bfe-60f0-4cd3-bf25-2c78fc9da6b6 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:12.373569 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aba5c-ed1f-4dc4-b261-cd4203ca38de None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-0e753bfe-60f0-4cd3-bf25-2c78fc9da6b6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:12.379277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:12.381358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:12.384703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 480/957] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:34:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:12.388182 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e753bfe-60f0-4cd3-bf25-2c78fc9da6b6 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:12.419050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ff052-49d5-4824-94d7-4e85008dedc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:12.419717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ff052-49d5-4824-94d7-4e85008dedc8 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:12.420003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ff052-49d5-4824-94d7-4e85008dedc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:12.420278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ff052-49d5-4824-94d7-4e85008dedc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:12.421061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ff052-49d5-4824-94d7-4e85008dedc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:12.423428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ff052-49d5-4824-94d7-4e85008dedc8 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:12.449248 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 478/958] 10.222.0.61 () {60 vars in 1144 bytes} [Sat May 14 15:34:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:34:12.512892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e753bfe-60f0-4cd3-bf25-2c78fc9da6b6 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:12.558561 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c167f5-f5c1-4002-b65c-14c86f7a49ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:12.559479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c167f5-f5c1-4002-b65c-14c86f7a49ac None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:12.559982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c167f5-f5c1-4002-b65c-14c86f7a49ac None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:12.560399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c167f5-f5c1-4002-b65c-14c86f7a49ac None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:12.561258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c167f5-f5c1-4002-b65c-14c86f7a49ac None admin] RBAC: Adding query filter params (name=compute) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:12.561708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c167f5-f5c1-4002-b65c-14c86f7a49ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:12.563322 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c167f5-f5c1-4002-b65c-14c86f7a49ac None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:12.573223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 481/959] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:34:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:12.575697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ff052-49d5-4824-94d7-4e85008dedc8 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:12.685913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ff052-49d5-4824-94d7-4e85008dedc8 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:12.719799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109afd0-6bec-4f4b-b017-91830cdd3f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:12.720476 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109afd0-6bec-4f4b-b017-91830cdd3f19 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:12.720758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109afd0-6bec-4f4b-b017-91830cdd3f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:12.721033 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109afd0-6bec-4f4b-b017-91830cdd3f19 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:12.721752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109afd0-6bec-4f4b-b017-91830cdd3f19 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:12.722058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109afd0-6bec-4f4b-b017-91830cdd3f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:12.723493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109afd0-6bec-4f4b-b017-91830cdd3f19 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:12.729774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 479/960] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:34:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:13.854504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b40f2-86ca-4788-be48-a146ba30e540 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:13.854974 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b40f2-86ca-4788-be48-a146ba30e540 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:13.855073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b40f2-86ca-4788-be48-a146ba30e540 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:13.856645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 482/961] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:13.862036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b624f-8ecd-4575-8cec-862ea9748a3d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:13.862451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b624f-8ecd-4575-8cec-862ea9748a3d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:13.862628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b624f-8ecd-4575-8cec-862ea9748a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:13.880641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-250b624f-8ecd-4575-8cec-862ea9748a3d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:13.882392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-250b624f-8ecd-4575-8cec-862ea9748a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:13.952237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 480/962] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:13.975430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b40f2-86ca-4788-be48-a146ba30e540 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:14.081254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b40f2-86ca-4788-be48-a146ba30e540 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:14.115664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e0cac-9cc6-4721-a021-ae45b7dcbc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:14.116926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e0cac-9cc6-4721-a021-ae45b7dcbc58 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:14.117205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e0cac-9cc6-4721-a021-ae45b7dcbc58 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:14.117476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e0cac-9cc6-4721-a021-ae45b7dcbc58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:14.128174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e0cac-9cc6-4721-a021-ae45b7dcbc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-0b7e0cac-9cc6-4721-a021-ae45b7dcbc58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:34:14.136703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:14.137614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:14.139196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 483/963] 10.222.0.61 () {56 vars in 1120 bytes} [Sat May 14 15:34:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:14.143827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b624f-8ecd-4575-8cec-862ea9748a3d None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:14.244269 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b624f-8ecd-4575-8cec-862ea9748a3d None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:14.279480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2378cf-4ed5-4bfa-adb3-e214f5929c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:14.280151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2378cf-4ed5-4bfa-adb3-e214f5929c77 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:14.280435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2378cf-4ed5-4bfa-adb3-e214f5929c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:14.280710 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2378cf-4ed5-4bfa-adb3-e214f5929c77 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:14.281461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2378cf-4ed5-4bfa-adb3-e214f5929c77 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:14.281767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2378cf-4ed5-4bfa-adb3-e214f5929c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:14.283159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2378cf-4ed5-4bfa-adb3-e214f5929c77 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:14.291656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 481/964] 10.222.0.61 () {56 vars in 1115 bytes} [Sat May 14 15:34:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:14.297167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e0cac-9cc6-4721-a021-ae45b7dcbc58 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:14.404558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e0cac-9cc6-4721-a021-ae45b7dcbc58 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:14.443888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b9c2c-6f77-4cdd-965a-07fafe26d043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:14.445265 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b9c2c-6f77-4cdd-965a-07fafe26d043 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:14.445543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b9c2c-6f77-4cdd-965a-07fafe26d043 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:14.445807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b9c2c-6f77-4cdd-965a-07fafe26d043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:14.456832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b9c2c-6f77-4cdd-965a-07fafe26d043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:14.458288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b9c2c-6f77-4cdd-965a-07fafe26d043 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-c95b9c2c-6f77-4cdd-965a-07fafe26d043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:14.476848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:14.479089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:14.480319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:14.480319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:14.480319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:14.480319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:14.480319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 484/965] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:14.483970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2378cf-4ed5-4bfa-adb3-e214f5929c77 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:14.589939 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2378cf-4ed5-4bfa-adb3-e214f5929c77 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:14.620939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eda350-1bed-4142-83cd-1a84fffd65d5 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:14.621279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eda350-1bed-4142-83cd-1a84fffd65d5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:14.621797 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eda350-1bed-4142-83cd-1a84fffd65d5 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:14.623722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 485/966] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:14.626416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71505186-ba7a-410d-822e-aeb9bed7762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:14.627088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71505186-ba7a-410d-822e-aeb9bed7762a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:14.627577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71505186-ba7a-410d-822e-aeb9bed7762a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:14.627750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71505186-ba7a-410d-822e-aeb9bed7762a None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:14.628442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71505186-ba7a-410d-822e-aeb9bed7762a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:14.628749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71505186-ba7a-410d-822e-aeb9bed7762a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:14.628911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22078c2-07a3-48af-b6a9-a7960b01204e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:14.629056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22078c2-07a3-48af-b6a9-a7960b01204e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:14.629319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22078c2-07a3-48af-b6a9-a7960b01204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:14.630126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71505186-ba7a-410d-822e-aeb9bed7762a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:14.643098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 482/967] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:14.649082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71505186-ba7a-410d-822e-aeb9bed7762a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:14.649494 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c22078c2-07a3-48af-b6a9-a7960b01204e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:14.650644 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c22078c2-07a3-48af-b6a9-a7960b01204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:14.738466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 486/968] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:14.761384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71505186-ba7a-410d-822e-aeb9bed7762a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:14.762454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22078c2-07a3-48af-b6a9-a7960b01204e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:14.793525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad0b06-e986-47eb-8c47-28f06290488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:14.794361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad0b06-e986-47eb-8c47-28f06290488b None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:14.794650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad0b06-e986-47eb-8c47-28f06290488b None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:14.794928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad0b06-e986-47eb-8c47-28f06290488b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:14.802122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad0b06-e986-47eb-8c47-28f06290488b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:14.804465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad0b06-e986-47eb-8c47-28f06290488b None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-8dad0b06-e986-47eb-8c47-28f06290488b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:34:14.819156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:14.820898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:14.822421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:14.822421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:14.822421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:34:14.822421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:34:14.822421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:34:14.822421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:34:14.822421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:34:14.822421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:34:14.822421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 14 15:34:14.822421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:14.822421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 483/969] 10.222.0.61 () {56 vars in 1117 bytes} [Sat May 14 15:34:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:14.823016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99898d-0b33-43d8-8923-ccc706bb0905 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:14.823016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99898d-0b33-43d8-8923-ccc706bb0905 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:14.823144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99898d-0b33-43d8-8923-ccc706bb0905 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:14.824471 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 484/970] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:14.829136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99898d-0b33-43d8-8923-ccc706bb0905 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:14.871197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22078c2-07a3-48af-b6a9-a7960b01204e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:14.906423 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e8be6-a1d7-4af1-a578-c4943ff2613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:14.907102 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e8be6-a1d7-4af1-a578-c4943ff2613e None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:14.907381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e8be6-a1d7-4af1-a578-c4943ff2613e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:14.907655 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e8be6-a1d7-4af1-a578-c4943ff2613e None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:14.908359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e8be6-a1d7-4af1-a578-c4943ff2613e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:14.909786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4e8be6-a1d7-4af1-a578-c4943ff2613e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:14.911126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: WARNING keystone.server.flask.common [None req-2c4e8be6-a1d7-4af1-a578-c4943ff2613e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 14 15:34:14.923432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.sql.core [None req-2c4e8be6-a1d7-4af1-a578-c4943ff2613e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 14 15:34:14.923432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 14 15:34:14.923432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [parameters: {'user_id': '5e9455064f854b1a8c181c29e5ff709c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 14 15:34:14.923432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86464) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-2c4e8be6-a1d7-4af1-a578-c4943ff2613e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application result = self._query(query) May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application conn.query(q) May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application result.read() May 14 15:34:14.930890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 15:34:14.931803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application next(self.gen) May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application yield resource May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application next(self.gen) May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self.session.rollback() May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self.force_reraise() May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise self.value May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application session.commit() May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 14 15:34:14.933439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._prepare_impl() May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self.session.flush() May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._flush(objects) May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application compat.raise_( May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application flush_context.execute() May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rec.execute(self) May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 14 15:34:14.934374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application _emit_insert_statements( May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application result = connection._execute_20( May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ret = self._execute_context( May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 15:34:14.935465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self.dialect.do_execute( May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application result = self._query(query) May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application conn.query(q) May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application result.read() May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 15:34:14.938025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application packet.raise_for_error() May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [parameters: {'user_id': '5e9455064f854b1a8c181c29e5ff709c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:14.940237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 14 15:34:14.943386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 14 15:34:14.945662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 14 15:34:14.945662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 14 15:34:14.945662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 14 15:34:14.945662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 14 15:34:14.945662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 14 15:34:14.945662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:14.945662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 487/971] 10.222.0.61 () {60 vars in 1131 bytes} [Sat May 14 15:34:14 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:14.945662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9435a-0fb9-48ae-bd01-b123bcbb25fb None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:14.945662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9435a-0fb9-48ae-bd01-b123bcbb25fb None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:14.945662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9435a-0fb9-48ae-bd01-b123bcbb25fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:14.947058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99898d-0b33-43d8-8923-ccc706bb0905 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:14.953131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-1ad9435a-0fb9-48ae-bd01-b123bcbb25fb None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:14.954731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1ad9435a-0fb9-48ae-bd01-b123bcbb25fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:14.977359 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b387c-92e8-4a33-b2bc-06ba18a10aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:14.978294 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b387c-92e8-4a33-b2bc-06ba18a10aca None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:14.978612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b387c-92e8-4a33-b2bc-06ba18a10aca None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:14.978888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b387c-92e8-4a33-b2bc-06ba18a10aca None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:14.979724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b387c-92e8-4a33-b2bc-06ba18a10aca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:14.980035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b387c-92e8-4a33-b2bc-06ba18a10aca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:14.981447 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b387c-92e8-4a33-b2bc-06ba18a10aca None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:15.004232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 485/972] 10.222.0.61 () {56 vars in 1149 bytes} [Sat May 14 15:34:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:15.004232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b387c-92e8-4a33-b2bc-06ba18a10aca None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:15.031999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 488/973] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:15.033114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9435a-0fb9-48ae-bd01-b123bcbb25fb None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:15.100625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b387c-92e8-4a33-b2bc-06ba18a10aca None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:15.127026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9435a-0fb9-48ae-bd01-b123bcbb25fb None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:15.132682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8a0c0-6412-4acd-8432-84b61dd62def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:15.133472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8a0c0-6412-4acd-8432-84b61dd62def None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:15.133753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8a0c0-6412-4acd-8432-84b61dd62def None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:15.134020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8a0c0-6412-4acd-8432-84b61dd62def None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:15.140722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8a0c0-6412-4acd-8432-84b61dd62def None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:15.142137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8a0c0-6412-4acd-8432-84b61dd62def None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-d1f8a0c0-6412-4acd-8432-84b61dd62def None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:34:15.157633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:15.158789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 486/974] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:34:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:15.160074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ea7ab-0f8a-4c71-868c-ed7389bc8d02 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:15.160883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ea7ab-0f8a-4c71-868c-ed7389bc8d02 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:15.160883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ea7ab-0f8a-4c71-868c-ed7389bc8d02 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:15.161886 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 487/975] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:15.163461 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df76127-5041-4335-83a3-5a0ca58ecdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:15.163762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ea7ab-0f8a-4c71-868c-ed7389bc8d02 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:15.163892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df76127-5041-4335-83a3-5a0ca58ecdd6 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:15.163892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df76127-5041-4335-83a3-5a0ca58ecdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:15.164316 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df76127-5041-4335-83a3-5a0ca58ecdd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:15.227249 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df76127-5041-4335-83a3-5a0ca58ecdd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:15.229180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df76127-5041-4335-83a3-5a0ca58ecdd6 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:15.264999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ea7ab-0f8a-4c71-868c-ed7389bc8d02 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:15.297326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63b02d-b440-4345-8d80-4679bd187aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:15.298118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b02d-b440-4345-8d80-4679bd187aee None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:15.298426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b02d-b440-4345-8d80-4679bd187aee None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:15.298724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63b02d-b440-4345-8d80-4679bd187aee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:15.299345 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63b02d-b440-4345-8d80-4679bd187aee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:15.300703 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb63b02d-b440-4345-8d80-4679bd187aee None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-fb63b02d-b440-4345-8d80-4679bd187aee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:15.312924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:15.314169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:15.315063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 488/976] 10.222.0.61 () {56 vars in 1126 bytes} [Sat May 14 15:34:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:15.315875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63b02d-b440-4345-8d80-4679bd187aee None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:15.324963 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 489/977] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:34:15 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:34:15.326254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adda7e-41db-4466-85a7-a93d7f4b648d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:15.326579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adda7e-41db-4466-85a7-a93d7f4b648d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:15.326860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adda7e-41db-4466-85a7-a93d7f4b648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:15.342462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b7adda7e-41db-4466-85a7-a93d7f4b648d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:15.343632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b7adda7e-41db-4466-85a7-a93d7f4b648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:15.407146 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 490/978] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:15.407967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adda7e-41db-4466-85a7-a93d7f4b648d None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:15.408400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63b02d-b440-4345-8d80-4679bd187aee None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:15.441088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab40a27-93bd-4290-bc8b-0db41a113790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:15.441746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab40a27-93bd-4290-bc8b-0db41a113790 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:15.442024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab40a27-93bd-4290-bc8b-0db41a113790 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:15.442291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab40a27-93bd-4290-bc8b-0db41a113790 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:15.443106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab40a27-93bd-4290-bc8b-0db41a113790 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:15.443414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab40a27-93bd-4290-bc8b-0db41a113790 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:15.445035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab40a27-93bd-4290-bc8b-0db41a113790 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:15.479223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 489/979] 10.222.0.61 () {56 vars in 1101 bytes} [Sat May 14 15:34:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:15.480036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab40a27-93bd-4290-bc8b-0db41a113790 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:15.514478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adda7e-41db-4466-85a7-a93d7f4b648d None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:15.551099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506587db-d927-4da5-9a84-9006a89934ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:15.551689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506587db-d927-4da5-9a84-9006a89934ca None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:15.551967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506587db-d927-4da5-9a84-9006a89934ca None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:15.552241 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506587db-d927-4da5-9a84-9006a89934ca None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:15.552959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506587db-d927-4da5-9a84-9006a89934ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:15.553267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506587db-d927-4da5-9a84-9006a89934ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:15.554827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506587db-d927-4da5-9a84-9006a89934ca None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:15.567466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 491/980] 10.222.0.61 () {56 vars in 1122 bytes} [Sat May 14 15:34:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:15.567466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506587db-d927-4da5-9a84-9006a89934ca None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:15.591737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab40a27-93bd-4290-bc8b-0db41a113790 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:15.628199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f836d8-dbf4-45bc-9be2-2e7361b1586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:15.629014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f836d8-dbf4-45bc-9be2-2e7361b1586a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:15.629294 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f836d8-dbf4-45bc-9be2-2e7361b1586a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:15.629567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f836d8-dbf4-45bc-9be2-2e7361b1586a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:15.641018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f836d8-dbf4-45bc-9be2-2e7361b1586a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:15.642531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f836d8-dbf4-45bc-9be2-2e7361b1586a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-e1f836d8-dbf4-45bc-9be2-2e7361b1586a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:15.661621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:15.662769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:15.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:15.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:15.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:15.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:15.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 490/981] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:15.664465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f836d8-dbf4-45bc-9be2-2e7361b1586a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:15.674957 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506587db-d927-4da5-9a84-9006a89934ca None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:15.711000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615a215-744d-493a-a4b2-1bc32324e8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:15.711668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615a215-744d-493a-a4b2-1bc32324e8a0 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:15.711947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615a215-744d-493a-a4b2-1bc32324e8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:15.712226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615a215-744d-493a-a4b2-1bc32324e8a0 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:15.713262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615a215-744d-493a-a4b2-1bc32324e8a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:15.714366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615a215-744d-493a-a4b2-1bc32324e8a0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:15.729525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 492/982] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:34:15 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:34:15.730536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615a215-744d-493a-a4b2-1bc32324e8a0 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:15.782826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f836d8-dbf4-45bc-9be2-2e7361b1586a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:15.846764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e663ec-a820-4073-9f3e-bd3b0837a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:15.847464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e663ec-a820-4073-9f3e-bd3b0837a881 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:15.847752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e663ec-a820-4073-9f3e-bd3b0837a881 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:15.848024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e663ec-a820-4073-9f3e-bd3b0837a881 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:15.848735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e663ec-a820-4073-9f3e-bd3b0837a881 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:15.849031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e663ec-a820-4073-9f3e-bd3b0837a881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:15.850459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e663ec-a820-4073-9f3e-bd3b0837a881 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:15.856402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 491/983] 10.222.0.61 () {56 vars in 1122 bytes} [Sat May 14 15:34:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:15.862534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615a215-744d-493a-a4b2-1bc32324e8a0 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:15.862791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e663ec-a820-4073-9f3e-bd3b0837a881 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:15.903019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd27f-c6e5-41cc-ba74-a07673914283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:15.903781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd27f-c6e5-41cc-ba74-a07673914283 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:15.904082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd27f-c6e5-41cc-ba74-a07673914283 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:15.904359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcd27f-c6e5-41cc-ba74-a07673914283 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:15.905098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcd27f-c6e5-41cc-ba74-a07673914283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:15.905406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcd27f-c6e5-41cc-ba74-a07673914283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:15.906868 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcd27f-c6e5-41cc-ba74-a07673914283 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:15.920560 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 493/984] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:15.926568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd27f-c6e5-41cc-ba74-a07673914283 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:15.966522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e663ec-a820-4073-9f3e-bd3b0837a881 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:16.000701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eda67-ac5b-4c57-8d92-d593220bb694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:16.001361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eda67-ac5b-4c57-8d92-d593220bb694 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:16.001645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eda67-ac5b-4c57-8d92-d593220bb694 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:16.001917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eda67-ac5b-4c57-8d92-d593220bb694 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:16.002752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eda67-ac5b-4c57-8d92-d593220bb694 None admin] RBAC: Adding query filter params (interface=admin, service_id=cdaa558884034884a188a5a37e064828, region_id=RegionOne) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:16.003063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eda67-ac5b-4c57-8d92-d593220bb694 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:16.004423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eda67-ac5b-4c57-8d92-d593220bb694 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:16.009882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 492/985] 10.222.0.61 () {56 vars in 1249 bytes} [Sat May 14 15:34:15 2022] GET /identity/v3/endpoints?service_id=cdaa558884034884a188a5a37e064828&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:16.015202 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eda67-ac5b-4c57-8d92-d593220bb694 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:16.031107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcd27f-c6e5-41cc-ba74-a07673914283 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:16.064760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbed88-6847-43bd-b248-85754db4e55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:16.065551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbed88-6847-43bd-b248-85754db4e55b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:16.065826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbed88-6847-43bd-b248-85754db4e55b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:16.066093 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbed88-6847-43bd-b248-85754db4e55b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:16.073382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbed88-6847-43bd-b248-85754db4e55b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:16.074849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbed88-6847-43bd-b248-85754db4e55b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-a9cbed88-6847-43bd-b248-85754db4e55b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:34:16.088991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:16.089946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:16.091186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:34:16.091186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:34:16.091186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:34:16.091186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:34:16.091186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:34:16.091186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:34:16.091186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:16.091186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:16.094617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 494/986] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:34:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:16.095669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbed88-6847-43bd-b248-85754db4e55b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:16.113163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eda67-ac5b-4c57-8d92-d593220bb694 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:16.146405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f86595-6651-496d-bf0a-d11c616dd2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:16.147079 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f86595-6651-496d-bf0a-d11c616dd2d1 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:16.147363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f86595-6651-496d-bf0a-d11c616dd2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:16.148190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f86595-6651-496d-bf0a-d11c616dd2d1 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:16.148879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f86595-6651-496d-bf0a-d11c616dd2d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:16.150242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f86595-6651-496d-bf0a-d11c616dd2d1 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:16.156728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 493/987] 10.222.0.61 () {56 vars in 1087 bytes} [Sat May 14 15:34:16 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:34:16.196919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbed88-6847-43bd-b248-85754db4e55b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:16.232479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7555df6-7692-406e-b933-5eafee43a5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:16.233156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7555df6-7692-406e-b933-5eafee43a5f1 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:16.233434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7555df6-7692-406e-b933-5eafee43a5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:16.233705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7555df6-7692-406e-b933-5eafee43a5f1 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:16.234533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7555df6-7692-406e-b933-5eafee43a5f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:16.234842 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7555df6-7692-406e-b933-5eafee43a5f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:16.236293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7555df6-7692-406e-b933-5eafee43a5f1 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:16.254640 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 495/988] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:34:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:16.256218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f86595-6651-496d-bf0a-d11c616dd2d1 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:16.358526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f86595-6651-496d-bf0a-d11c616dd2d1 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:16.391680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689eab1e-cd81-4850-a115-59836d82082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:16.392336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eab1e-cd81-4850-a115-59836d82082c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:16.392616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eab1e-cd81-4850-a115-59836d82082c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:16.392898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689eab1e-cd81-4850-a115-59836d82082c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:16.393722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eab1e-cd81-4850-a115-59836d82082c None admin] RBAC: Adding query filter params (role.id=be2d9f91e4cb4dc0ad7bb5589d31739b, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=579cb64ce191482eb4ae03d099e8635d) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:16.394031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eab1e-cd81-4850-a115-59836d82082c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:16.395473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689eab1e-cd81-4850-a115-59836d82082c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:16.406382 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 494/989] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:34:16 2022] GET /identity/v3/role_assignments?user.id=579cb64ce191482eb4ae03d099e8635d&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=be2d9f91e4cb4dc0ad7bb5589d31739b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:17.983204 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d32677-f447-41eb-b47d-a6e00706b090 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:17.983716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d32677-f447-41eb-b47d-a6e00706b090 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:17.983828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d32677-f447-41eb-b47d-a6e00706b090 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:17.985275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 496/990] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:17.990619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d58e1-2e90-4715-91cf-cb7cb058bdee None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:17.991042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d58e1-2e90-4715-91cf-cb7cb058bdee None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:17.991273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d58e1-2e90-4715-91cf-cb7cb058bdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.008112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-922d58e1-2e90-4715-91cf-cb7cb058bdee None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:18.009279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-922d58e1-2e90-4715-91cf-cb7cb058bdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:18.073328 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 495/991] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:18.095532 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d32677-f447-41eb-b47d-a6e00706b090 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:18.193701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d32677-f447-41eb-b47d-a6e00706b090 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:18.229918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1413a2-403b-4109-b05c-8e8e40c791d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:18.230735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1413a2-403b-4109-b05c-8e8e40c791d9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.231017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1413a2-403b-4109-b05c-8e8e40c791d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.231292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1413a2-403b-4109-b05c-8e8e40c791d9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.231941 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1413a2-403b-4109-b05c-8e8e40c791d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:18.233297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1413a2-403b-4109-b05c-8e8e40c791d9 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-2f1413a2-403b-4109-b05c-8e8e40c791d9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:18.245059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:18.246080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 15:34:18.246996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:18.248533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 497/992] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:34:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:18.252292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d58e1-2e90-4715-91cf-cb7cb058bdee None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:18.347729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d58e1-2e90-4715-91cf-cb7cb058bdee None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:18.374880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d610-a6f7-487b-9fa2-315a50aef3b5 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.375196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d610-a6f7-487b-9fa2-315a50aef3b5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.375445 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d610-a6f7-487b-9fa2-315a50aef3b5 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.376813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 498/993] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:34:18.380506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bdf6c-dd49-48a0-9385-6972c82b008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:18.381181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bdf6c-dd49-48a0-9385-6972c82b008d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.381465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bdf6c-dd49-48a0-9385-6972c82b008d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.382348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084bdf6c-dd49-48a0-9385-6972c82b008d None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.382586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866c49-ceac-4e5c-ac5c-f273a432eec2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.382964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866c49-ceac-4e5c-ac5c-f273a432eec2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.383060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bdf6c-dd49-48a0-9385-6972c82b008d None admin] RBAC: Adding query filter params (name=compute) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:18.383308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3866c49-ceac-4e5c-ac5c-f273a432eec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.383400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bdf6c-dd49-48a0-9385-6972c82b008d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:18.384707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084bdf6c-dd49-48a0-9385-6972c82b008d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:18.389677 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 496/994] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:34:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:18.395865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bdf6c-dd49-48a0-9385-6972c82b008d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:18.401848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d3866c49-ceac-4e5c-ac5c-f273a432eec2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:18.403060 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d3866c49-ceac-4e5c-ac5c-f273a432eec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:18.469715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 499/995] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:18.492681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084bdf6c-dd49-48a0-9385-6972c82b008d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:18.493561 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3866c49-ceac-4e5c-ac5c-f273a432eec2 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:18.528823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2088715-590d-47ea-a4cc-4e8d5a8fe3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:18.529481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2088715-590d-47ea-a4cc-4e8d5a8fe3cf None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.529761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2088715-590d-47ea-a4cc-4e8d5a8fe3cf None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.530032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2088715-590d-47ea-a4cc-4e8d5a8fe3cf None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.530775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2088715-590d-47ea-a4cc-4e8d5a8fe3cf None admin] RBAC: Adding query filter params (type=compute) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:18.531077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2088715-590d-47ea-a4cc-4e8d5a8fe3cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:18.532475 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2088715-590d-47ea-a4cc-4e8d5a8fe3cf None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:18.541938 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 497/996] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:34:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:18.542940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2088715-590d-47ea-a4cc-4e8d5a8fe3cf None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:18.594625 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3866c49-ceac-4e5c-ac5c-f273a432eec2 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:18.632372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f350-9385-449e-96ed-4c7a582d9570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:18.633090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f350-9385-449e-96ed-4c7a582d9570 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.633372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f350-9385-449e-96ed-4c7a582d9570 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.633643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32f350-9385-449e-96ed-4c7a582d9570 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.634289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32f350-9385-449e-96ed-4c7a582d9570 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:18.635683 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32f350-9385-449e-96ed-4c7a582d9570 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:18.639489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2088715-590d-47ea-a4cc-4e8d5a8fe3cf None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-0e32f350-9385-449e-96ed-4c7a582d9570 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:18.647266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:18.648814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:18.649645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 500/997] 10.222.0.61 () {56 vars in 1126 bytes} [Sat May 14 15:34:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:18.654950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f350-9385-449e-96ed-4c7a582d9570 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:18.674958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf37e-159d-4ed6-8341-db28c513da17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:18.675623 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf37e-159d-4ed6-8341-db28c513da17 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.675903 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf37e-159d-4ed6-8341-db28c513da17 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.676178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf37e-159d-4ed6-8341-db28c513da17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.676962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abf37e-159d-4ed6-8341-db28c513da17 None admin] RBAC: Adding query filter params (interface=public, service_id=6a244824748a406897231dc185b4ab4e, region_id=RegionOne) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:18.677269 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abf37e-159d-4ed6-8341-db28c513da17 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:18.679465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abf37e-159d-4ed6-8341-db28c513da17 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:18.684542 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 498/998] 10.222.0.61 () {56 vars in 1251 bytes} [Sat May 14 15:34:18 2022] GET /identity/v3/endpoints?service_id=6a244824748a406897231dc185b4ab4e&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:18.685898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828396c-a3cd-44a4-9796-ba0f3fc66a04 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.686185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828396c-a3cd-44a4-9796-ba0f3fc66a04 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.686493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828396c-a3cd-44a4-9796-ba0f3fc66a04 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.687825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 499/999] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:18.691151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828396c-a3cd-44a4-9796-ba0f3fc66a04 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:18.751309 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32f350-9385-449e-96ed-4c7a582d9570 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:18.782873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7ac7b-74fa-4d78-84ed-ddfafbdc47bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:18.783527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7ac7b-74fa-4d78-84ed-ddfafbdc47bf None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.783807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7ac7b-74fa-4d78-84ed-ddfafbdc47bf None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.784088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7ac7b-74fa-4d78-84ed-ddfafbdc47bf None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.784787 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7ac7b-74fa-4d78-84ed-ddfafbdc47bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:18.785091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7ac7b-74fa-4d78-84ed-ddfafbdc47bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:18.786487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7ac7b-74fa-4d78-84ed-ddfafbdc47bf None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:18.787353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828396c-a3cd-44a4-9796-ba0f3fc66a04 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:18.791844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 501/1000] 10.222.0.61 () {56 vars in 1122 bytes} [Sat May 14 15:34:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:18.793158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae718-d569-4af2-85e5-97d4fd9110a7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.793450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae718-d569-4af2-85e5-97d4fd9110a7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.793727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ae718-d569-4af2-85e5-97d4fd9110a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.809247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-e17ae718-d569-4af2-85e5-97d4fd9110a7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:18.810439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e17ae718-d569-4af2-85e5-97d4fd9110a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:18.820380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef909487-528a-4d4d-a95d-354e7fa24945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:18.821033 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef909487-528a-4d4d-a95d-354e7fa24945 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.821312 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef909487-528a-4d4d-a95d-354e7fa24945 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.821578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef909487-528a-4d4d-a95d-354e7fa24945 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.822244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef909487-528a-4d4d-a95d-354e7fa24945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:18.823734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef909487-528a-4d4d-a95d-354e7fa24945 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:18.830181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 500/1001] 10.222.0.61 () {56 vars in 1087 bytes} [Sat May 14 15:34:18 2022] GET /identity/v3/services => generated 1727 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:34:18.830695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef909487-528a-4d4d-a95d-354e7fa24945 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:18.898606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 502/1002] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:18.917491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ae718-d569-4af2-85e5-97d4fd9110a7 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:18.939636 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef909487-528a-4d4d-a95d-354e7fa24945 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:18.974695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158c49d-2ec1-49a0-8082-ab0549e08bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:18.975374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158c49d-2ec1-49a0-8082-ab0549e08bb4 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:18.976199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158c49d-2ec1-49a0-8082-ab0549e08bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:18.976476 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158c49d-2ec1-49a0-8082-ab0549e08bb4 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:18.977200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158c49d-2ec1-49a0-8082-ab0549e08bb4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:18.977504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158c49d-2ec1-49a0-8082-ab0549e08bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:18.979162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158c49d-2ec1-49a0-8082-ab0549e08bb4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:18.989394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 501/1003] 10.222.0.61 () {56 vars in 1122 bytes} [Sat May 14 15:34:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:18.990620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158c49d-2ec1-49a0-8082-ab0549e08bb4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:19.023591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ae718-d569-4af2-85e5-97d4fd9110a7 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:19.058777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285b89-3652-4e58-936d-793092f2dcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:19.059570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285b89-3652-4e58-936d-793092f2dcca None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:19.059858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285b89-3652-4e58-936d-793092f2dcca None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:19.060136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285b89-3652-4e58-936d-793092f2dcca None admin] PATH_INFO: `/v3/services/image` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:19.060792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b285b89-3652-4e58-936d-793092f2dcca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:19.062168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b285b89-3652-4e58-936d-793092f2dcca None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-1b285b89-3652-4e58-936d-793092f2dcca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:19.073964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:19.075022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:19.075975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 503/1004] 10.222.0.61 () {56 vars in 1105 bytes} [Sat May 14 15:34:18 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:19.080938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285b89-3652-4e58-936d-793092f2dcca None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:19.103317 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158c49d-2ec1-49a0-8082-ab0549e08bb4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:19.136614 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95166dd-e625-4adf-9ed6-277212b25f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:19.137265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95166dd-e625-4adf-9ed6-277212b25f47 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:19.137546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95166dd-e625-4adf-9ed6-277212b25f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:19.137816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95166dd-e625-4adf-9ed6-277212b25f47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:19.138577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95166dd-e625-4adf-9ed6-277212b25f47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:19.139928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95166dd-e625-4adf-9ed6-277212b25f47 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:19.154484 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 502/1005] 10.222.0.61 () {60 vars in 1144 bytes} [Sat May 14 15:34:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:34:19.182826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285b89-3652-4e58-936d-793092f2dcca None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:19.228303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffd9f9-9b71-4e9a-af2b-9f4e6ab29252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:19.228982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffd9f9-9b71-4e9a-af2b-9f4e6ab29252 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:19.229262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffd9f9-9b71-4e9a-af2b-9f4e6ab29252 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:19.229532 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffd9f9-9b71-4e9a-af2b-9f4e6ab29252 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:19.230281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffd9f9-9b71-4e9a-af2b-9f4e6ab29252 None admin] RBAC: Adding query filter params (name=image) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:19.230615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffd9f9-9b71-4e9a-af2b-9f4e6ab29252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:19.232121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffd9f9-9b71-4e9a-af2b-9f4e6ab29252 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:19.237729 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 504/1006] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:19.244057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95166dd-e625-4adf-9ed6-277212b25f47 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:19.351882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95166dd-e625-4adf-9ed6-277212b25f47 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:19.386388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719f873-e865-4401-af4b-1da7f66f2de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:19.387026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f873-e865-4401-af4b-1da7f66f2de1 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:19.387305 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f873-e865-4401-af4b-1da7f66f2de1 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:19.387575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f873-e865-4401-af4b-1da7f66f2de1 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:19.388280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719f873-e865-4401-af4b-1da7f66f2de1 None admin] RBAC: Adding query filter params (type=image) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:19.388582 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719f873-e865-4401-af4b-1da7f66f2de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:19.389930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719f873-e865-4401-af4b-1da7f66f2de1 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:19.395577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 503/1007] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:21.070347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b226b2-68dd-4bdf-a9fc-e5d3a10a7eb8 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.070860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b226b2-68dd-4bdf-a9fc-e5d3a10a7eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.070936 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b226b2-68dd-4bdf-a9fc-e5d3a10a7eb8 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.074354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 505/1008] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:21.077622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856778-57a0-4b6f-8cea-4b9f2923ae38 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.078030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856778-57a0-4b6f-8cea-4b9f2923ae38 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.078212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab856778-57a0-4b6f-8cea-4b9f2923ae38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.095558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-ab856778-57a0-4b6f-8cea-4b9f2923ae38 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:21.099775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ab856778-57a0-4b6f-8cea-4b9f2923ae38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:21.164708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 504/1009] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:21.186961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b226b2-68dd-4bdf-a9fc-e5d3a10a7eb8 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:21.289994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b226b2-68dd-4bdf-a9fc-e5d3a10a7eb8 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:21.321873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254065c-bd89-4cd7-9df1-6d30e224d1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:21.322696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254065c-bd89-4cd7-9df1-6d30e224d1e1 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.322975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254065c-bd89-4cd7-9df1-6d30e224d1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.323243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254065c-bd89-4cd7-9df1-6d30e224d1e1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.323889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254065c-bd89-4cd7-9df1-6d30e224d1e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:21.325233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0254065c-bd89-4cd7-9df1-6d30e224d1e1 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-0254065c-bd89-4cd7-9df1-6d30e224d1e1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:21.337148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:21.338135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 14 15:34:21.339066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:21.342662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 506/1010] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:34:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:21.344291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab856778-57a0-4b6f-8cea-4b9f2923ae38 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:21.382209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dab56-a2c1-4c71-a262-0cca8362992d None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.382711 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dab56-a2c1-4c71-a262-0cca8362992d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.382849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dab56-a2c1-4c71-a262-0cca8362992d None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.384216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 507/1011] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:34:21.389203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508aca9-7703-440b-b1b4-4a78bc2fe90d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.389488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508aca9-7703-440b-b1b4-4a78bc2fe90d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.389765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508aca9-7703-440b-b1b4-4a78bc2fe90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.406692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9508aca9-7703-440b-b1b4-4a78bc2fe90d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:21.408085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9508aca9-7703-440b-b1b4-4a78bc2fe90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:21.446639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab856778-57a0-4b6f-8cea-4b9f2923ae38 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:21.475196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 508/1012] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:21 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:21.485517 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657e4cc-dd95-4a34-9c7a-5ef75cf3c23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:21.486219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657e4cc-dd95-4a34-9c7a-5ef75cf3c23d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.486549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657e4cc-dd95-4a34-9c7a-5ef75cf3c23d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.486829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657e4cc-dd95-4a34-9c7a-5ef75cf3c23d None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.487570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657e4cc-dd95-4a34-9c7a-5ef75cf3c23d None admin] RBAC: Adding query filter params (name=compute) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:21.487878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657e4cc-dd95-4a34-9c7a-5ef75cf3c23d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:21.489298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657e4cc-dd95-4a34-9c7a-5ef75cf3c23d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:21.495540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 505/1013] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:34:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:21.500767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508aca9-7703-440b-b1b4-4a78bc2fe90d None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:21.501380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657e4cc-dd95-4a34-9c7a-5ef75cf3c23d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:21.599107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508aca9-7703-440b-b1b4-4a78bc2fe90d None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:21.600245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657e4cc-dd95-4a34-9c7a-5ef75cf3c23d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:21.633815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0f48c-4b06-4616-941c-7c78bc3d4729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:21.634547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f48c-4b06-4616-941c-7c78bc3d4729 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.634824 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f48c-4b06-4616-941c-7c78bc3d4729 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.635095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0f48c-4b06-4616-941c-7c78bc3d4729 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.636261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0f48c-4b06-4616-941c-7c78bc3d4729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:21.636930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980f4a9-1c1a-4f65-b4d1-17087a8f9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:21.637677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0f48c-4b06-4616-941c-7c78bc3d4729 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:21.638063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f4a9-1c1a-4f65-b4d1-17087a8f9030 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.638574 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f4a9-1c1a-4f65-b4d1-17087a8f9030 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.639045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980f4a9-1c1a-4f65-b4d1-17087a8f9030 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.639312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 509/1014] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:21.640218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980f4a9-1c1a-4f65-b4d1-17087a8f9030 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:21.640669 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980f4a9-1c1a-4f65-b4d1-17087a8f9030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:21.642168 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980f4a9-1c1a-4f65-b4d1-17087a8f9030 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:21.644843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0f48c-4b06-4616-941c-7c78bc3d4729 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:21.648267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 506/1015] 10.222.0.61 () {56 vars in 1112 bytes} [Sat May 14 15:34:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:21.653229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980f4a9-1c1a-4f65-b4d1-17087a8f9030 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:21.740446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0f48c-4b06-4616-941c-7c78bc3d4729 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:21.752522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980f4a9-1c1a-4f65-b4d1-17087a8f9030 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:21.773064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83d873-f0a0-4160-a7cf-f1aabe5da058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:21.773716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83d873-f0a0-4160-a7cf-f1aabe5da058 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.773995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83d873-f0a0-4160-a7cf-f1aabe5da058 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.774263 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83d873-f0a0-4160-a7cf-f1aabe5da058 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.774990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83d873-f0a0-4160-a7cf-f1aabe5da058 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:21.776414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83d873-f0a0-4160-a7cf-f1aabe5da058 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:21.785379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb67b4-3fb8-46b0-b420-c3018d770401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:21.786026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb67b4-3fb8-46b0-b420-c3018d770401 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.786327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb67b4-3fb8-46b0-b420-c3018d770401 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.786606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb67b4-3fb8-46b0-b420-c3018d770401 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.787340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb67b4-3fb8-46b0-b420-c3018d770401 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:21.789187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb67b4-3fb8-46b0-b420-c3018d770401 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:21.802282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 510/1016] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:34:21 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:34:21.804195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28263b1-5c9e-4697-b11d-7db41419daef None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.804459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28263b1-5c9e-4697-b11d-7db41419daef None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.804739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28263b1-5c9e-4697-b11d-7db41419daef None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.806342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 511/1017] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:21.810353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 507/1018] 10.222.0.61 () {60 vars in 1144 bytes} [Sat May 14 15:34:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:34:21.816099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a296-560f-47aa-b158-12a60f60c89c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:21.816385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a296-560f-47aa-b158-12a60f60c89c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:21.816662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a296-560f-47aa-b158-12a60f60c89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:21.835955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9932a296-560f-47aa-b158-12a60f60c89c None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:21.837127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9932a296-560f-47aa-b158-12a60f60c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:21.921508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 512/1019] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:21 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:21.945741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb67b4-3fb8-46b0-b420-c3018d770401 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:22.059888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb67b4-3fb8-46b0-b420-c3018d770401 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:22.094214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a2b7c-57fe-4b32-b064-a4f65d7ec596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:22.094906 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a2b7c-57fe-4b32-b064-a4f65d7ec596 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:22.095178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a2b7c-57fe-4b32-b064-a4f65d7ec596 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:22.095450 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a2b7c-57fe-4b32-b064-a4f65d7ec596 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:22.096182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a2b7c-57fe-4b32-b064-a4f65d7ec596 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:22.097603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a2b7c-57fe-4b32-b064-a4f65d7ec596 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:22.112885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 508/1020] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:34:21 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:34:24.111401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b8da-e086-4d7f-a6f7-18d460b71064 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.111896 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b8da-e086-4d7f-a6f7-18d460b71064 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.111896 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201b8da-e086-4d7f-a6f7-18d460b71064 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.113372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 513/1021] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:24.118735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255f11-bf3b-48e1-9ebe-9ac965bb2b76 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.119127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255f11-bf3b-48e1-9ebe-9ac965bb2b76 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.119289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32255f11-bf3b-48e1-9ebe-9ac965bb2b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.136006 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-32255f11-bf3b-48e1-9ebe-9ac965bb2b76 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:24.137172 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-32255f11-bf3b-48e1-9ebe-9ac965bb2b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:24.200498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf66a6-0ee5-4277-a08b-5e6bd0f8b0c0 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.200835 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf66a6-0ee5-4277-a08b-5e6bd0f8b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.201054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf66a6-0ee5-4277-a08b-5e6bd0f8b0c0 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.202662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 514/1022] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:34:24.208307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd781f5-f423-4876-9135-07a2643d2790 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.208652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd781f5-f423-4876-9135-07a2643d2790 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.208861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd781f5-f423-4876-9135-07a2643d2790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.211334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 509/1023] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:24.227420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-cbd781f5-f423-4876-9135-07a2643d2790 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:24.228881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-cbd781f5-f423-4876-9135-07a2643d2790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:24.235919 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32255f11-bf3b-48e1-9ebe-9ac965bb2b76 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:24.296558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 515/1024] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:24.320449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd781f5-f423-4876-9135-07a2643d2790 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:24.330665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32255f11-bf3b-48e1-9ebe-9ac965bb2b76 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:24.363936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fb870-7082-44d5-a145-d1723df233e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:24.364645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb870-7082-44d5-a145-d1723df233e1 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.364924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb870-7082-44d5-a145-d1723df233e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.365194 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fb870-7082-44d5-a145-d1723df233e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.367027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fb870-7082-44d5-a145-d1723df233e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:24.368203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976fb870-7082-44d5-a145-d1723df233e1 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:24.370177 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 510/1025] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:24.375423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fb870-7082-44d5-a145-d1723df233e1 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:24.418102 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd781f5-f423-4876-9135-07a2643d2790 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:24.451578 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302b958-7fd5-458a-ae20-29a2d5e108de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:24.452386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302b958-7fd5-458a-ae20-29a2d5e108de None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.452666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302b958-7fd5-458a-ae20-29a2d5e108de None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.452937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302b958-7fd5-458a-ae20-29a2d5e108de None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.462751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302b958-7fd5-458a-ae20-29a2d5e108de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:34:24.468909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fb870-7082-44d5-a145-d1723df233e1 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-0302b958-7fd5-458a-ae20-29a2d5e108de None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:34:24.470845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:24.471742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:24.472588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 516/1026] 10.222.0.61 () {56 vars in 1120 bytes} [Sat May 14 15:34:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:24.473302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea87319-dc82-47a4-a840-4819bd302df6 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.473869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea87319-dc82-47a4-a840-4819bd302df6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.473869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea87319-dc82-47a4-a840-4819bd302df6 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.475146 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 517/1027] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:24.478642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea87319-dc82-47a4-a840-4819bd302df6 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:24.503789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e1508-fbc1-4844-a943-a3207d4eca98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:24.504449 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e1508-fbc1-4844-a943-a3207d4eca98 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.504726 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e1508-fbc1-4844-a943-a3207d4eca98 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.504995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e1508-fbc1-4844-a943-a3207d4eca98 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.505685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e1508-fbc1-4844-a943-a3207d4eca98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:24.507360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e1508-fbc1-4844-a943-a3207d4eca98 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:24.526923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 511/1028] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:34:24 2022] POST /identity/v3/users => generated 285 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:34:24.527986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb06f-f76c-4aae-bf1f-a18967e3d0ac None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.528271 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb06f-f76c-4aae-bf1f-a18967e3d0ac None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.528545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb06f-f76c-4aae-bf1f-a18967e3d0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.546577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-8b9cb06f-f76c-4aae-bf1f-a18967e3d0ac None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:24.547822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8b9cb06f-f76c-4aae-bf1f-a18967e3d0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:24.582503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea87319-dc82-47a4-a840-4819bd302df6 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:24.620115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 512/1029] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:24.620415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc44619-0c7e-462e-8c03-8b70adce1db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:24.621037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44619-0c7e-462e-8c03-8b70adce1db8 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.621320 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44619-0c7e-462e-8c03-8b70adce1db8 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.621594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc44619-0c7e-462e-8c03-8b70adce1db8 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.622382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc44619-0c7e-462e-8c03-8b70adce1db8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:24.622686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc44619-0c7e-462e-8c03-8b70adce1db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:24.624077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc44619-0c7e-462e-8c03-8b70adce1db8 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:24.638362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 518/1030] 10.222.0.61 () {56 vars in 1115 bytes} [Sat May 14 15:34:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:24.640314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cb06f-f76c-4aae-bf1f-a18967e3d0ac None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:24.642352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc44619-0c7e-462e-8c03-8b70adce1db8 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:24.742916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc44619-0c7e-462e-8c03-8b70adce1db8 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:24.743167 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cb06f-f76c-4aae-bf1f-a18967e3d0ac None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:24.779294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b452be-8df5-47fb-b180-5277ab1485eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:24.780087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b452be-8df5-47fb-b180-5277ab1485eb None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.780367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b452be-8df5-47fb-b180-5277ab1485eb None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.780579 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073a1ba-494b-4102-949d-29187f98047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:24.780689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b452be-8df5-47fb-b180-5277ab1485eb None admin] PATH_INFO: `/v3/services/image` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.781282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b452be-8df5-47fb-b180-5277ab1485eb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:24.781750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073a1ba-494b-4102-949d-29187f98047f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.782174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073a1ba-494b-4102-949d-29187f98047f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.782612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073a1ba-494b-4102-949d-29187f98047f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.782959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b452be-8df5-47fb-b180-5277ab1485eb None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:24.793214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073a1ba-494b-4102-949d-29187f98047f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-65b452be-8df5-47fb-b180-5277ab1485eb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:24.794621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:24.795595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 15:34:24.796988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:24.797995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073a1ba-494b-4102-949d-29187f98047f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:24.798083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 519/1031] 10.222.0.61 () {56 vars in 1105 bytes} [Sat May 14 15:34:24 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:24.802176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b452be-8df5-47fb-b180-5277ab1485eb None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-6073a1ba-494b-4102-949d-29187f98047f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:24.813813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:24.814997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:24.816588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:24.816588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:24.816588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:24.816588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:24.816588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 513/1032] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:24.821052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073a1ba-494b-4102-949d-29187f98047f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:24.899501 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b452be-8df5-47fb-b180-5277ab1485eb None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:24.918727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073a1ba-494b-4102-949d-29187f98047f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:24.932118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc64cfe-6d5a-415a-aeda-a51f8a902418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:24.932767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc64cfe-6d5a-415a-aeda-a51f8a902418 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.933048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc64cfe-6d5a-415a-aeda-a51f8a902418 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.933320 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc64cfe-6d5a-415a-aeda-a51f8a902418 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.934022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc64cfe-6d5a-415a-aeda-a51f8a902418 None admin] RBAC: Adding query filter params (name=image) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:24.934343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc64cfe-6d5a-415a-aeda-a51f8a902418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:24.935701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc64cfe-6d5a-415a-aeda-a51f8a902418 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:24.940528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 520/1033] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:24.946887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc64cfe-6d5a-415a-aeda-a51f8a902418 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:24.952902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1200b5d-3a6c-4e6e-8cea-57b77b4c9614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:24.953573 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1200b5d-3a6c-4e6e-8cea-57b77b4c9614 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:24.953856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1200b5d-3a6c-4e6e-8cea-57b77b4c9614 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:24.954128 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1200b5d-3a6c-4e6e-8cea-57b77b4c9614 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:24.954877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1200b5d-3a6c-4e6e-8cea-57b77b4c9614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:24.955180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1200b5d-3a6c-4e6e-8cea-57b77b4c9614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:24.956551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1200b5d-3a6c-4e6e-8cea-57b77b4c9614 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:24.968209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 514/1034] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:24.973462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1200b5d-3a6c-4e6e-8cea-57b77b4c9614 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:25.050588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc64cfe-6d5a-415a-aeda-a51f8a902418 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:25.073197 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1200b5d-3a6c-4e6e-8cea-57b77b4c9614 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:25.083471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50537d45-f33a-411c-a0d6-a5e96b387e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:25.084136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537d45-f33a-411c-a0d6-a5e96b387e25 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:25.084415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537d45-f33a-411c-a0d6-a5e96b387e25 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:25.084714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537d45-f33a-411c-a0d6-a5e96b387e25 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:25.086244 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50537d45-f33a-411c-a0d6-a5e96b387e25 None admin] RBAC: Adding query filter params (type=image) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:25.086580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50537d45-f33a-411c-a0d6-a5e96b387e25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:25.087940 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50537d45-f33a-411c-a0d6-a5e96b387e25 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:25.092660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 521/1035] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:25.098428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50537d45-f33a-411c-a0d6-a5e96b387e25 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:25.107241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0b111-7726-47b5-864a-5bdaef47d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:25.108042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0b111-7726-47b5-864a-5bdaef47d78f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:25.108322 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0b111-7726-47b5-864a-5bdaef47d78f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:25.108591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0b111-7726-47b5-864a-5bdaef47d78f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:25.116413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0b111-7726-47b5-864a-5bdaef47d78f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:25.117860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0b111-7726-47b5-864a-5bdaef47d78f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-87f0b111-7726-47b5-864a-5bdaef47d78f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:34:25.132838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:25.134377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:25.135366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:25.135366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:25.135366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:34:25.135366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:34:25.135366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:34:25.135366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:34:25.135366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:34:25.135366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:34:25.135366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 15:34:25.135366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:25.135366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 515/1036] 10.222.0.61 () {56 vars in 1093 bytes} [Sat May 14 15:34:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:25.139797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0b111-7726-47b5-864a-5bdaef47d78f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:25.198813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50537d45-f33a-411c-a0d6-a5e96b387e25 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:25.231892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b37018-582b-4423-b827-739aa28dc993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:25.232549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b37018-582b-4423-b827-739aa28dc993 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:25.232828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b37018-582b-4423-b827-739aa28dc993 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:25.233101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b37018-582b-4423-b827-739aa28dc993 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:25.233879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b37018-582b-4423-b827-739aa28dc993 None admin] RBAC: Adding query filter params (interface=public, service_id=6bd23b9219894d89bc820e473f61f00a, region_id=RegionOne) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:25.234186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b37018-582b-4423-b827-739aa28dc993 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:25.235574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b37018-582b-4423-b827-739aa28dc993 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:25.236619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0b111-7726-47b5-864a-5bdaef47d78f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:25.240584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 522/1037] 10.222.0.61 () {56 vars in 1251 bytes} [Sat May 14 15:34:25 2022] GET /identity/v3/endpoints?service_id=6bd23b9219894d89bc820e473f61f00a&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:25.246064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b37018-582b-4423-b827-739aa28dc993 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:25.270746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7539a98-b617-4dfb-843c-e04181beaf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:25.271418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7539a98-b617-4dfb-843c-e04181beaf34 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:25.271699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7539a98-b617-4dfb-843c-e04181beaf34 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:25.271971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7539a98-b617-4dfb-843c-e04181beaf34 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:25.273439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7539a98-b617-4dfb-843c-e04181beaf34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:25.273750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7539a98-b617-4dfb-843c-e04181beaf34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:25.275213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7539a98-b617-4dfb-843c-e04181beaf34 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:25.292740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 516/1038] 10.222.0.61 () {56 vars in 1133 bytes} [Sat May 14 15:34:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:25.298455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7539a98-b617-4dfb-843c-e04181beaf34 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:25.348156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b37018-582b-4423-b827-739aa28dc993 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:25.383604 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272764e8-f7ee-404a-b234-a12dec0aa366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:25.384185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272764e8-f7ee-404a-b234-a12dec0aa366 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:25.384488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272764e8-f7ee-404a-b234-a12dec0aa366 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:25.384762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272764e8-f7ee-404a-b234-a12dec0aa366 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:25.385447 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272764e8-f7ee-404a-b234-a12dec0aa366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:25.386832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272764e8-f7ee-404a-b234-a12dec0aa366 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:25.393598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 523/1039] 10.222.0.61 () {56 vars in 1087 bytes} [Sat May 14 15:34:25 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:34:25.396905 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7539a98-b617-4dfb-843c-e04181beaf34 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:25.437010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ad42c-19a0-4445-acb4-83e52116813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:25.437935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad42c-19a0-4445-acb4-83e52116813c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:25.438431 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad42c-19a0-4445-acb4-83e52116813c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:25.438860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ad42c-19a0-4445-acb4-83e52116813c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:25.512648 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ad42c-19a0-4445-acb4-83e52116813c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:25.514021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ad42c-19a0-4445-acb4-83e52116813c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:25.613135 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 517/1040] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:34:25 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 15:34:25.619446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272764e8-f7ee-404a-b234-a12dec0aa366 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:25.717847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272764e8-f7ee-404a-b234-a12dec0aa366 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:25.751568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fc54e-71de-4a23-8b2d-1cd4c195464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:25.752705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc54e-71de-4a23-8b2d-1cd4c195464d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:25.753290 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc54e-71de-4a23-8b2d-1cd4c195464d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:25.753789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc54e-71de-4a23-8b2d-1cd4c195464d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:25.765205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fc54e-71de-4a23-8b2d-1cd4c195464d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:25.766938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fc54e-71de-4a23-8b2d-1cd4c195464d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-b78fc54e-71de-4a23-8b2d-1cd4c195464d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:25.784657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:25.785649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:25.786777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:25.786777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:25.786777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:25.786777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:25.788371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 524/1041] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:25.794123 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ad42c-19a0-4445-acb4-83e52116813c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:25.893255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ad42c-19a0-4445-acb4-83e52116813c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:25.927104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367cb1b-ebce-4e33-8f47-5de5fda39b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:25.927761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367cb1b-ebce-4e33-8f47-5de5fda39b1a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:25.928037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367cb1b-ebce-4e33-8f47-5de5fda39b1a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:25.928306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367cb1b-ebce-4e33-8f47-5de5fda39b1a None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:25.929727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367cb1b-ebce-4e33-8f47-5de5fda39b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:25.929999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367cb1b-ebce-4e33-8f47-5de5fda39b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:25.931375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367cb1b-ebce-4e33-8f47-5de5fda39b1a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:25.942403 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 518/1042] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:25.947818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fc54e-71de-4a23-8b2d-1cd4c195464d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:26.043715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fc54e-71de-4a23-8b2d-1cd4c195464d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:26.074952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a63038-80ed-41fe-9cff-7c483d8a235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:26.075735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63038-80ed-41fe-9cff-7c483d8a235f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:26.076016 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63038-80ed-41fe-9cff-7c483d8a235f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:26.076286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a63038-80ed-41fe-9cff-7c483d8a235f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:26.082841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a63038-80ed-41fe-9cff-7c483d8a235f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:26.084266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a63038-80ed-41fe-9cff-7c483d8a235f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-b0a63038-80ed-41fe-9cff-7c483d8a235f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:34:26.098927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:26.099871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:26.100997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:34:26.100997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:34:26.100997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:34:26.100997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:34:26.100997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:34:26.100997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:34:26.100997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:26.100997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:26.102211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 525/1043] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:26.106426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367cb1b-ebce-4e33-8f47-5de5fda39b1a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:26.200603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367cb1b-ebce-4e33-8f47-5de5fda39b1a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:26.233358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4270b-1e9d-45b8-b947-c077e9ab6088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:26.234016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4270b-1e9d-45b8-b947-c077e9ab6088 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:26.234301 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4270b-1e9d-45b8-b947-c077e9ab6088 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:26.234599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4270b-1e9d-45b8-b947-c077e9ab6088 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:26.235379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4270b-1e9d-45b8-b947-c077e9ab6088 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:26.235680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4270b-1e9d-45b8-b947-c077e9ab6088 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:26.237088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4270b-1e9d-45b8-b947-c077e9ab6088 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:26.249670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 519/1044] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:34:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:26.255392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a63038-80ed-41fe-9cff-7c483d8a235f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:26.354495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a63038-80ed-41fe-9cff-7c483d8a235f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:26.386582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ab850-3b5d-4b5c-ac65-79f20d8907b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:26.387229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab850-3b5d-4b5c-ac65-79f20d8907b4 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:26.387565 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab850-3b5d-4b5c-ac65-79f20d8907b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:26.387836 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ab850-3b5d-4b5c-ac65-79f20d8907b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:26.388663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ab850-3b5d-4b5c-ac65-79f20d8907b4 None admin] RBAC: Adding query filter params (role.id=be2d9f91e4cb4dc0ad7bb5589d31739b, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=ebefa53d595b4e6486ce409f2ac47ff1) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:26.388969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ab850-3b5d-4b5c-ac65-79f20d8907b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:26.390400 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ab850-3b5d-4b5c-ac65-79f20d8907b4 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:26.395865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 526/1045] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:34:26 2022] GET /identity/v3/role_assignments?user.id=ebefa53d595b4e6486ce409f2ac47ff1&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=be2d9f91e4cb4dc0ad7bb5589d31739b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:26.825844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ba618-070b-4955-a930-11d832f8a9e3 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:26.826196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ba618-070b-4955-a930-11d832f8a9e3 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:26.826442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ba618-070b-4955-a930-11d832f8a9e3 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:26.827852 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 520/1046] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:26.836074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5bb90-6cc5-426e-9fd8-6097e69f718f None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:26.836654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5bb90-6cc5-426e-9fd8-6097e69f718f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:26.838719 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5bb90-6cc5-426e-9fd8-6097e69f718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:26.856035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-a4c5bb90-6cc5-426e-9fd8-6097e69f718f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:26.857390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a4c5bb90-6cc5-426e-9fd8-6097e69f718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:26.924264 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 527/1047] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:26.946117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ba618-070b-4955-a930-11d832f8a9e3 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:27.043148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ba618-070b-4955-a930-11d832f8a9e3 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:27.076580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca662441-6e34-4236-8d46-7c59bd4a2303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:27.077298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca662441-6e34-4236-8d46-7c59bd4a2303 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:27.077606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca662441-6e34-4236-8d46-7c59bd4a2303 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:27.077852 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca662441-6e34-4236-8d46-7c59bd4a2303 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:27.087833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca662441-6e34-4236-8d46-7c59bd4a2303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-ca662441-6e34-4236-8d46-7c59bd4a2303 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:34:27.095459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:27.096365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:34:27.097211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:27.102921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 521/1048] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:34:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:27.104260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5bb90-6cc5-426e-9fd8-6097e69f718f None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:27.199659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5bb90-6cc5-426e-9fd8-6097e69f718f None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:27.233046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b2b5f-2add-43ab-a0ff-07435a571890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:27.233714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b2b5f-2add-43ab-a0ff-07435a571890 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:27.233994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b2b5f-2add-43ab-a0ff-07435a571890 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:27.234265 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b2b5f-2add-43ab-a0ff-07435a571890 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:27.235036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b2b5f-2add-43ab-a0ff-07435a571890 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:27.235337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b2b5f-2add-43ab-a0ff-07435a571890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:27.236692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b2b5f-2add-43ab-a0ff-07435a571890 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:27.249392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 528/1049] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:34:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:27.251129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca662441-6e34-4236-8d46-7c59bd4a2303 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:27.347434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca662441-6e34-4236-8d46-7c59bd4a2303 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:27.379761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2eecb-9237-4941-ac2b-42fbc8709a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:27.380887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2eecb-9237-4941-ac2b-42fbc8709a38 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:27.381346 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2eecb-9237-4941-ac2b-42fbc8709a38 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:27.382340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2eecb-9237-4941-ac2b-42fbc8709a38 None admin] PATH_INFO: `/v3/users/29063303cd89466289b67eb9487c9878` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:27.395047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2eecb-9237-4941-ac2b-42fbc8709a38 None admin] RBAC: Authorizing `identity:get_user(user_id=29063303cd89466289b67eb9487c9878)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:27.396693 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2eecb-9237-4941-ac2b-42fbc8709a38 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:27.399447 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 522/1050] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:34:27 2022] GET /identity/v3/users/29063303cd89466289b67eb9487c9878 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:27.405050 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b2b5f-2add-43ab-a0ff-07435a571890 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:27.510576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b2b5f-2add-43ab-a0ff-07435a571890 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:27.542515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce481b-3255-4312-a944-23d1f6dacd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:27.543170 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce481b-3255-4312-a944-23d1f6dacd6e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:27.543452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce481b-3255-4312-a944-23d1f6dacd6e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:27.543727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce481b-3255-4312-a944-23d1f6dacd6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:27.611597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce481b-3255-4312-a944-23d1f6dacd6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:27.612957 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce481b-3255-4312-a944-23d1f6dacd6e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:27.644893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14503f1-8e91-4707-b292-99c5a6fbb0a5 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:27.645227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14503f1-8e91-4707-b292-99c5a6fbb0a5 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:27.645438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14503f1-8e91-4707-b292-99c5a6fbb0a5 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:27.646829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 523/1051] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:34:27.652286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93719e65-b586-4ca4-8a38-f7a3a799349f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:27.652570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93719e65-b586-4ca4-8a38-f7a3a799349f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:27.652856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93719e65-b586-4ca4-8a38-f7a3a799349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:27.668820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-93719e65-b586-4ca4-8a38-f7a3a799349f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:27.669975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-93719e65-b586-4ca4-8a38-f7a3a799349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:27.713356 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 529/1052] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:34:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:34:27.714450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce481b-3255-4312-a944-23d1f6dacd6e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:27.735816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 524/1053] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:27.759043 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93719e65-b586-4ca4-8a38-f7a3a799349f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:27.807215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce481b-3255-4312-a944-23d1f6dacd6e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:27.843019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1f393-b6ba-4ed3-a67b-dd044bc48a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:27.843889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1f393-b6ba-4ed3-a67b-dd044bc48a52 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:27.844177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1f393-b6ba-4ed3-a67b-dd044bc48a52 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:27.844454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1f393-b6ba-4ed3-a67b-dd044bc48a52 None admin] PATH_INFO: `/v3/projects/d08670e8e75d40dab852126665405f11` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:27.845655 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1f393-b6ba-4ed3-a67b-dd044bc48a52 None admin] RBAC: Authorizing `identity:get_project(project_id=d08670e8e75d40dab852126665405f11)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:27.847111 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1f393-b6ba-4ed3-a67b-dd044bc48a52 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:27.848967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 530/1054] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:34:27 2022] GET /identity/v3/projects/d08670e8e75d40dab852126665405f11 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:27.855069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1f393-b6ba-4ed3-a67b-dd044bc48a52 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:27.855520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93719e65-b586-4ca4-8a38-f7a3a799349f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:27.889474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909a42a-26f3-446b-8a1b-e32683526bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:27.890184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909a42a-26f3-446b-8a1b-e32683526bb4 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:27.890506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909a42a-26f3-446b-8a1b-e32683526bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:27.890782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909a42a-26f3-446b-8a1b-e32683526bb4 None admin] PATH_INFO: `/v3/services/image` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:27.891431 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909a42a-26f3-446b-8a1b-e32683526bb4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:27.892804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909a42a-26f3-446b-8a1b-e32683526bb4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-4909a42a-26f3-446b-8a1b-e32683526bb4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:27.904788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:27.906640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 14 15:34:27.909882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:27.914252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 525/1055] 10.222.0.61 () {56 vars in 1105 bytes} [Sat May 14 15:34:27 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:27.914252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909a42a-26f3-446b-8a1b-e32683526bb4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:27.953966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1f393-b6ba-4ed3-a67b-dd044bc48a52 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:27.988485 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523120a-cf68-42c9-a189-2dad371cdb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:27.988965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523120a-cf68-42c9-a189-2dad371cdb5b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:27.989245 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523120a-cf68-42c9-a189-2dad371cdb5b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:27.989520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523120a-cf68-42c9-a189-2dad371cdb5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:27.990366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523120a-cf68-42c9-a189-2dad371cdb5b None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=d08670e8e75d40dab852126665405f11, user.id=29063303cd89466289b67eb9487c9878) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:27.990752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523120a-cf68-42c9-a189-2dad371cdb5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:27.992726 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523120a-cf68-42c9-a189-2dad371cdb5b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:28.006562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 531/1056] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:34:27 2022] GET /identity/v3/role_assignments?user.id=29063303cd89466289b67eb9487c9878&scope.project.id=d08670e8e75d40dab852126665405f11&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:28.009654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909a42a-26f3-446b-8a1b-e32683526bb4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:28.046089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baf54f-d985-4194-90d5-4c0397c75863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:28.046901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baf54f-d985-4194-90d5-4c0397c75863 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:28.047252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baf54f-d985-4194-90d5-4c0397c75863 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:28.047593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5baf54f-d985-4194-90d5-4c0397c75863 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:28.048403 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5baf54f-d985-4194-90d5-4c0397c75863 None admin] RBAC: Adding query filter params (name=image) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:28.048773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5baf54f-d985-4194-90d5-4c0397c75863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:28.050223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5baf54f-d985-4194-90d5-4c0397c75863 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:28.056591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 526/1057] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:28.062331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523120a-cf68-42c9-a189-2dad371cdb5b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:28.166404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523120a-cf68-42c9-a189-2dad371cdb5b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:28.201558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c25f34a-07dd-4755-b23d-937692868308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:28.202219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25f34a-07dd-4755-b23d-937692868308 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:28.202542 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25f34a-07dd-4755-b23d-937692868308 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:28.202815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25f34a-07dd-4755-b23d-937692868308 None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:28.203523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25f34a-07dd-4755-b23d-937692868308 None admin] RBAC: Adding query filter params (type=image) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:28.203822 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25f34a-07dd-4755-b23d-937692868308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:28.205199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c25f34a-07dd-4755-b23d-937692868308 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:28.210892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 532/1058] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:28.216280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baf54f-d985-4194-90d5-4c0397c75863 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:28.312282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5baf54f-d985-4194-90d5-4c0397c75863 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:28.344667 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7194f4c-7c6d-4a94-a1e0-07bbb4691992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:28.345313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7194f4c-7c6d-4a94-a1e0-07bbb4691992 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:28.345602 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7194f4c-7c6d-4a94-a1e0-07bbb4691992 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:28.345875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7194f4c-7c6d-4a94-a1e0-07bbb4691992 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:28.346659 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7194f4c-7c6d-4a94-a1e0-07bbb4691992 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:28.348022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7194f4c-7c6d-4a94-a1e0-07bbb4691992 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:28.374349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 527/1059] 10.222.0.61 () {60 vars in 1144 bytes} [Sat May 14 15:34:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:34:28.627367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2309cae-b2d1-48f3-a77a-4fad5fce6ba0 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:28.627881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2309cae-b2d1-48f3-a77a-4fad5fce6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:28.627990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2309cae-b2d1-48f3-a77a-4fad5fce6ba0 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:28.629482 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 533/1060] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:28.635287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8b1a9-a250-48ae-93f0-6a90786f0f09 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:28.635583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8b1a9-a250-48ae-93f0-6a90786f0f09 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:28.635863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8b1a9-a250-48ae-93f0-6a90786f0f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:28.653323 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b4b8b1a9-a250-48ae-93f0-6a90786f0f09 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:28.654529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b4b8b1a9-a250-48ae-93f0-6a90786f0f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:28.725107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 528/1061] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:28.748168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2309cae-b2d1-48f3-a77a-4fad5fce6ba0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:28.851582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2309cae-b2d1-48f3-a77a-4fad5fce6ba0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:28.885873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dc6a8-93e6-4451-9b43-ffc29eb3691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:28.886690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc6a8-93e6-4451-9b43-ffc29eb3691d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:28.886989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc6a8-93e6-4451-9b43-ffc29eb3691d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:28.887294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dc6a8-93e6-4451-9b43-ffc29eb3691d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:28.898011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653dc6a8-93e6-4451-9b43-ffc29eb3691d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-653dc6a8-93e6-4451-9b43-ffc29eb3691d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:34:28.906346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:28.907274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:28.908228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:28.909362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 534/1062] 10.222.0.61 () {56 vars in 1120 bytes} [Sat May 14 15:34:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:28.914790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8b1a9-a250-48ae-93f0-6a90786f0f09 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:29.010535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8b1a9-a250-48ae-93f0-6a90786f0f09 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:29.043455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5c40a-4973-45fd-90ac-2ead6f8a9eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:29.044116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5c40a-4973-45fd-90ac-2ead6f8a9eed None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:29.044394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5c40a-4973-45fd-90ac-2ead6f8a9eed None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:29.044661 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5c40a-4973-45fd-90ac-2ead6f8a9eed None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:29.045395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5c40a-4973-45fd-90ac-2ead6f8a9eed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:29.045682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5c40a-4973-45fd-90ac-2ead6f8a9eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:29.047043 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5c40a-4973-45fd-90ac-2ead6f8a9eed None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:29.054834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 529/1063] 10.222.0.61 () {56 vars in 1115 bytes} [Sat May 14 15:34:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:29.060360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dc6a8-93e6-4451-9b43-ffc29eb3691d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:29.157452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dc6a8-93e6-4451-9b43-ffc29eb3691d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:29.190031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db92baf-81f1-4dda-8954-0f68a8ea792c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:29.190852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db92baf-81f1-4dda-8954-0f68a8ea792c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:29.191134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db92baf-81f1-4dda-8954-0f68a8ea792c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:29.191409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db92baf-81f1-4dda-8954-0f68a8ea792c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:29.201956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db92baf-81f1-4dda-8954-0f68a8ea792c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:29.203427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db92baf-81f1-4dda-8954-0f68a8ea792c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-9db92baf-81f1-4dda-8954-0f68a8ea792c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:29.220754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:29.221705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:29.222643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:29.222643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:29.222643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:29.222643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:29.222643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 535/1064] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:29.228953 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5c40a-4973-45fd-90ac-2ead6f8a9eed None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:29.324608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5c40a-4973-45fd-90ac-2ead6f8a9eed None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:29.356470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adb248-e334-4a2f-8fe5-b3b0a803cdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:29.357129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adb248-e334-4a2f-8fe5-b3b0a803cdd5 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:29.357408 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adb248-e334-4a2f-8fe5-b3b0a803cdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:29.357739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adb248-e334-4a2f-8fe5-b3b0a803cdd5 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:29.358487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adb248-e334-4a2f-8fe5-b3b0a803cdd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:29.358791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adb248-e334-4a2f-8fe5-b3b0a803cdd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:29.360154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0adb248-e334-4a2f-8fe5-b3b0a803cdd5 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:29.371508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 530/1065] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:29.376959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db92baf-81f1-4dda-8954-0f68a8ea792c None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:29.472858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db92baf-81f1-4dda-8954-0f68a8ea792c None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:29.505356 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935d10b-a326-4aad-94ee-86ca44f34253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:29.506144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935d10b-a326-4aad-94ee-86ca44f34253 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:29.506496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935d10b-a326-4aad-94ee-86ca44f34253 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:29.507003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935d10b-a326-4aad-94ee-86ca44f34253 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:29.514282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935d10b-a326-4aad-94ee-86ca44f34253 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:29.515745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935d10b-a326-4aad-94ee-86ca44f34253 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-1935d10b-a326-4aad-94ee-86ca44f34253 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:34:29.530132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:29.531388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:29.532354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:29.532354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:29.532354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:34:29.532354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:34:29.532354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:34:29.532354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:34:29.532354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:34:29.532354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:34:29.532354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 15:34:29.532354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:29.534396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 536/1066] 10.222.0.61 () {56 vars in 1093 bytes} [Sat May 14 15:34:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:29.537251 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adb248-e334-4a2f-8fe5-b3b0a803cdd5 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:29.635559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adb248-e334-4a2f-8fe5-b3b0a803cdd5 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:29.668555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011670f-c9ec-4d9e-96c6-e3cf8fb28463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:29.669226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011670f-c9ec-4d9e-96c6-e3cf8fb28463 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:29.669512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011670f-c9ec-4d9e-96c6-e3cf8fb28463 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:29.669808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011670f-c9ec-4d9e-96c6-e3cf8fb28463 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:29.670672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011670f-c9ec-4d9e-96c6-e3cf8fb28463 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:29.670976 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011670f-c9ec-4d9e-96c6-e3cf8fb28463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:29.672395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011670f-c9ec-4d9e-96c6-e3cf8fb28463 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:29.694854 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 531/1067] 10.222.0.61 () {56 vars in 1133 bytes} [Sat May 14 15:34:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:29.696910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935d10b-a326-4aad-94ee-86ca44f34253 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:29.793553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935d10b-a326-4aad-94ee-86ca44f34253 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:29.826188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e5a1f-b426-47d2-af83-2b13c3afc6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:29.827006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e5a1f-b426-47d2-af83-2b13c3afc6a6 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:29.827287 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e5a1f-b426-47d2-af83-2b13c3afc6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:29.827563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e5a1f-b426-47d2-af83-2b13c3afc6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:29.842590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e5a1f-b426-47d2-af83-2b13c3afc6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:29.844049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e5a1f-b426-47d2-af83-2b13c3afc6a6 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-661e5a1f-b426-47d2-af83-2b13c3afc6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:29.861178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:29.862115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:29.868078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:29.868078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:29.868078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:29.868078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:29.868078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 537/1068] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:29.868724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011670f-c9ec-4d9e-96c6-e3cf8fb28463 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:29.963275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011670f-c9ec-4d9e-96c6-e3cf8fb28463 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:29.996599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd3751-7aa1-4570-acda-85e2fdaee6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:29.997255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd3751-7aa1-4570-acda-85e2fdaee6d3 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:29.997536 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd3751-7aa1-4570-acda-85e2fdaee6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:29.997806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd3751-7aa1-4570-acda-85e2fdaee6d3 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:29.998545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd3751-7aa1-4570-acda-85e2fdaee6d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:29.998849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd3751-7aa1-4570-acda-85e2fdaee6d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:30.000195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd3751-7aa1-4570-acda-85e2fdaee6d3 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:30.016204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 532/1069] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:30.017350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e5a1f-b426-47d2-af83-2b13c3afc6a6 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:30.120348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e5a1f-b426-47d2-af83-2b13c3afc6a6 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:30.153096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980d073-4825-4478-8960-2775bc81aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:30.153890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980d073-4825-4478-8960-2775bc81aea5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.154170 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980d073-4825-4478-8960-2775bc81aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.154470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980d073-4825-4478-8960-2775bc81aea5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.161036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980d073-4825-4478-8960-2775bc81aea5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:30.162496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980d073-4825-4478-8960-2775bc81aea5 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-4980d073-4825-4478-8960-2775bc81aea5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:34:30.176913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:30.177812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:30.183185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:34:30.183185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:34:30.183185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:34:30.183185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:34:30.183185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:34:30.183185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:34:30.183185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:30.183185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:30.183185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 538/1070] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:34:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:30.185917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd3751-7aa1-4570-acda-85e2fdaee6d3 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:30.223568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de076c7-b191-41ac-aa30-8715d81b1a8d None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.223905 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de076c7-b191-41ac-aa30-8715d81b1a8d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.224126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de076c7-b191-41ac-aa30-8715d81b1a8d None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.226174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 539/1071] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:34:30.231254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d550-c45e-453f-b7f9-8661e203b089 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.231544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d550-c45e-453f-b7f9-8661e203b089 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.231822 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d550-c45e-453f-b7f9-8661e203b089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.248464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-6f75d550-c45e-453f-b7f9-8661e203b089 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:30.249626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6f75d550-c45e-453f-b7f9-8661e203b089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:30.285070 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd3751-7aa1-4570-acda-85e2fdaee6d3 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:30.317331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111bd65-afce-476c-a370-5983eac004b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:30.317985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bd65-afce-476c-a370-5983eac004b4 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.318103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 540/1072] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:30.318262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bd65-afce-476c-a370-5983eac004b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.318554 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111bd65-afce-476c-a370-5983eac004b4 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.319969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111bd65-afce-476c-a370-5983eac004b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:30.320275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111bd65-afce-476c-a370-5983eac004b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:30.321694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111bd65-afce-476c-a370-5983eac004b4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:30.339577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 533/1073] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:34:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:30.341510 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75d550-c45e-453f-b7f9-8661e203b089 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:30.341666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111bd65-afce-476c-a370-5983eac004b4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:30.439326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111bd65-afce-476c-a370-5983eac004b4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:30.445013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75d550-c45e-453f-b7f9-8661e203b089 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:30.476044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e5f5d-14f7-46e9-944f-18c6dda11242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:30.477260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e5f5d-14f7-46e9-944f-18c6dda11242 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.477757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e5f5d-14f7-46e9-944f-18c6dda11242 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.478551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e5f5d-14f7-46e9-944f-18c6dda11242 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.482773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f7ad9-4c2f-4cb8-8b9e-825df027585a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:30.483677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7ad9-4c2f-4cb8-8b9e-825df027585a None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.483959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7ad9-4c2f-4cb8-8b9e-825df027585a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.484236 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f7ad9-4c2f-4cb8-8b9e-825df027585a None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/ebefa53d595b4e6486ce409f2ac47ff1/roles/be2d9f91e4cb4dc0ad7bb5589d31739b` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.486559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f7ad9-4c2f-4cb8-8b9e-825df027585a None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=ebefa53d595b4e6486ce409f2ac47ff1, role_id=be2d9f91e4cb4dc0ad7bb5589d31739b)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:30.488005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f7ad9-4c2f-4cb8-8b9e-825df027585a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:30.491293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e5f5d-14f7-46e9-944f-18c6dda11242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-107e5f5d-14f7-46e9-944f-18c6dda11242 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:34:30.500501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:30.501440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:34:30.502302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:30.502980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 541/1074] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:34:30 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/ebefa53d595b4e6486ce409f2ac47ff1/roles/be2d9f91e4cb4dc0ad7bb5589d31739b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:34:30.504502 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 534/1075] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:34:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:30.510881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f7ad9-4c2f-4cb8-8b9e-825df027585a None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:30.618565 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f7ad9-4c2f-4cb8-8b9e-825df027585a None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:30.648921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca299ebf-1c50-4b8a-931c-7f2c66890564 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.649250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca299ebf-1c50-4b8a-931c-7f2c66890564 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.649477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca299ebf-1c50-4b8a-931c-7f2c66890564 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.651033 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 535/1076] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:30.654750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfe275-7758-4240-aa06-720d56dd4816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:30.655439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfe275-7758-4240-aa06-720d56dd4816 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.655717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfe275-7758-4240-aa06-720d56dd4816 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.655987 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfe275-7758-4240-aa06-720d56dd4816 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.656747 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfe275-7758-4240-aa06-720d56dd4816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:30.656860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14927d-7362-4663-beb0-2d80d8de36c9 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.657107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfe275-7758-4240-aa06-720d56dd4816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:30.657200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14927d-7362-4663-beb0-2d80d8de36c9 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.657558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14927d-7362-4663-beb0-2d80d8de36c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.658516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfe275-7758-4240-aa06-720d56dd4816 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:30.672583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 542/1077] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:34:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:30.673764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfe275-7758-4240-aa06-720d56dd4816 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:30.676781 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-4b14927d-7362-4663-beb0-2d80d8de36c9 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:30.677962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4b14927d-7362-4663-beb0-2d80d8de36c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:30.754442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 536/1078] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:30.773622 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfe275-7758-4240-aa06-720d56dd4816 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:30.776407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14927d-7362-4663-beb0-2d80d8de36c9 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:30.807231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e984874-e2d4-469d-a897-4aa6d3b8583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:30.808110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e984874-e2d4-469d-a897-4aa6d3b8583d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.808396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e984874-e2d4-469d-a897-4aa6d3b8583d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.808671 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e984874-e2d4-469d-a897-4aa6d3b8583d None admin] PATH_INFO: `/v3/users/29063303cd89466289b67eb9487c9878` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.809874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e984874-e2d4-469d-a897-4aa6d3b8583d None admin] RBAC: Authorizing `identity:get_user(user_id=29063303cd89466289b67eb9487c9878)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:30.811328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e984874-e2d4-469d-a897-4aa6d3b8583d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:30.813139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 543/1079] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:34:30 2022] GET /identity/v3/users/29063303cd89466289b67eb9487c9878 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:30.818446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e984874-e2d4-469d-a897-4aa6d3b8583d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:30.874479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14927d-7362-4663-beb0-2d80d8de36c9 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:30.908678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11399d-fa4c-47c8-8f94-409af8d0cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:30.909322 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11399d-fa4c-47c8-8f94-409af8d0cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.909600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11399d-fa4c-47c8-8f94-409af8d0cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.909869 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11399d-fa4c-47c8-8f94-409af8d0cfa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.918025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e984874-e2d4-469d-a897-4aa6d3b8583d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:30.952251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166ca98-21c0-495d-9ab2-5e33aeb46280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:30.953106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166ca98-21c0-495d-9ab2-5e33aeb46280 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:30.953381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166ca98-21c0-495d-9ab2-5e33aeb46280 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:30.953648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166ca98-21c0-495d-9ab2-5e33aeb46280 None admin] PATH_INFO: `/v3/projects/d08670e8e75d40dab852126665405f11` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:30.954854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166ca98-21c0-495d-9ab2-5e33aeb46280 None admin] RBAC: Authorizing `identity:get_project(project_id=d08670e8e75d40dab852126665405f11)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:30.956285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166ca98-21c0-495d-9ab2-5e33aeb46280 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:30.963450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 544/1080] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:34:30 2022] GET /identity/v3/projects/d08670e8e75d40dab852126665405f11 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:30.964090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166ca98-21c0-495d-9ab2-5e33aeb46280 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:30.977971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11399d-fa4c-47c8-8f94-409af8d0cfa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:30.979732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11399d-fa4c-47c8-8f94-409af8d0cfa4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:31.063611 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166ca98-21c0-495d-9ab2-5e33aeb46280 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:31.077931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 537/1081] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:34:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 15:34:31.083682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11399d-fa4c-47c8-8f94-409af8d0cfa4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:31.097271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735b055-d822-4d04-9ea3-12045bdcf4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:31.098150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735b055-d822-4d04-9ea3-12045bdcf4f9 None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:31.098467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735b055-d822-4d04-9ea3-12045bdcf4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:31.099015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735b055-d822-4d04-9ea3-12045bdcf4f9 None admin] PATH_INFO: `/v3/projects/d08670e8e75d40dab852126665405f11/users/29063303cd89466289b67eb9487c9878/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:31.101025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735b055-d822-4d04-9ea3-12045bdcf4f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d08670e8e75d40dab852126665405f11, user_id=29063303cd89466289b67eb9487c9878, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:31.102596 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735b055-d822-4d04-9ea3-12045bdcf4f9 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:31.116739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 545/1082] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:34:30 2022] PUT /identity/v3/projects/d08670e8e75d40dab852126665405f11/users/29063303cd89466289b67eb9487c9878/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:34:31.192340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11399d-fa4c-47c8-8f94-409af8d0cfa4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:31.228007 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd87f1-df4e-4d71-b1fb-1e2fe48e134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:31.229084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd87f1-df4e-4d71-b1fb-1e2fe48e134c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:31.229364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd87f1-df4e-4d71-b1fb-1e2fe48e134c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:31.229633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd87f1-df4e-4d71-b1fb-1e2fe48e134c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:31.240453 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd87f1-df4e-4d71-b1fb-1e2fe48e134c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:31.242668 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd87f1-df4e-4d71-b1fb-1e2fe48e134c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-90bd87f1-df4e-4d71-b1fb-1e2fe48e134c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:31.261989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:31.263165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:31.264084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:31.264084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:31.264084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:31.264084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:31.264084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 538/1083] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:31.269338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735b055-d822-4d04-9ea3-12045bdcf4f9 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:31.369798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735b055-d822-4d04-9ea3-12045bdcf4f9 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:31.402420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bec88-36c8-4740-bee2-7e43f8d636ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:31.403085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bec88-36c8-4740-bee2-7e43f8d636ac None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:31.403367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bec88-36c8-4740-bee2-7e43f8d636ac None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:31.403645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bec88-36c8-4740-bee2-7e43f8d636ac None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:31.404367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bec88-36c8-4740-bee2-7e43f8d636ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:31.404674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bec88-36c8-4740-bee2-7e43f8d636ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:31.406042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bec88-36c8-4740-bee2-7e43f8d636ac None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:31.418229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 546/1084] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:32.732217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeca153-32a2-4c0f-8d05-82547027a21e None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:32.732809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeca153-32a2-4c0f-8d05-82547027a21e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:32.732809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeca153-32a2-4c0f-8d05-82547027a21e None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:32.734139 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 539/1085] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:34:32.739480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edd658-797b-4e1a-a7be-74d41d93adaa None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:32.739917 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edd658-797b-4e1a-a7be-74d41d93adaa None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:32.740031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edd658-797b-4e1a-a7be-74d41d93adaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:32.756492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-97edd658-797b-4e1a-a7be-74d41d93adaa None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:32.757673 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-97edd658-797b-4e1a-a7be-74d41d93adaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:32.821199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 547/1086] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:32.844932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeca153-32a2-4c0f-8d05-82547027a21e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:32.942044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeca153-32a2-4c0f-8d05-82547027a21e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:32.974750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c6c1a-3a91-46e6-9734-527709e234bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:32.975718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c6c1a-3a91-46e6-9734-527709e234bc None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:32.976003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c6c1a-3a91-46e6-9734-527709e234bc None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:32.976278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c6c1a-3a91-46e6-9734-527709e234bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:32.986524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c6c1a-3a91-46e6-9734-527709e234bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-b88c6c1a-3a91-46e6-9734-527709e234bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:34:32.995057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:32.996148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:32.997374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 540/1087] 10.222.0.61 () {56 vars in 1120 bytes} [Sat May 14 15:34:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:33.002144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edd658-797b-4e1a-a7be-74d41d93adaa None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:33.103392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edd658-797b-4e1a-a7be-74d41d93adaa None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:33.136423 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66346d7-ffa2-4232-a4a0-04790e1f7061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:33.137115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66346d7-ffa2-4232-a4a0-04790e1f7061 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:33.137393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66346d7-ffa2-4232-a4a0-04790e1f7061 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:33.137662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66346d7-ffa2-4232-a4a0-04790e1f7061 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:33.138476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66346d7-ffa2-4232-a4a0-04790e1f7061 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:33.138782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66346d7-ffa2-4232-a4a0-04790e1f7061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:33.140191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66346d7-ffa2-4232-a4a0-04790e1f7061 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:33.149989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 548/1088] 10.222.0.61 () {56 vars in 1115 bytes} [Sat May 14 15:34:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:33.156030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c6c1a-3a91-46e6-9734-527709e234bc None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:33.251790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c6c1a-3a91-46e6-9734-527709e234bc None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:33.283096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae38c-f5ee-4a75-8568-42d51f80d436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:33.283878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae38c-f5ee-4a75-8568-42d51f80d436 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:33.284158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae38c-f5ee-4a75-8568-42d51f80d436 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:33.284429 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae38c-f5ee-4a75-8568-42d51f80d436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:33.295694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ae38c-f5ee-4a75-8568-42d51f80d436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:33.297159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ae38c-f5ee-4a75-8568-42d51f80d436 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-237ae38c-f5ee-4a75-8568-42d51f80d436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:33.314098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:33.315225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:33.316434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:33.316434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:33.316434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:33.316434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:33.316434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 541/1089] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:33.321315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66346d7-ffa2-4232-a4a0-04790e1f7061 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:33.327282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5310cd-653e-4186-b9a2-5032a1f6f1f8 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:33.327574 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5310cd-653e-4186-b9a2-5032a1f6f1f8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:33.327854 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5310cd-653e-4186-b9a2-5032a1f6f1f8 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:33.329199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 542/1090] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:34:33.334143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e90f-e06a-4e86-9cbb-a844ba938eb4 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:33.334473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e90f-e06a-4e86-9cbb-a844ba938eb4 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:33.335309 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e90f-e06a-4e86-9cbb-a844ba938eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:33.351881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-4bb3e90f-e06a-4e86-9cbb-a844ba938eb4 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:33.353045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4bb3e90f-e06a-4e86-9cbb-a844ba938eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:33.414976 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 543/1091] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:33.416457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66346d7-ffa2-4232-a4a0-04790e1f7061 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:33.437913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e90f-e06a-4e86-9cbb-a844ba938eb4 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:33.449710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea709-0d86-4e38-a473-dcd6f745c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:33.450395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea709-0d86-4e38-a473-dcd6f745c52d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:33.450680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea709-0d86-4e38-a473-dcd6f745c52d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:33.450953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dea709-0d86-4e38-a473-dcd6f745c52d None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:33.451678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dea709-0d86-4e38-a473-dcd6f745c52d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:33.451982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dea709-0d86-4e38-a473-dcd6f745c52d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:33.453341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dea709-0d86-4e38-a473-dcd6f745c52d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:33.469112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 549/1092] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:33.470055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea709-0d86-4e38-a473-dcd6f745c52d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:33.532895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e90f-e06a-4e86-9cbb-a844ba938eb4 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:33.565106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dea709-0d86-4e38-a473-dcd6f745c52d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:33.565418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84b909-7ca5-4dbd-bc36-91f5bafe8d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:33.566200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b909-7ca5-4dbd-bc36-91f5bafe8d80 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:33.566509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b909-7ca5-4dbd-bc36-91f5bafe8d80 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:33.566799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b909-7ca5-4dbd-bc36-91f5bafe8d80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:33.576985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84b909-7ca5-4dbd-bc36-91f5bafe8d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-ba84b909-7ca5-4dbd-bc36-91f5bafe8d80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:34:33.584487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:33.585512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:33.586399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 544/1093] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:33.591451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84b909-7ca5-4dbd-bc36-91f5bafe8d80 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:33.597694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92776726-99e0-40ae-9884-729080226704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:33.598512 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92776726-99e0-40ae-9884-729080226704 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:33.598792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92776726-99e0-40ae-9884-729080226704 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:33.599062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92776726-99e0-40ae-9884-729080226704 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:33.606943 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92776726-99e0-40ae-9884-729080226704 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:33.608373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92776726-99e0-40ae-9884-729080226704 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-92776726-99e0-40ae-9884-729080226704 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:34:33.622229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:33.623410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:33.624437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:33.624437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:33.624437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:34:33.624437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:34:33.624437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:34:33.624437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:34:33.624437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:34:33.624437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:34:33.624437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 14 15:34:33.624437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:33.624437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 550/1094] 10.222.0.61 () {56 vars in 1093 bytes} [Sat May 14 15:34:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:33.628936 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92776726-99e0-40ae-9884-729080226704 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:33.688997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84b909-7ca5-4dbd-bc36-91f5bafe8d80 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:33.720327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e14ba9-db64-4dbb-a624-170703d3cfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:33.720985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e14ba9-db64-4dbb-a624-170703d3cfdf None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:33.721263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e14ba9-db64-4dbb-a624-170703d3cfdf None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:33.721534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e14ba9-db64-4dbb-a624-170703d3cfdf None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:33.722262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e14ba9-db64-4dbb-a624-170703d3cfdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:33.722562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92776726-99e0-40ae-9884-729080226704 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:33.722670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e14ba9-db64-4dbb-a624-170703d3cfdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:33.723924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e14ba9-db64-4dbb-a624-170703d3cfdf None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:33.732057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 545/1095] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:33.737696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e14ba9-db64-4dbb-a624-170703d3cfdf None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:33.755094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb386ae-30b2-4769-99a5-77ace39f70f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:33.755752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb386ae-30b2-4769-99a5-77ace39f70f4 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:33.756028 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb386ae-30b2-4769-99a5-77ace39f70f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:33.756316 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb386ae-30b2-4769-99a5-77ace39f70f4 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:33.757724 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb386ae-30b2-4769-99a5-77ace39f70f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:33.758029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb386ae-30b2-4769-99a5-77ace39f70f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:33.759551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb386ae-30b2-4769-99a5-77ace39f70f4 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:33.776550 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 551/1096] 10.222.0.61 () {56 vars in 1133 bytes} [Sat May 14 15:34:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:33.781806 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb386ae-30b2-4769-99a5-77ace39f70f4 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:33.835215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e14ba9-db64-4dbb-a624-170703d3cfdf None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:33.868113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370f3f-933d-4c7b-966b-d770a531f4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:33.868969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370f3f-933d-4c7b-966b-d770a531f4ea None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:33.869249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370f3f-933d-4c7b-966b-d770a531f4ea None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:33.869520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c370f3f-933d-4c7b-966b-d770a531f4ea None admin] PATH_INFO: `/v3/users/29063303cd89466289b67eb9487c9878` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:33.870719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c370f3f-933d-4c7b-966b-d770a531f4ea None admin] RBAC: Authorizing `identity:get_user(user_id=29063303cd89466289b67eb9487c9878)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:33.872132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c370f3f-933d-4c7b-966b-d770a531f4ea None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:33.873924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 546/1097] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:34:33 2022] GET /identity/v3/users/29063303cd89466289b67eb9487c9878 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:33.879290 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370f3f-933d-4c7b-966b-d770a531f4ea None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:33.882498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb386ae-30b2-4769-99a5-77ace39f70f4 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:33.915203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30330b8d-be7a-4a34-b9dc-f64c59262006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:33.915846 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330b8d-be7a-4a34-b9dc-f64c59262006 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:33.916129 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330b8d-be7a-4a34-b9dc-f64c59262006 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:33.916408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30330b8d-be7a-4a34-b9dc-f64c59262006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:33.971521 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c370f3f-933d-4c7b-966b-d770a531f4ea None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:33.979544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30330b8d-be7a-4a34-b9dc-f64c59262006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:33.980986 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30330b8d-be7a-4a34-b9dc-f64c59262006 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:34.005031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217c4d7-f507-472d-878d-fa56c9315250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:34.005682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217c4d7-f507-472d-878d-fa56c9315250 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:34.005967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217c4d7-f507-472d-878d-fa56c9315250 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:34.006243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217c4d7-f507-472d-878d-fa56c9315250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:34.071263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217c4d7-f507-472d-878d-fa56c9315250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:34.072696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217c4d7-f507-472d-878d-fa56c9315250 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:34.079861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 552/1098] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:34:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 15:34:34.080875 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30330b8d-be7a-4a34-b9dc-f64c59262006 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:34.173685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 547/1099] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:34:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 15:34:34.173972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30330b8d-be7a-4a34-b9dc-f64c59262006 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:34.174660 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217c4d7-f507-472d-878d-fa56c9315250 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:34.207327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57144fb7-d2b8-4a30-94f7-86fa5081d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:34.208104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57144fb7-d2b8-4a30-94f7-86fa5081d520 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:34.208383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57144fb7-d2b8-4a30-94f7-86fa5081d520 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:34.208654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57144fb7-d2b8-4a30-94f7-86fa5081d520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:34.218790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57144fb7-d2b8-4a30-94f7-86fa5081d520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:34.220260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57144fb7-d2b8-4a30-94f7-86fa5081d520 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-57144fb7-d2b8-4a30-94f7-86fa5081d520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:34:34.237188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:34.238101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:34.239059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:34:34.239059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:34:34.239059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:34:34.239059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:34.239059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 553/1100] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:34.244361 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57144fb7-d2b8-4a30-94f7-86fa5081d520 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:34.268226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217c4d7-f507-472d-878d-fa56c9315250 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:34.300093 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338b6bf-f0f0-4978-aab0-d771b113acbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:34.300946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338b6bf-f0f0-4978-aab0-d771b113acbb None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:34.301227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338b6bf-f0f0-4978-aab0-d771b113acbb None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:34.301505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338b6bf-f0f0-4978-aab0-d771b113acbb None admin] PATH_INFO: `/v3/projects/d08670e8e75d40dab852126665405f11` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:34.302756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338b6bf-f0f0-4978-aab0-d771b113acbb None admin] RBAC: Authorizing `identity:get_project(project_id=d08670e8e75d40dab852126665405f11)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:34.304686 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338b6bf-f0f0-4978-aab0-d771b113acbb None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:34.306379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 548/1101] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:34:34 2022] GET /identity/v3/projects/d08670e8e75d40dab852126665405f11 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:34.312265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338b6bf-f0f0-4978-aab0-d771b113acbb None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:34.340232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57144fb7-d2b8-4a30-94f7-86fa5081d520 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:34.373990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38488a47-e56a-43df-8ea4-3bf73720fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:34.374683 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488a47-e56a-43df-8ea4-3bf73720fb5e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:34.374972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488a47-e56a-43df-8ea4-3bf73720fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:34.375259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38488a47-e56a-43df-8ea4-3bf73720fb5e None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:34.375971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38488a47-e56a-43df-8ea4-3bf73720fb5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:34.376281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38488a47-e56a-43df-8ea4-3bf73720fb5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:34.377640 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38488a47-e56a-43df-8ea4-3bf73720fb5e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:34.389563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 554/1102] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:34.395514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38488a47-e56a-43df-8ea4-3bf73720fb5e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:34.405988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338b6bf-f0f0-4978-aab0-d771b113acbb None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:34.438986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbe372-d291-4137-a1ff-f4573eba9d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:34.439567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbe372-d291-4137-a1ff-f4573eba9d56 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:34.439849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbe372-d291-4137-a1ff-f4573eba9d56 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:34.440125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbe372-d291-4137-a1ff-f4573eba9d56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:34.440951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbe372-d291-4137-a1ff-f4573eba9d56 None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=d08670e8e75d40dab852126665405f11, user.id=29063303cd89466289b67eb9487c9878) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:34.441265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbe372-d291-4137-a1ff-f4573eba9d56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:34.442711 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbe372-d291-4137-a1ff-f4573eba9d56 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:34.449393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 549/1103] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:34:34 2022] GET /identity/v3/role_assignments?user.id=29063303cd89466289b67eb9487c9878&scope.project.id=d08670e8e75d40dab852126665405f11&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:34:34.493710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38488a47-e56a-43df-8ea4-3bf73720fb5e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:34.528639 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef81d2-607c-4b0b-9b23-b0551b58d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:34.529456 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef81d2-607c-4b0b-9b23-b0551b58d974 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:34.529736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef81d2-607c-4b0b-9b23-b0551b58d974 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:34.530010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef81d2-607c-4b0b-9b23-b0551b58d974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:34.537434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef81d2-607c-4b0b-9b23-b0551b58d974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:34.539504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef81d2-607c-4b0b-9b23-b0551b58d974 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-45ef81d2-607c-4b0b-9b23-b0551b58d974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:34:34.555020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:34.556194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:34.557113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:34:34.557113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:34:34.557113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:34:34.557113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:34:34.557113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:34:34.557113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:34:34.557113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:34:34.557113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:34:34.557113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 555/1104] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:34:34.562519 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbe372-d291-4137-a1ff-f4573eba9d56 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:34.661620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbe372-d291-4137-a1ff-f4573eba9d56 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:34.694863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a95ea2-99f3-4de6-98d4-da17ffb97f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:34.695445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a95ea2-99f3-4de6-98d4-da17ffb97f3c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:34.695727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a95ea2-99f3-4de6-98d4-da17ffb97f3c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:34.696002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a95ea2-99f3-4de6-98d4-da17ffb97f3c None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:34.696785 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a95ea2-99f3-4de6-98d4-da17ffb97f3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:34.697092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a95ea2-99f3-4de6-98d4-da17ffb97f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:34.698544 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a95ea2-99f3-4de6-98d4-da17ffb97f3c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:34.710266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 550/1105] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:34.716270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef81d2-607c-4b0b-9b23-b0551b58d974 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:34.812191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef81d2-607c-4b0b-9b23-b0551b58d974 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:34.846748 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc0915-2c25-4480-b3ad-e134321c87f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:34.847407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc0915-2c25-4480-b3ad-e134321c87f2 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:34.847689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc0915-2c25-4480-b3ad-e134321c87f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:34.847963 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc0915-2c25-4480-b3ad-e134321c87f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:34.848804 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc0915-2c25-4480-b3ad-e134321c87f2 None admin] RBAC: Adding query filter params (role.id=be2d9f91e4cb4dc0ad7bb5589d31739b, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=ebefa53d595b4e6486ce409f2ac47ff1) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:34.849115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc0915-2c25-4480-b3ad-e134321c87f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:34.851232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc0915-2c25-4480-b3ad-e134321c87f2 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:34.857190 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 556/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:34:34 2022] GET /identity/v3/role_assignments?user.id=ebefa53d595b4e6486ce409f2ac47ff1&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=be2d9f91e4cb4dc0ad7bb5589d31739b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:36.706303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433be21-1ec6-41a1-8fd4-d2284640c84d None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:36.706966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433be21-1ec6-41a1-8fd4-d2284640c84d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:36.706966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433be21-1ec6-41a1-8fd4-d2284640c84d None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:36.708230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 551/1107] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:36.714326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48506c-e1d5-49d2-8fd6-5878d2c50e79 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:36.714750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48506c-e1d5-49d2-8fd6-5878d2c50e79 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:36.714888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48506c-e1d5-49d2-8fd6-5878d2c50e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:36.731863 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4d48506c-e1d5-49d2-8fd6-5878d2c50e79 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:36.733027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4d48506c-e1d5-49d2-8fd6-5878d2c50e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:36.795737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 557/1108] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:36.819972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433be21-1ec6-41a1-8fd4-d2284640c84d None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:36.916384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433be21-1ec6-41a1-8fd4-d2284640c84d None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:36.947756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928088f5-a04c-4864-8905-b2fc36dc358f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:36.948530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928088f5-a04c-4864-8905-b2fc36dc358f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:36.948810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928088f5-a04c-4864-8905-b2fc36dc358f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:36.949078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928088f5-a04c-4864-8905-b2fc36dc358f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:36.950234 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928088f5-a04c-4864-8905-b2fc36dc358f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:36.951685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928088f5-a04c-4864-8905-b2fc36dc358f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:36.953280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 552/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:36.959096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48506c-e1d5-49d2-8fd6-5878d2c50e79 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:37.051769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48506c-e1d5-49d2-8fd6-5878d2c50e79 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:37.083611 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d49765-18be-47cf-a4c8-c85edc48bf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:37.084267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d49765-18be-47cf-a4c8-c85edc48bf29 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:37.085205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d49765-18be-47cf-a4c8-c85edc48bf29 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:37.085564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d49765-18be-47cf-a4c8-c85edc48bf29 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:37.086493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d49765-18be-47cf-a4c8-c85edc48bf29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:37.087929 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d49765-18be-47cf-a4c8-c85edc48bf29 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:37.106503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 558/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:34:36 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:34:39.361174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bcd21-9c6c-4cdd-915d-05fff93743dd None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:39.361707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bcd21-9c6c-4cdd-915d-05fff93743dd None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:39.361802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bcd21-9c6c-4cdd-915d-05fff93743dd None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:39.363140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 553/1111] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:39.368721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a5e0e-0e80-40f1-9c13-e3dae8e94a4e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:39.369128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a5e0e-0e80-40f1-9c13-e3dae8e94a4e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:39.369270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a5e0e-0e80-40f1-9c13-e3dae8e94a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:39.386140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9a3a5e0e-0e80-40f1-9c13-e3dae8e94a4e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:39.387368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9a3a5e0e-0e80-40f1-9c13-e3dae8e94a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:39.449683 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 559/1112] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:39.472469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bcd21-9c6c-4cdd-915d-05fff93743dd None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:39.567880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bcd21-9c6c-4cdd-915d-05fff93743dd None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:39.599682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3be6f0-639d-4b2c-ba1e-e754e183b7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:39.601146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3be6f0-639d-4b2c-ba1e-e754e183b7c3 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:39.601424 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3be6f0-639d-4b2c-ba1e-e754e183b7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:39.601695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3be6f0-639d-4b2c-ba1e-e754e183b7c3 None admin] PATH_INFO: `/v3/roles/97f5bd452f314fa093a222f49facdac7` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:39.603163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3be6f0-639d-4b2c-ba1e-e754e183b7c3 None admin] RBAC: Authorizing `identity:get_role(role_id=97f5bd452f314fa093a222f49facdac7)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:39.604771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3be6f0-639d-4b2c-ba1e-e754e183b7c3 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:39.606104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 554/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:34:39 2022] GET /identity/v3/roles/97f5bd452f314fa093a222f49facdac7 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:39.612000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a5e0e-0e80-40f1-9c13-e3dae8e94a4e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:39.703324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a5e0e-0e80-40f1-9c13-e3dae8e94a4e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:39.735881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11350f8d-12a0-46ce-9ff4-1f2c8632cfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:39.736721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350f8d-12a0-46ce-9ff4-1f2c8632cfc9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:39.736999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350f8d-12a0-46ce-9ff4-1f2c8632cfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:39.737268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11350f8d-12a0-46ce-9ff4-1f2c8632cfc9 None admin] PATH_INFO: `/v3/users/35f4069954a34a09a9cdaa3a7b5b20e7` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:39.749571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11350f8d-12a0-46ce-9ff4-1f2c8632cfc9 None admin] RBAC: Authorizing `identity:get_user(user_id=35f4069954a34a09a9cdaa3a7b5b20e7)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:39.751009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11350f8d-12a0-46ce-9ff4-1f2c8632cfc9 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:39.752600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 560/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:34:39 2022] GET /identity/v3/users/35f4069954a34a09a9cdaa3a7b5b20e7 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:39.758422 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3be6f0-639d-4b2c-ba1e-e754e183b7c3 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:39.851785 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3be6f0-639d-4b2c-ba1e-e754e183b7c3 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:39.883835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc2474-2483-49b8-8b4f-6f77c72ee692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:39.884415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc2474-2483-49b8-8b4f-6f77c72ee692 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:39.884704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc2474-2483-49b8-8b4f-6f77c72ee692 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:39.884980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc2474-2483-49b8-8b4f-6f77c72ee692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:39.947416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc2474-2483-49b8-8b4f-6f77c72ee692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:39.948842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc2474-2483-49b8-8b4f-6f77c72ee692 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:40.042094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 555/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:34:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:34:40.048247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11350f8d-12a0-46ce-9ff4-1f2c8632cfc9 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:40.141625 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11350f8d-12a0-46ce-9ff4-1f2c8632cfc9 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:40.173171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4226ce-0102-4926-b3a3-266b9b91a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:40.174010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4226ce-0102-4926-b3a3-266b9b91a563 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:40.174289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4226ce-0102-4926-b3a3-266b9b91a563 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:40.174587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4226ce-0102-4926-b3a3-266b9b91a563 None admin] PATH_INFO: `/v3/projects/d08670e8e75d40dab852126665405f11` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:40.175754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4226ce-0102-4926-b3a3-266b9b91a563 None admin] RBAC: Authorizing `identity:get_project(project_id=d08670e8e75d40dab852126665405f11)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:40.177175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4226ce-0102-4926-b3a3-266b9b91a563 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:40.179490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 561/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:34:40 2022] GET /identity/v3/projects/d08670e8e75d40dab852126665405f11 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:40.185576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc2474-2483-49b8-8b4f-6f77c72ee692 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:40.281344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc2474-2483-49b8-8b4f-6f77c72ee692 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:40.313936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5870e-7931-4564-b738-4204ba17b381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:40.314605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5870e-7931-4564-b738-4204ba17b381 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:40.314890 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5870e-7931-4564-b738-4204ba17b381 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:40.315163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5870e-7931-4564-b738-4204ba17b381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:40.315984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5870e-7931-4564-b738-4204ba17b381 None admin] RBAC: Adding query filter params (role.id=97f5bd452f314fa093a222f49facdac7, scope.project.id=d08670e8e75d40dab852126665405f11, user.id=35f4069954a34a09a9cdaa3a7b5b20e7) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:40.316292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5870e-7931-4564-b738-4204ba17b381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:40.317695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f5870e-7931-4564-b738-4204ba17b381 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:40.323627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 556/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:34:40 2022] GET /identity/v3/role_assignments?user.id=35f4069954a34a09a9cdaa3a7b5b20e7&scope.project.id=d08670e8e75d40dab852126665405f11&role.id=97f5bd452f314fa093a222f49facdac7 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:42.489175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687ff0-8494-4e02-9c17-f8231dc32b74 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:42.489733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687ff0-8494-4e02-9c17-f8231dc32b74 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:42.489733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687ff0-8494-4e02-9c17-f8231dc32b74 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:42.491699 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 562/1118] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:42.496856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8883b-70ef-4730-9369-c56048755e2a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:42.497280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8883b-70ef-4730-9369-c56048755e2a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:42.497414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8883b-70ef-4730-9369-c56048755e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:42.514139 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-79f8883b-70ef-4730-9369-c56048755e2a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:42.515353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-79f8883b-70ef-4730-9369-c56048755e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:42.577009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 557/1119] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:42.599080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687ff0-8494-4e02-9c17-f8231dc32b74 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:42.698015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687ff0-8494-4e02-9c17-f8231dc32b74 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:42.730448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861ca7a-ec01-4512-b985-f4bc7d001d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:42.731286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ca7a-ec01-4512-b985-f4bc7d001d8e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:42.731570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ca7a-ec01-4512-b985-f4bc7d001d8e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:42.731845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ca7a-ec01-4512-b985-f4bc7d001d8e None admin] PATH_INFO: `/v3/roles/97f5bd452f314fa093a222f49facdac7` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:42.733312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861ca7a-ec01-4512-b985-f4bc7d001d8e None admin] RBAC: Authorizing `identity:get_role(role_id=97f5bd452f314fa093a222f49facdac7)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:42.734705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861ca7a-ec01-4512-b985-f4bc7d001d8e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:42.736055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 563/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:34:42 2022] GET /identity/v3/roles/97f5bd452f314fa093a222f49facdac7 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:42.742730 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8883b-70ef-4730-9369-c56048755e2a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:42.835539 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8883b-70ef-4730-9369-c56048755e2a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:42.868628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6ea7b-3c0e-4e93-8480-4a9c69e81339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:42.869482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6ea7b-3c0e-4e93-8480-4a9c69e81339 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:42.869763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6ea7b-3c0e-4e93-8480-4a9c69e81339 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:42.870032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6ea7b-3c0e-4e93-8480-4a9c69e81339 None admin] PATH_INFO: `/v3/users/35f4069954a34a09a9cdaa3a7b5b20e7` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:42.871227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6ea7b-3c0e-4e93-8480-4a9c69e81339 None admin] RBAC: Authorizing `identity:get_user(user_id=35f4069954a34a09a9cdaa3a7b5b20e7)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:42.872658 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6ea7b-3c0e-4e93-8480-4a9c69e81339 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:42.874255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 558/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:34:42 2022] GET /identity/v3/users/35f4069954a34a09a9cdaa3a7b5b20e7 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:42.879959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861ca7a-ec01-4512-b985-f4bc7d001d8e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:42.972317 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861ca7a-ec01-4512-b985-f4bc7d001d8e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:43.005037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def55bf-08fc-41a6-be18-8b900575a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:43.005820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def55bf-08fc-41a6-be18-8b900575a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:43.006151 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def55bf-08fc-41a6-be18-8b900575a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:43.006517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def55bf-08fc-41a6-be18-8b900575a2d3 None admin] PATH_INFO: `/v3/projects/d08670e8e75d40dab852126665405f11` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:43.007693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def55bf-08fc-41a6-be18-8b900575a2d3 None admin] RBAC: Authorizing `identity:get_project(project_id=d08670e8e75d40dab852126665405f11)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:43.009114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def55bf-08fc-41a6-be18-8b900575a2d3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:43.010819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 564/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:34:42 2022] GET /identity/v3/projects/d08670e8e75d40dab852126665405f11 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:43.016583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6ea7b-3c0e-4e93-8480-4a9c69e81339 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:43.109335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6ea7b-3c0e-4e93-8480-4a9c69e81339 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:43.141478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1d593-a1df-434b-a8b8-0c7066957da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:43.142373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d593-a1df-434b-a8b8-0c7066957da1 None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:43.142656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d593-a1df-434b-a8b8-0c7066957da1 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:43.142929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d593-a1df-434b-a8b8-0c7066957da1 None admin] PATH_INFO: `/v3/projects/d08670e8e75d40dab852126665405f11/users/35f4069954a34a09a9cdaa3a7b5b20e7/roles/97f5bd452f314fa093a222f49facdac7` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:43.145096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1d593-a1df-434b-a8b8-0c7066957da1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d08670e8e75d40dab852126665405f11, user_id=35f4069954a34a09a9cdaa3a7b5b20e7, role_id=97f5bd452f314fa093a222f49facdac7)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:43.146548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1d593-a1df-434b-a8b8-0c7066957da1 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:43.158434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 559/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:34:43 2022] PUT /identity/v3/projects/d08670e8e75d40dab852126665405f11/users/35f4069954a34a09a9cdaa3a7b5b20e7/roles/97f5bd452f314fa093a222f49facdac7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:34:45.333031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830fb87-4f28-401b-9cc8-7fd72ceb0d0f None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:45.333577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830fb87-4f28-401b-9cc8-7fd72ceb0d0f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:45.333577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830fb87-4f28-401b-9cc8-7fd72ceb0d0f None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:45.335201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 565/1124] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:45.340508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c323a-e0db-4295-aab8-088c9dc9fe6d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:45.340904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c323a-e0db-4295-aab8-088c9dc9fe6d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:45.341069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c323a-e0db-4295-aab8-088c9dc9fe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:45.357975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-400c323a-e0db-4295-aab8-088c9dc9fe6d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:45.359174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-400c323a-e0db-4295-aab8-088c9dc9fe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:45.420955 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 560/1125] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:45.443810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830fb87-4f28-401b-9cc8-7fd72ceb0d0f None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:45.538859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830fb87-4f28-401b-9cc8-7fd72ceb0d0f None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:45.569727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69018ca0-560e-4637-93aa-c67cf9864f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:45.570577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69018ca0-560e-4637-93aa-c67cf9864f6f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:45.570855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69018ca0-560e-4637-93aa-c67cf9864f6f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:45.571121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69018ca0-560e-4637-93aa-c67cf9864f6f None admin] PATH_INFO: `/v3/roles/97f5bd452f314fa093a222f49facdac7` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:45.572601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69018ca0-560e-4637-93aa-c67cf9864f6f None admin] RBAC: Authorizing `identity:get_role(role_id=97f5bd452f314fa093a222f49facdac7)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:45.573972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69018ca0-560e-4637-93aa-c67cf9864f6f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:45.575326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 566/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:34:45 2022] GET /identity/v3/roles/97f5bd452f314fa093a222f49facdac7 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:45.581013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c323a-e0db-4295-aab8-088c9dc9fe6d None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:45.673951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c323a-e0db-4295-aab8-088c9dc9fe6d None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:45.704872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b74950-7dde-4c7e-b2ed-757623382c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:45.705716 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74950-7dde-4c7e-b2ed-757623382c1b None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:45.705992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74950-7dde-4c7e-b2ed-757623382c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:45.706261 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74950-7dde-4c7e-b2ed-757623382c1b None admin] PATH_INFO: `/v3/users/35f4069954a34a09a9cdaa3a7b5b20e7` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:45.707448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b74950-7dde-4c7e-b2ed-757623382c1b None admin] RBAC: Authorizing `identity:get_user(user_id=35f4069954a34a09a9cdaa3a7b5b20e7)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:45.708864 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b74950-7dde-4c7e-b2ed-757623382c1b None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:45.711049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 561/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:34:45 2022] GET /identity/v3/users/35f4069954a34a09a9cdaa3a7b5b20e7 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:45.716768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69018ca0-560e-4637-93aa-c67cf9864f6f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:45.809189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69018ca0-560e-4637-93aa-c67cf9864f6f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:45.841586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb63632-5a0b-4b4a-831a-9b7046d8e7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:45.842227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb63632-5a0b-4b4a-831a-9b7046d8e7ff None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:45.842530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb63632-5a0b-4b4a-831a-9b7046d8e7ff None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:45.842799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb63632-5a0b-4b4a-831a-9b7046d8e7ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:45.905594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb63632-5a0b-4b4a-831a-9b7046d8e7ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:45.907034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb63632-5a0b-4b4a-831a-9b7046d8e7ff None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:45.998636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 567/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:34:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:34:46.004387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b74950-7dde-4c7e-b2ed-757623382c1b None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:46.096978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b74950-7dde-4c7e-b2ed-757623382c1b None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:46.128988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089e59-f8da-4e59-9313-a49382331a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:46.129826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089e59-f8da-4e59-9313-a49382331a33 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:46.130111 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089e59-f8da-4e59-9313-a49382331a33 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:46.130414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089e59-f8da-4e59-9313-a49382331a33 None admin] PATH_INFO: `/v3/projects/d08670e8e75d40dab852126665405f11` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:46.132199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089e59-f8da-4e59-9313-a49382331a33 None admin] RBAC: Authorizing `identity:get_project(project_id=d08670e8e75d40dab852126665405f11)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:46.133615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089e59-f8da-4e59-9313-a49382331a33 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:46.135316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 562/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:34:46 2022] GET /identity/v3/projects/d08670e8e75d40dab852126665405f11 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:46.141394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb63632-5a0b-4b4a-831a-9b7046d8e7ff None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:46.234429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb63632-5a0b-4b4a-831a-9b7046d8e7ff None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:46.267573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c95466-4b7a-495d-b14a-5890e1345942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:46.268155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c95466-4b7a-495d-b14a-5890e1345942 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:46.268440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c95466-4b7a-495d-b14a-5890e1345942 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:46.268719 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c95466-4b7a-495d-b14a-5890e1345942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:46.269548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c95466-4b7a-495d-b14a-5890e1345942 None admin] RBAC: Adding query filter params (role.id=97f5bd452f314fa093a222f49facdac7, scope.project.id=d08670e8e75d40dab852126665405f11, user.id=35f4069954a34a09a9cdaa3a7b5b20e7) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:46.269859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c95466-4b7a-495d-b14a-5890e1345942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:46.271306 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c95466-4b7a-495d-b14a-5890e1345942 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:46.277040 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 568/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:34:46 2022] GET /identity/v3/role_assignments?user.id=35f4069954a34a09a9cdaa3a7b5b20e7&scope.project.id=d08670e8e75d40dab852126665405f11&role.id=97f5bd452f314fa093a222f49facdac7 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:48.484058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9457c-592c-4974-935f-ddfe4142dadf None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:48.484589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9457c-592c-4974-935f-ddfe4142dadf None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:48.484589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9457c-592c-4974-935f-ddfe4142dadf None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:48.485949 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 563/1131] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:48.491710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80008f6-267c-4c8f-adfc-37cfbdf02b39 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:48.492147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80008f6-267c-4c8f-adfc-37cfbdf02b39 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:48.492242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80008f6-267c-4c8f-adfc-37cfbdf02b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:48.508890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d80008f6-267c-4c8f-adfc-37cfbdf02b39 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:48.510053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d80008f6-267c-4c8f-adfc-37cfbdf02b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:48.571757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 569/1132] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:48.594515 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9457c-592c-4974-935f-ddfe4142dadf None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:48.689542 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9457c-592c-4974-935f-ddfe4142dadf None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:48.720999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400ac66-ac99-45f7-828d-230c2f4f0a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:48.721766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400ac66-ac99-45f7-828d-230c2f4f0a67 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:48.722044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400ac66-ac99-45f7-828d-230c2f4f0a67 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:48.722337 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400ac66-ac99-45f7-828d-230c2f4f0a67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:48.723493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400ac66-ac99-45f7-828d-230c2f4f0a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:48.724929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400ac66-ac99-45f7-828d-230c2f4f0a67 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:48.726509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 564/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:48.732451 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80008f6-267c-4c8f-adfc-37cfbdf02b39 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:48.824639 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80008f6-267c-4c8f-adfc-37cfbdf02b39 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:48.857421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2614d-2674-4494-9075-3b7677b0a6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:48.858071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2614d-2674-4494-9075-3b7677b0a6bf None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:48.858377 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2614d-2674-4494-9075-3b7677b0a6bf None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:48.858653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2614d-2674-4494-9075-3b7677b0a6bf None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:48.859347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2614d-2674-4494-9075-3b7677b0a6bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:48.860758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2614d-2674-4494-9075-3b7677b0a6bf None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:48.884753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 570/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:34:48 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:34:51.111263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61f06e-6a4c-4fe5-8be0-bbf07437b105 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:51.111777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61f06e-6a4c-4fe5-8be0-bbf07437b105 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:51.111777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61f06e-6a4c-4fe5-8be0-bbf07437b105 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:51.113073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 565/1135] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:51.118284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b386ffb-279e-4646-8705-36f3a6108fc0 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:51.118683 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b386ffb-279e-4646-8705-36f3a6108fc0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:51.118866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b386ffb-279e-4646-8705-36f3a6108fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:51.135900 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-6b386ffb-279e-4646-8705-36f3a6108fc0 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:51.137079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6b386ffb-279e-4646-8705-36f3a6108fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:51.199643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 571/1136] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:34:51.223930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61f06e-6a4c-4fe5-8be0-bbf07437b105 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:51.317545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61f06e-6a4c-4fe5-8be0-bbf07437b105 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:51.349028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9ba65-a9f0-47f6-a3bf-a892cebfa800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:51.349827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9ba65-a9f0-47f6-a3bf-a892cebfa800 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:51.350104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9ba65-a9f0-47f6-a3bf-a892cebfa800 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:51.350402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9ba65-a9f0-47f6-a3bf-a892cebfa800 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:51.351552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9ba65-a9f0-47f6-a3bf-a892cebfa800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:51.353267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be9ba65-a9f0-47f6-a3bf-a892cebfa800 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:51.355109 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 566/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:34:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:51.360707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b386ffb-279e-4646-8705-36f3a6108fc0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:51.452687 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b386ffb-279e-4646-8705-36f3a6108fc0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:51.483766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aea3e2-643b-4045-905e-5e6fb242aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:51.484419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aea3e2-643b-4045-905e-5e6fb242aead None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:51.484699 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aea3e2-643b-4045-905e-5e6fb242aead None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:51.484969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aea3e2-643b-4045-905e-5e6fb242aead None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:51.485666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aea3e2-643b-4045-905e-5e6fb242aead None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:51.487166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aea3e2-643b-4045-905e-5e6fb242aead None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:51.506375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 572/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:34:51 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:34:53.720744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c909af4-eece-4129-877f-436d93283a93 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:53.721275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c909af4-eece-4129-877f-436d93283a93 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:53.721275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c909af4-eece-4129-877f-436d93283a93 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:53.722665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 567/1139] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:53.727817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0ae4-c140-4faf-bb7b-e93970492aef None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:53.728210 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0ae4-c140-4faf-bb7b-e93970492aef None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:53.728626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0ae4-c140-4faf-bb7b-e93970492aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:53.745146 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-999c0ae4-c140-4faf-bb7b-e93970492aef None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:53.746323 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-999c0ae4-c140-4faf-bb7b-e93970492aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:53.808019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 573/1140] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:53.830515 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c909af4-eece-4129-877f-436d93283a93 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:53.926737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c909af4-eece-4129-877f-436d93283a93 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:53.957171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d326b4-f89e-406e-92b1-1072b2fae077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:53.957940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d326b4-f89e-406e-92b1-1072b2fae077 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:53.958216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d326b4-f89e-406e-92b1-1072b2fae077 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:53.958518 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d326b4-f89e-406e-92b1-1072b2fae077 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:53.968576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d326b4-f89e-406e-92b1-1072b2fae077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-05d326b4-f89e-406e-92b1-1072b2fae077 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:34:53.976245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:53.977313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:53.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 568/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:53.983566 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c0ae4-c140-4faf-bb7b-e93970492aef None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:54.077054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c0ae4-c140-4faf-bb7b-e93970492aef None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:54.109097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31c7d2-22e5-4387-97cc-785e0ecd2f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:54.109741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31c7d2-22e5-4387-97cc-785e0ecd2f81 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:54.110019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31c7d2-22e5-4387-97cc-785e0ecd2f81 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:54.110287 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31c7d2-22e5-4387-97cc-785e0ecd2f81 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:54.111048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31c7d2-22e5-4387-97cc-785e0ecd2f81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:54.111347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31c7d2-22e5-4387-97cc-785e0ecd2f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:54.112692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31c7d2-22e5-4387-97cc-785e0ecd2f81 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:54.120820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 574/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:54.126441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d326b4-f89e-406e-92b1-1072b2fae077 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:54.218981 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d326b4-f89e-406e-92b1-1072b2fae077 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:54.250885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc62d19-869e-4f46-9916-284d4a59e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:54.251670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc62d19-869e-4f46-9916-284d4a59e61c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:54.251953 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc62d19-869e-4f46-9916-284d4a59e61c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:54.252228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc62d19-869e-4f46-9916-284d4a59e61c None admin] PATH_INFO: `/v3/users/e9ac13626b1a48979535c1ca2396ecff` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:54.264537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc62d19-869e-4f46-9916-284d4a59e61c None admin] RBAC: Authorizing `identity:get_user(user_id=e9ac13626b1a48979535c1ca2396ecff)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:54.265977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc62d19-869e-4f46-9916-284d4a59e61c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:54.267609 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 569/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:34:54 2022] GET /identity/v3/users/e9ac13626b1a48979535c1ca2396ecff => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:54.273300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31c7d2-22e5-4387-97cc-785e0ecd2f81 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:54.369987 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31c7d2-22e5-4387-97cc-785e0ecd2f81 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:54.400638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25ed5f-6ffa-4b9b-b1c6-4ecdd823a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:54.401271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25ed5f-6ffa-4b9b-b1c6-4ecdd823a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:54.401575 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25ed5f-6ffa-4b9b-b1c6-4ecdd823a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:54.401827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25ed5f-6ffa-4b9b-b1c6-4ecdd823a9f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:54.463895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25ed5f-6ffa-4b9b-b1c6-4ecdd823a9f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:54.465305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad25ed5f-6ffa-4b9b-b1c6-4ecdd823a9f2 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:54.556623 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 575/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:34:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:34:54.562466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc62d19-869e-4f46-9916-284d4a59e61c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:54.655430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc62d19-869e-4f46-9916-284d4a59e61c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:54.687313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccec14-9da2-445b-a3d1-7341c4fd0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:54.688146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccec14-9da2-445b-a3d1-7341c4fd0ffa None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:54.688425 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccec14-9da2-445b-a3d1-7341c4fd0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:54.688697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccec14-9da2-445b-a3d1-7341c4fd0ffa None admin] PATH_INFO: `/v3/projects/8f1f51f045114bab81292fe42a33d622` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:54.689847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccec14-9da2-445b-a3d1-7341c4fd0ffa None admin] RBAC: Authorizing `identity:get_project(project_id=8f1f51f045114bab81292fe42a33d622)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:54.691276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccec14-9da2-445b-a3d1-7341c4fd0ffa None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:54.692905 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 570/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:34:54 2022] GET /identity/v3/projects/8f1f51f045114bab81292fe42a33d622 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:54.698937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25ed5f-6ffa-4b9b-b1c6-4ecdd823a9f2 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:54.792143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25ed5f-6ffa-4b9b-b1c6-4ecdd823a9f2 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:54.823553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1f42f-5b42-4f38-9c69-3b5958d939ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:54.824192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1f42f-5b42-4f38-9c69-3b5958d939ad None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:54.824476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1f42f-5b42-4f38-9c69-3b5958d939ad None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:54.824753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1f42f-5b42-4f38-9c69-3b5958d939ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:54.825569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1f42f-5b42-4f38-9c69-3b5958d939ad None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=8f1f51f045114bab81292fe42a33d622, user.id=e9ac13626b1a48979535c1ca2396ecff) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:54.825879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1f42f-5b42-4f38-9c69-3b5958d939ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:54.827317 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1f42f-5b42-4f38-9c69-3b5958d939ad None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:54.832718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 576/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:34:54 2022] GET /identity/v3/role_assignments?user.id=e9ac13626b1a48979535c1ca2396ecff&scope.project.id=8f1f51f045114bab81292fe42a33d622&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:57.001764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d60fb-46c6-42ea-b089-311ecd816afd None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:57.002282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d60fb-46c6-42ea-b089-311ecd816afd None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:57.002405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d60fb-46c6-42ea-b089-311ecd816afd None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:57.003706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 571/1147] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:34:57.009645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66291163-3dfb-4703-afce-c073504a1e01 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:57.010055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66291163-3dfb-4703-afce-c073504a1e01 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:57.010197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66291163-3dfb-4703-afce-c073504a1e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:57.026514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-66291163-3dfb-4703-afce-c073504a1e01 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:34:57.027673 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-66291163-3dfb-4703-afce-c073504a1e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:34:57.089444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 577/1148] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:34:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:34:57.113429 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d60fb-46c6-42ea-b089-311ecd816afd None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:57.208196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d60fb-46c6-42ea-b089-311ecd816afd None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:57.239919 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68a421-5435-4818-bba4-35ec64cf9d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:57.241225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68a421-5435-4818-bba4-35ec64cf9d9a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:57.241499 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68a421-5435-4818-bba4-35ec64cf9d9a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:57.241767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68a421-5435-4818-bba4-35ec64cf9d9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:57.251206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68a421-5435-4818-bba4-35ec64cf9d9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-cd68a421-5435-4818-bba4-35ec64cf9d9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:34:57.258696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:34:57.259818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:34:57.260876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 572/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:34:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:34:57.265672 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66291163-3dfb-4703-afce-c073504a1e01 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:57.359610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66291163-3dfb-4703-afce-c073504a1e01 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:57.391193 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3f7bf-7129-4937-8e88-18d9cff7fcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:57.391843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3f7bf-7129-4937-8e88-18d9cff7fcb5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:57.392123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3f7bf-7129-4937-8e88-18d9cff7fcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:57.392397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3f7bf-7129-4937-8e88-18d9cff7fcb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:57.393139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3f7bf-7129-4937-8e88-18d9cff7fcb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:34:57.393443 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3f7bf-7129-4937-8e88-18d9cff7fcb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:57.394835 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3f7bf-7129-4937-8e88-18d9cff7fcb5 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:57.402610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 578/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:34:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:57.408276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68a421-5435-4818-bba4-35ec64cf9d9a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:57.501828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68a421-5435-4818-bba4-35ec64cf9d9a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:57.532611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f7d7-d7ba-4ece-b84a-99c32dd055c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:57.533446 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f7d7-d7ba-4ece-b84a-99c32dd055c7 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:57.533722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f7d7-d7ba-4ece-b84a-99c32dd055c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:57.533991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7f7d7-d7ba-4ece-b84a-99c32dd055c7 None admin] PATH_INFO: `/v3/users/e9ac13626b1a48979535c1ca2396ecff` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:57.535174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7f7d7-d7ba-4ece-b84a-99c32dd055c7 None admin] RBAC: Authorizing `identity:get_user(user_id=e9ac13626b1a48979535c1ca2396ecff)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:57.536580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7f7d7-d7ba-4ece-b84a-99c32dd055c7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:57.538766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 573/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:34:57 2022] GET /identity/v3/users/e9ac13626b1a48979535c1ca2396ecff => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:57.544197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3f7bf-7129-4937-8e88-18d9cff7fcb5 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:57.637943 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3f7bf-7129-4937-8e88-18d9cff7fcb5 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:57.670652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76cb97-5734-4287-a8b6-9b359ea69f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:57.671498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76cb97-5734-4287-a8b6-9b359ea69f23 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:57.671783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76cb97-5734-4287-a8b6-9b359ea69f23 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:57.672062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76cb97-5734-4287-a8b6-9b359ea69f23 None admin] PATH_INFO: `/v3/projects/8f1f51f045114bab81292fe42a33d622` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:57.673237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76cb97-5734-4287-a8b6-9b359ea69f23 None admin] RBAC: Authorizing `identity:get_project(project_id=8f1f51f045114bab81292fe42a33d622)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:57.674693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76cb97-5734-4287-a8b6-9b359ea69f23 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:57.676367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 579/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:34:57 2022] GET /identity/v3/projects/8f1f51f045114bab81292fe42a33d622 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:34:57.682086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f7d7-d7ba-4ece-b84a-99c32dd055c7 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:34:57.775739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7f7d7-d7ba-4ece-b84a-99c32dd055c7 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:34:57.806591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883167f4-467b-4574-a1ad-99d84e04e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:34:57.807449 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883167f4-467b-4574-a1ad-99d84e04e230 None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:34:57.807727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883167f4-467b-4574-a1ad-99d84e04e230 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:34:57.807998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883167f4-467b-4574-a1ad-99d84e04e230 None admin] PATH_INFO: `/v3/projects/8f1f51f045114bab81292fe42a33d622/users/e9ac13626b1a48979535c1ca2396ecff/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:34:57.809897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883167f4-467b-4574-a1ad-99d84e04e230 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f1f51f045114bab81292fe42a33d622, user_id=e9ac13626b1a48979535c1ca2396ecff, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:34:57.811342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883167f4-467b-4574-a1ad-99d84e04e230 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:34:57.824737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 574/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:34:57 2022] PUT /identity/v3/projects/8f1f51f045114bab81292fe42a33d622/users/e9ac13626b1a48979535c1ca2396ecff/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:35:00.008439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afafc8c-7746-4f4b-a45e-4f202e1f55fa None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:00.008982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afafc8c-7746-4f4b-a45e-4f202e1f55fa None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:00.008982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afafc8c-7746-4f4b-a45e-4f202e1f55fa None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:00.010381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 580/1154] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:35:00.015596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291dc98-9fdd-4d74-a8dc-897bb355917e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:00.015977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291dc98-9fdd-4d74-a8dc-897bb355917e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:00.016147 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291dc98-9fdd-4d74-a8dc-897bb355917e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:00.032283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7291dc98-9fdd-4d74-a8dc-897bb355917e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:35:00.033447 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7291dc98-9fdd-4d74-a8dc-897bb355917e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:35:00.095290 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 575/1155] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:35:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 14 15:35:00.119143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afafc8c-7746-4f4b-a45e-4f202e1f55fa None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:00.214401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afafc8c-7746-4f4b-a45e-4f202e1f55fa None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:00.245504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffb805-aea7-4839-ac75-611f2dda5ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:00.246278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb805-aea7-4839-ac75-611f2dda5ca8 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:00.246594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb805-aea7-4839-ac75-611f2dda5ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:00.246869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb805-aea7-4839-ac75-611f2dda5ca8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:00.258753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffb805-aea7-4839-ac75-611f2dda5ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-feffb805-aea7-4839-ac75-611f2dda5ca8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:35:00.266496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:35:00.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:35:00.268617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 581/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:35:00.275992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291dc98-9fdd-4d74-a8dc-897bb355917e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:00.369022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291dc98-9fdd-4d74-a8dc-897bb355917e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:00.401102 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a64cad-7b3c-4f18-a817-48b03cca0a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:00.401756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64cad-7b3c-4f18-a817-48b03cca0a76 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:00.402039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64cad-7b3c-4f18-a817-48b03cca0a76 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:00.402357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a64cad-7b3c-4f18-a817-48b03cca0a76 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:00.403096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a64cad-7b3c-4f18-a817-48b03cca0a76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:35:00.403399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a64cad-7b3c-4f18-a817-48b03cca0a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:00.404783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a64cad-7b3c-4f18-a817-48b03cca0a76 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:00.412534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 576/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:00.418246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffb805-aea7-4839-ac75-611f2dda5ca8 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:00.513944 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffb805-aea7-4839-ac75-611f2dda5ca8 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:00.547156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90748dfe-63cf-40d4-aab9-92d9b55f1cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:00.548002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90748dfe-63cf-40d4-aab9-92d9b55f1cf5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:00.548284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90748dfe-63cf-40d4-aab9-92d9b55f1cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:00.548561 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90748dfe-63cf-40d4-aab9-92d9b55f1cf5 None admin] PATH_INFO: `/v3/users/e9ac13626b1a48979535c1ca2396ecff` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:00.549735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90748dfe-63cf-40d4-aab9-92d9b55f1cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=e9ac13626b1a48979535c1ca2396ecff)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:00.551195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90748dfe-63cf-40d4-aab9-92d9b55f1cf5 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:00.553312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 582/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:35:00 2022] GET /identity/v3/users/e9ac13626b1a48979535c1ca2396ecff => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:00.558877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a64cad-7b3c-4f18-a817-48b03cca0a76 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:00.652431 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a64cad-7b3c-4f18-a817-48b03cca0a76 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:00.683278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7a0b9-d103-4019-8f18-27ef452df6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:00.683905 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7a0b9-d103-4019-8f18-27ef452df6f3 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:00.684184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7a0b9-d103-4019-8f18-27ef452df6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:00.684457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7a0b9-d103-4019-8f18-27ef452df6f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:00.746026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7a0b9-d103-4019-8f18-27ef452df6f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:00.747466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7a0b9-d103-4019-8f18-27ef452df6f3 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:00.836708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 577/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:35:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:35:00.842468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90748dfe-63cf-40d4-aab9-92d9b55f1cf5 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:00.935567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90748dfe-63cf-40d4-aab9-92d9b55f1cf5 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:00.966478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fefbe-ae18-49b1-b16c-1bfaa1c0f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:00.967313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fefbe-ae18-49b1-b16c-1bfaa1c0f10c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:00.967591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fefbe-ae18-49b1-b16c-1bfaa1c0f10c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:00.967863 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fefbe-ae18-49b1-b16c-1bfaa1c0f10c None admin] PATH_INFO: `/v3/projects/8f1f51f045114bab81292fe42a33d622` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:00.969024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fefbe-ae18-49b1-b16c-1bfaa1c0f10c None admin] RBAC: Authorizing `identity:get_project(project_id=8f1f51f045114bab81292fe42a33d622)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:00.970478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fefbe-ae18-49b1-b16c-1bfaa1c0f10c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:00.972137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 583/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:35:00 2022] GET /identity/v3/projects/8f1f51f045114bab81292fe42a33d622 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:00.979020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7a0b9-d103-4019-8f18-27ef452df6f3 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:01.071168 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7a0b9-d103-4019-8f18-27ef452df6f3 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:01.103290 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d45ce4-3081-418f-ba53-fc482f5a98b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:01.104184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d45ce4-3081-418f-ba53-fc482f5a98b0 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:01.104464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d45ce4-3081-418f-ba53-fc482f5a98b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:01.104737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d45ce4-3081-418f-ba53-fc482f5a98b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:01.105559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d45ce4-3081-418f-ba53-fc482f5a98b0 None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=8f1f51f045114bab81292fe42a33d622, user.id=e9ac13626b1a48979535c1ca2396ecff) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:35:01.105868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d45ce4-3081-418f-ba53-fc482f5a98b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:01.107314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d45ce4-3081-418f-ba53-fc482f5a98b0 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:01.112866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 578/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:35:00 2022] GET /identity/v3/role_assignments?user.id=e9ac13626b1a48979535c1ca2396ecff&scope.project.id=8f1f51f045114bab81292fe42a33d622&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:03.331386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f16d-8e21-40c7-88ef-358e1a8307fe None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:03.331955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f16d-8e21-40c7-88ef-358e1a8307fe None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:03.331955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6f16d-8e21-40c7-88ef-358e1a8307fe None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:03.333331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 584/1162] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:35:03.338660 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435559-7927-4f2f-b240-9fa54d3b2811 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:03.339065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435559-7927-4f2f-b240-9fa54d3b2811 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:03.339217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17435559-7927-4f2f-b240-9fa54d3b2811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:03.357107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-17435559-7927-4f2f-b240-9fa54d3b2811 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:35:03.358270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-17435559-7927-4f2f-b240-9fa54d3b2811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:35:03.420040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 579/1163] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:35:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:35:03.442505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6f16d-8e21-40c7-88ef-358e1a8307fe None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:03.536818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6f16d-8e21-40c7-88ef-358e1a8307fe None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:03.568497 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30243f99-0816-439b-95ff-1862cf8ebe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:03.569119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243f99-0816-439b-95ff-1862cf8ebe66 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:03.569397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243f99-0816-439b-95ff-1862cf8ebe66 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:03.569669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30243f99-0816-439b-95ff-1862cf8ebe66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:03.633085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30243f99-0816-439b-95ff-1862cf8ebe66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:03.634509 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30243f99-0816-439b-95ff-1862cf8ebe66 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:03.724699 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 585/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:35:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:35:03.730915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17435559-7927-4f2f-b240-9fa54d3b2811 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:03.824023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17435559-7927-4f2f-b240-9fa54d3b2811 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:03.856185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f684e6-4762-44d8-9ba3-deccf1a24f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:03.856971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f684e6-4762-44d8-9ba3-deccf1a24f59 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:03.857247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f684e6-4762-44d8-9ba3-deccf1a24f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:03.857515 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f684e6-4762-44d8-9ba3-deccf1a24f59 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:03.863886 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f684e6-4762-44d8-9ba3-deccf1a24f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:03.865924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f684e6-4762-44d8-9ba3-deccf1a24f59 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-f3f684e6-4762-44d8-9ba3-deccf1a24f59 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:35:03.879654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:35:03.881083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:35:03.882021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 580/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Sat May 14 15:35:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:35:03.886788 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30243f99-0816-439b-95ff-1862cf8ebe66 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:03.977690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30243f99-0816-439b-95ff-1862cf8ebe66 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:04.010074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de15f2-24d8-4ddc-9e2e-a01e3b8dafe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:04.010746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de15f2-24d8-4ddc-9e2e-a01e3b8dafe5 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:04.011029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de15f2-24d8-4ddc-9e2e-a01e3b8dafe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:04.011301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de15f2-24d8-4ddc-9e2e-a01e3b8dafe5 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:04.012012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de15f2-24d8-4ddc-9e2e-a01e3b8dafe5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:35:04.012316 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de15f2-24d8-4ddc-9e2e-a01e3b8dafe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:04.013668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de15f2-24d8-4ddc-9e2e-a01e3b8dafe5 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:04.020599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 586/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Sat May 14 15:35:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:06.227426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674045b0-4476-406f-944a-a4521a771e88 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:06.227935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674045b0-4476-406f-944a-a4521a771e88 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:06.227935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674045b0-4476-406f-944a-a4521a771e88 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:06.229526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 581/1167] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:35:06.234981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d49cb-8b9b-400c-892a-88febb91f6d0 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:06.235367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d49cb-8b9b-400c-892a-88febb91f6d0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:06.235541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d49cb-8b9b-400c-892a-88febb91f6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:06.252615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-739d49cb-8b9b-400c-892a-88febb91f6d0 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:35:06.253790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-739d49cb-8b9b-400c-892a-88febb91f6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:35:06.316412 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 587/1168] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:35:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:35:06.340052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674045b0-4476-406f-944a-a4521a771e88 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:06.436553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674045b0-4476-406f-944a-a4521a771e88 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:06.468689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695ed1a-20f8-4173-b21a-0b50fda91856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:06.469328 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ed1a-20f8-4173-b21a-0b50fda91856 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:06.469606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ed1a-20f8-4173-b21a-0b50fda91856 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:06.469877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695ed1a-20f8-4173-b21a-0b50fda91856 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:06.470641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695ed1a-20f8-4173-b21a-0b50fda91856 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:06.471983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695ed1a-20f8-4173-b21a-0b50fda91856 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:06.486567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 582/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Sat May 14 15:35:06 2022] POST /identity/v3/domains => generated 267 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:35:08.718277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f091-d248-4d09-b5b0-817cf9361a68 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:08.718849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f091-d248-4d09-b5b0-817cf9361a68 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:08.718849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a170f091-d248-4d09-b5b0-817cf9361a68 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:08.720213 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 588/1170] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:35:08.725682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d01d74-4ec9-4726-b1bd-16f624aa642a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:08.726130 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d01d74-4ec9-4726-b1bd-16f624aa642a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:08.726234 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d01d74-4ec9-4726-b1bd-16f624aa642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:08.743162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e8d01d74-4ec9-4726-b1bd-16f624aa642a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:35:08.744324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e8d01d74-4ec9-4726-b1bd-16f624aa642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:35:08.806971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 583/1171] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:35:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:35:08.829346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170f091-d248-4d09-b5b0-817cf9361a68 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:08.931302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a170f091-d248-4d09-b5b0-817cf9361a68 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:08.964988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff13d4-ce15-47a5-8c30-c11651779091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:08.965822 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff13d4-ce15-47a5-8c30-c11651779091 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:08.966098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff13d4-ce15-47a5-8c30-c11651779091 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:08.966947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff13d4-ce15-47a5-8c30-c11651779091 None admin] PATH_INFO: `/v3/domains/86b9e404e75c4d3183dceb0b648f03f8` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:08.977633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff13d4-ce15-47a5-8c30-c11651779091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=86b9e404e75c4d3183dceb0b648f03f8)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:08.979289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff13d4-ce15-47a5-8c30-c11651779091 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:08.980895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 589/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Sat May 14 15:35:08 2022] GET /identity/v3/domains/86b9e404e75c4d3183dceb0b648f03f8 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:08.986931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d01d74-4ec9-4726-b1bd-16f624aa642a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:09.086880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d01d74-4ec9-4726-b1bd-16f624aa642a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:09.121089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966883d-a789-4dd1-807c-82633dbee67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:09.121746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966883d-a789-4dd1-807c-82633dbee67d None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:09.122030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966883d-a789-4dd1-807c-82633dbee67d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:09.122327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966883d-a789-4dd1-807c-82633dbee67d None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:09.123291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966883d-a789-4dd1-807c-82633dbee67d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:09.125663 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966883d-a789-4dd1-807c-82633dbee67d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:09.156081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 584/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:35:08 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:35:11.447763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7367a2e-473a-4ac3-8240-4adad26b3353 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:11.448318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7367a2e-473a-4ac3-8240-4adad26b3353 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:11.448318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7367a2e-473a-4ac3-8240-4adad26b3353 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:11.449661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 590/1174] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:35:11.454942 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c401f-bcec-44fd-95c9-d46a54076368 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:11.455377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c401f-bcec-44fd-95c9-d46a54076368 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:11.455483 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c401f-bcec-44fd-95c9-d46a54076368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:11.471865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b67c401f-bcec-44fd-95c9-d46a54076368 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:35:11.473032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b67c401f-bcec-44fd-95c9-d46a54076368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:35:11.537985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 585/1175] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:35:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:35:11.563705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7367a2e-473a-4ac3-8240-4adad26b3353 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:11.657487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7367a2e-473a-4ac3-8240-4adad26b3353 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:11.689284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a69cc5-f38e-473e-ae3a-670234910b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:11.690116 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a69cc5-f38e-473e-ae3a-670234910b03 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:11.690419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a69cc5-f38e-473e-ae3a-670234910b03 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:11.690690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a69cc5-f38e-473e-ae3a-670234910b03 None admin] PATH_INFO: `/v3/domains/86b9e404e75c4d3183dceb0b648f03f8` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:11.691842 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a69cc5-f38e-473e-ae3a-670234910b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=86b9e404e75c4d3183dceb0b648f03f8)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:11.693574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a69cc5-f38e-473e-ae3a-670234910b03 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:11.695176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 591/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Sat May 14 15:35:11 2022] GET /identity/v3/domains/86b9e404e75c4d3183dceb0b648f03f8 => generated 267 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:11.700791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c401f-bcec-44fd-95c9-d46a54076368 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:11.795454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c401f-bcec-44fd-95c9-d46a54076368 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:11.826916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d37de90-d2d6-409c-a7bb-0b8c5c5da8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:11.827568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37de90-d2d6-409c-a7bb-0b8c5c5da8b7 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:11.827844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37de90-d2d6-409c-a7bb-0b8c5c5da8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:11.828114 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d37de90-d2d6-409c-a7bb-0b8c5c5da8b7 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:11.828816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37de90-d2d6-409c-a7bb-0b8c5c5da8b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:11.830280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d37de90-d2d6-409c-a7bb-0b8c5c5da8b7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:11.850209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 586/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:35:11 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:35:14.095894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77574d3f-dad2-4445-95e8-5b9c6b47acd0 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:14.096412 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77574d3f-dad2-4445-95e8-5b9c6b47acd0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:14.096412 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77574d3f-dad2-4445-95e8-5b9c6b47acd0 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:14.097705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 592/1178] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:35:14.103520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b0f6-449a-487d-8c4d-d06d168e2838 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:14.104167 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b0f6-449a-487d-8c4d-d06d168e2838 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:14.104338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b0f6-449a-487d-8c4d-d06d168e2838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:14.120511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-8242b0f6-449a-487d-8c4d-d06d168e2838 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:35:14.121684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8242b0f6-449a-487d-8c4d-d06d168e2838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:35:14.184002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 587/1179] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:35:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:35:14.207604 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77574d3f-dad2-4445-95e8-5b9c6b47acd0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:14.302942 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77574d3f-dad2-4445-95e8-5b9c6b47acd0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:14.333944 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6762f0-a27a-41e3-8496-5d5c7e035346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:14.334818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6762f0-a27a-41e3-8496-5d5c7e035346 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:14.335102 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6762f0-a27a-41e3-8496-5d5c7e035346 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:14.335374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6762f0-a27a-41e3-8496-5d5c7e035346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:14.345435 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6762f0-a27a-41e3-8496-5d5c7e035346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-df6762f0-a27a-41e3-8496-5d5c7e035346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:35:14.353535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:35:14.354948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:35:14.355831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 593/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:35:14.360932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242b0f6-449a-487d-8c4d-d06d168e2838 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:14.452417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242b0f6-449a-487d-8c4d-d06d168e2838 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:14.490523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d3f8e-ee96-463b-83f8-80eaeb9cee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:14.491174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d3f8e-ee96-463b-83f8-80eaeb9cee6d None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:14.491453 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d3f8e-ee96-463b-83f8-80eaeb9cee6d None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:14.491725 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d3f8e-ee96-463b-83f8-80eaeb9cee6d None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:14.492460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d3f8e-ee96-463b-83f8-80eaeb9cee6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:35:14.492762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d3f8e-ee96-463b-83f8-80eaeb9cee6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:14.494104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d3f8e-ee96-463b-83f8-80eaeb9cee6d None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:14.501897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 588/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:14.507679 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6762f0-a27a-41e3-8496-5d5c7e035346 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:14.600114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6762f0-a27a-41e3-8496-5d5c7e035346 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:14.631883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9295d0-6908-4c5c-96d5-3b63ead96d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:14.632664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9295d0-6908-4c5c-96d5-3b63ead96d68 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:14.632949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9295d0-6908-4c5c-96d5-3b63ead96d68 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:14.633220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9295d0-6908-4c5c-96d5-3b63ead96d68 None admin] PATH_INFO: `/v3/users/0747884570fe4221b0bb2bce8b884eac` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:14.645363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9295d0-6908-4c5c-96d5-3b63ead96d68 None admin] RBAC: Authorizing `identity:get_user(user_id=0747884570fe4221b0bb2bce8b884eac)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:14.646979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9295d0-6908-4c5c-96d5-3b63ead96d68 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:14.648579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 594/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:35:14 2022] GET /identity/v3/users/0747884570fe4221b0bb2bce8b884eac => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:14.654504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d3f8e-ee96-463b-83f8-80eaeb9cee6d None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:14.748043 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d3f8e-ee96-463b-83f8-80eaeb9cee6d None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:14.778971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17d78f-07b7-40e8-9514-2b068eb66264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:14.779596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17d78f-07b7-40e8-9514-2b068eb66264 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:14.779874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17d78f-07b7-40e8-9514-2b068eb66264 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:14.780145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17d78f-07b7-40e8-9514-2b068eb66264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:14.843499 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17d78f-07b7-40e8-9514-2b068eb66264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:14.844953 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17d78f-07b7-40e8-9514-2b068eb66264 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:14.937090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 589/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:35:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:35:14.942965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9295d0-6908-4c5c-96d5-3b63ead96d68 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:15.037026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9295d0-6908-4c5c-96d5-3b63ead96d68 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:15.068884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3bf85-45c7-4934-9adc-68352781b140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:15.069709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3bf85-45c7-4934-9adc-68352781b140 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:15.069988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3bf85-45c7-4934-9adc-68352781b140 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:15.070258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3bf85-45c7-4934-9adc-68352781b140 None admin] PATH_INFO: `/v3/projects/d145bc6487d74837aca094e93309cc9c` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:15.071471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3bf85-45c7-4934-9adc-68352781b140 None admin] RBAC: Authorizing `identity:get_project(project_id=d145bc6487d74837aca094e93309cc9c)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:15.072893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3bf85-45c7-4934-9adc-68352781b140 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:15.074588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 595/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:35:14 2022] GET /identity/v3/projects/d145bc6487d74837aca094e93309cc9c => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:15.080542 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17d78f-07b7-40e8-9514-2b068eb66264 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:15.172767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17d78f-07b7-40e8-9514-2b068eb66264 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:15.204405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5e6de-97e2-4b94-84cf-954ed15f38c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:15.204979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5e6de-97e2-4b94-84cf-954ed15f38c6 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:15.205259 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5e6de-97e2-4b94-84cf-954ed15f38c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:15.205531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5e6de-97e2-4b94-84cf-954ed15f38c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:15.206361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5e6de-97e2-4b94-84cf-954ed15f38c6 None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=d145bc6487d74837aca094e93309cc9c, user.id=0747884570fe4221b0bb2bce8b884eac) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:35:15.206665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5e6de-97e2-4b94-84cf-954ed15f38c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:15.208079 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5e6de-97e2-4b94-84cf-954ed15f38c6 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:15.213283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 590/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:35:15 2022] GET /identity/v3/role_assignments?user.id=0747884570fe4221b0bb2bce8b884eac&scope.project.id=d145bc6487d74837aca094e93309cc9c&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:35:17.394871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb6ca-da33-4e9c-ad8f-0071c8a2eb68 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:17.395392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb6ca-da33-4e9c-ad8f-0071c8a2eb68 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:17.395392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb6ca-da33-4e9c-ad8f-0071c8a2eb68 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:17.397370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 596/1186] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:35:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:35:17.402468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca88e5-a11f-435b-a99c-f76510e29142 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:17.402893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca88e5-a11f-435b-a99c-f76510e29142 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:17.403017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca88e5-a11f-435b-a99c-f76510e29142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:17.419295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a4ca88e5-a11f-435b-a99c-f76510e29142 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:35:17.420487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a4ca88e5-a11f-435b-a99c-f76510e29142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:35:17.482137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 591/1187] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:35:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:35:17.504430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eb6ca-da33-4e9c-ad8f-0071c8a2eb68 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:17.598463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eb6ca-da33-4e9c-ad8f-0071c8a2eb68 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:17.629458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1d372-1b02-47bb-a5a4-a9fc4c8ee042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:17.630750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d372-1b02-47bb-a5a4-a9fc4c8ee042 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:17.631032 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d372-1b02-47bb-a5a4-a9fc4c8ee042 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:17.631309 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1d372-1b02-47bb-a5a4-a9fc4c8ee042 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:17.641130 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1d372-1b02-47bb-a5a4-a9fc4c8ee042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-9bb1d372-1b02-47bb-a5a4-a9fc4c8ee042 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:35:17.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:35:17.650228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:35:17.651127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 597/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:35:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:35:17.656179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca88e5-a11f-435b-a99c-f76510e29142 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:17.748707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca88e5-a11f-435b-a99c-f76510e29142 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:17.780507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecde93c-38a6-4f74-9158-61f800afb7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:17.781154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde93c-38a6-4f74-9158-61f800afb7f2 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:17.781436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde93c-38a6-4f74-9158-61f800afb7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:17.781710 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecde93c-38a6-4f74-9158-61f800afb7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:17.782477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecde93c-38a6-4f74-9158-61f800afb7f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:35:17.782780 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecde93c-38a6-4f74-9158-61f800afb7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:17.784122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecde93c-38a6-4f74-9158-61f800afb7f2 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:17.791766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 592/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:35:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:17.797453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1d372-1b02-47bb-a5a4-a9fc4c8ee042 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:17.891180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1d372-1b02-47bb-a5a4-a9fc4c8ee042 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:17.923302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1acd6a-1180-44ab-a9e7-e7a0b5c6012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:17.924098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1acd6a-1180-44ab-a9e7-e7a0b5c6012b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:17.924376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1acd6a-1180-44ab-a9e7-e7a0b5c6012b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:17.924642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1acd6a-1180-44ab-a9e7-e7a0b5c6012b None admin] PATH_INFO: `/v3/users/0747884570fe4221b0bb2bce8b884eac` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:17.925796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1acd6a-1180-44ab-a9e7-e7a0b5c6012b None admin] RBAC: Authorizing `identity:get_user(user_id=0747884570fe4221b0bb2bce8b884eac)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:17.927307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1acd6a-1180-44ab-a9e7-e7a0b5c6012b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:17.928898 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 598/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:35:17 2022] GET /identity/v3/users/0747884570fe4221b0bb2bce8b884eac => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:17.934588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecde93c-38a6-4f74-9158-61f800afb7f2 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:18.026242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecde93c-38a6-4f74-9158-61f800afb7f2 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:18.057393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adc71e-acf2-4584-96b6-4d9619fa71e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:18.058218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc71e-acf2-4584-96b6-4d9619fa71e5 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:18.058524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc71e-acf2-4584-96b6-4d9619fa71e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:18.058796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adc71e-acf2-4584-96b6-4d9619fa71e5 None admin] PATH_INFO: `/v3/projects/d145bc6487d74837aca094e93309cc9c` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:18.059943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adc71e-acf2-4584-96b6-4d9619fa71e5 None admin] RBAC: Authorizing `identity:get_project(project_id=d145bc6487d74837aca094e93309cc9c)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:18.061350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adc71e-acf2-4584-96b6-4d9619fa71e5 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:18.063028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 593/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:35:17 2022] GET /identity/v3/projects/d145bc6487d74837aca094e93309cc9c => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:18.069266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1acd6a-1180-44ab-a9e7-e7a0b5c6012b None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:18.161350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1acd6a-1180-44ab-a9e7-e7a0b5c6012b None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:18.193256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00eec6-1759-446c-8b4a-bde3aa4120e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:18.193937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00eec6-1759-446c-8b4a-bde3aa4120e7 None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:18.194210 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00eec6-1759-446c-8b4a-bde3aa4120e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:18.194508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00eec6-1759-446c-8b4a-bde3aa4120e7 None admin] PATH_INFO: `/v3/projects/d145bc6487d74837aca094e93309cc9c/users/0747884570fe4221b0bb2bce8b884eac/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:18.196421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00eec6-1759-446c-8b4a-bde3aa4120e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d145bc6487d74837aca094e93309cc9c, user_id=0747884570fe4221b0bb2bce8b884eac, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:18.197818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00eec6-1759-446c-8b4a-bde3aa4120e7 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:18.210125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 599/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:35:18 2022] PUT /identity/v3/projects/d145bc6487d74837aca094e93309cc9c/users/0747884570fe4221b0bb2bce8b884eac/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:35:20.377093 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea88b-e16f-4630-8407-a2d78497d511 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:20.377645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea88b-e16f-4630-8407-a2d78497d511 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:20.377645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ea88b-e16f-4630-8407-a2d78497d511 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:20.379020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 594/1193] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:35:20.384606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0e8b1-d887-49cd-827b-96186820e17c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:20.384990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0e8b1-d887-49cd-827b-96186820e17c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:20.385163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0e8b1-d887-49cd-827b-96186820e17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:20.407328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-28b0e8b1-d887-49cd-827b-96186820e17c None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:35:20.408491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-28b0e8b1-d887-49cd-827b-96186820e17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:35:20.470457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 600/1194] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:35:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:35:20.493777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea88b-e16f-4630-8407-a2d78497d511 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:20.588908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ea88b-e16f-4630-8407-a2d78497d511 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:20.620151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9c17a-5037-4710-b34b-025d67285329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:20.620925 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9c17a-5037-4710-b34b-025d67285329 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:20.621206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9c17a-5037-4710-b34b-025d67285329 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:20.621479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9c17a-5037-4710-b34b-025d67285329 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:20.631849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9c17a-5037-4710-b34b-025d67285329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-6ee9c17a-5037-4710-b34b-025d67285329 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:35:20.639274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:35:20.640348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:35:20.641233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 595/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:35:20.646766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0e8b1-d887-49cd-827b-96186820e17c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:20.740147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0e8b1-d887-49cd-827b-96186820e17c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:20.774079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ccb8-724b-423d-a425-18b80aca9413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:20.774760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ccb8-724b-423d-a425-18b80aca9413 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:20.775040 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ccb8-724b-423d-a425-18b80aca9413 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:20.775313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1ccb8-724b-423d-a425-18b80aca9413 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:20.776046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1ccb8-724b-423d-a425-18b80aca9413 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:35:20.776345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1ccb8-724b-423d-a425-18b80aca9413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:20.777694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1ccb8-724b-423d-a425-18b80aca9413 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:20.785314 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 601/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:35:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:20.791944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9c17a-5037-4710-b34b-025d67285329 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:20.886902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9c17a-5037-4710-b34b-025d67285329 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:20.919415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722f7a2-9299-4612-aeaa-326a0dfacfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:20.920271 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722f7a2-9299-4612-aeaa-326a0dfacfc6 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:20.920553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722f7a2-9299-4612-aeaa-326a0dfacfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:20.920825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722f7a2-9299-4612-aeaa-326a0dfacfc6 None admin] PATH_INFO: `/v3/users/0747884570fe4221b0bb2bce8b884eac` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:20.921985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722f7a2-9299-4612-aeaa-326a0dfacfc6 None admin] RBAC: Authorizing `identity:get_user(user_id=0747884570fe4221b0bb2bce8b884eac)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:20.923450 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722f7a2-9299-4612-aeaa-326a0dfacfc6 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:20.925036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 596/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Sat May 14 15:35:20 2022] GET /identity/v3/users/0747884570fe4221b0bb2bce8b884eac => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:20.930817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ccb8-724b-423d-a425-18b80aca9413 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:21.024051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1ccb8-724b-423d-a425-18b80aca9413 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:21.055055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132f292-1f33-4610-b906-6b425ef03d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:21.055688 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132f292-1f33-4610-b906-6b425ef03d34 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:21.055973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132f292-1f33-4610-b906-6b425ef03d34 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:21.056245 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132f292-1f33-4610-b906-6b425ef03d34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:21.119512 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132f292-1f33-4610-b906-6b425ef03d34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:21.120946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132f292-1f33-4610-b906-6b425ef03d34 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:21.212294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 602/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:35:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 15:35:21.218044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722f7a2-9299-4612-aeaa-326a0dfacfc6 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:21.310048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722f7a2-9299-4612-aeaa-326a0dfacfc6 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:21.342172 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a01603-6710-4278-91f5-7fe0ec0111dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:21.343047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01603-6710-4278-91f5-7fe0ec0111dd None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:21.343326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01603-6710-4278-91f5-7fe0ec0111dd None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:21.343595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01603-6710-4278-91f5-7fe0ec0111dd None admin] PATH_INFO: `/v3/projects/d145bc6487d74837aca094e93309cc9c` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:21.344757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a01603-6710-4278-91f5-7fe0ec0111dd None admin] RBAC: Authorizing `identity:get_project(project_id=d145bc6487d74837aca094e93309cc9c)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:21.346160 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a01603-6710-4278-91f5-7fe0ec0111dd None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:21.347840 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 597/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Sat May 14 15:35:21 2022] GET /identity/v3/projects/d145bc6487d74837aca094e93309cc9c => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:35:21.354075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132f292-1f33-4610-b906-6b425ef03d34 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:35:21.447469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132f292-1f33-4610-b906-6b425ef03d34 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:35:21.479061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cbb0f5-6612-472e-9ded-8da54f87a461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:35:21.479639 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb0f5-6612-472e-9ded-8da54f87a461 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:35:21.479920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb0f5-6612-472e-9ded-8da54f87a461 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:35:21.480194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cbb0f5-6612-472e-9ded-8da54f87a461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:35:21.481015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbb0f5-6612-472e-9ded-8da54f87a461 None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=d145bc6487d74837aca094e93309cc9c, user.id=0747884570fe4221b0bb2bce8b884eac) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:35:21.481324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbb0f5-6612-472e-9ded-8da54f87a461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:35:21.482764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cbb0f5-6612-472e-9ded-8da54f87a461 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:35:21.488286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 603/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:35:21 2022] GET /identity/v3/role_assignments?user.id=0747884570fe4221b0bb2bce8b884eac&scope.project.id=d145bc6487d74837aca094e93309cc9c&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:21.928905 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb62b-a1b7-4db5-85e8-c7e19859dcc3 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:21.929535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb62b-a1b7-4db5-85e8-c7e19859dcc3 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:21.929535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb62b-a1b7-4db5-85e8-c7e19859dcc3 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:21.930907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 598/1201] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:36:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:36:21.937538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a2ac4-fd34-434b-9b81-29f870b480c0 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:21.938062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a2ac4-fd34-434b-9b81-29f870b480c0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:21.938062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a2ac4-fd34-434b-9b81-29f870b480c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:21.956757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-af1a2ac4-fd34-434b-9b81-29f870b480c0 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:36:21.958195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-af1a2ac4-fd34-434b-9b81-29f870b480c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:36:22.040090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 604/1202] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:36:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:36:22.070921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceb62b-a1b7-4db5-85e8-c7e19859dcc3 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:22.198023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ceb62b-a1b7-4db5-85e8-c7e19859dcc3 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:22.242374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9f2d1-3944-4d2a-853d-325cd7d75cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:22.243209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f2d1-3944-4d2a-853d-325cd7d75cad None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:22.243501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f2d1-3944-4d2a-853d-325cd7d75cad None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:22.243883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f2d1-3944-4d2a-853d-325cd7d75cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:22.255771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9f2d1-3944-4d2a-853d-325cd7d75cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:22.257228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea9f2d1-3944-4d2a-853d-325cd7d75cad None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-4ea9f2d1-3944-4d2a-853d-325cd7d75cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:22.276341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:22.277904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:22.279763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:22.279763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:22.279763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:22.279763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:22.279763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 599/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:22.291785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a2ac4-fd34-434b-9b81-29f870b480c0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:22.406005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a2ac4-fd34-434b-9b81-29f870b480c0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:22.445259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883a6f7-9156-491b-b3f4-7c58b8d14360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:22.445961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883a6f7-9156-491b-b3f4-7c58b8d14360 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:22.446239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883a6f7-9156-491b-b3f4-7c58b8d14360 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:22.446625 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883a6f7-9156-491b-b3f4-7c58b8d14360 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:22.447324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883a6f7-9156-491b-b3f4-7c58b8d14360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:22.447627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883a6f7-9156-491b-b3f4-7c58b8d14360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:22.449084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883a6f7-9156-491b-b3f4-7c58b8d14360 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:22.462762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 605/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:22.468880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9f2d1-3944-4d2a-853d-325cd7d75cad None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:22.585856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9f2d1-3944-4d2a-853d-325cd7d75cad None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:22.624507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f052d5-181e-48a8-a1c8-5f9b8478cef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:22.625180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f052d5-181e-48a8-a1c8-5f9b8478cef4 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:22.625485 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f052d5-181e-48a8-a1c8-5f9b8478cef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:22.625762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f052d5-181e-48a8-a1c8-5f9b8478cef4 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:22.626538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f052d5-181e-48a8-a1c8-5f9b8478cef4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:22.627956 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f052d5-181e-48a8-a1c8-5f9b8478cef4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:22.658541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 600/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Sat May 14 15:36:22 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:36:25.005732 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb4d23-ca26-4df4-8ede-6eeff9394ea0 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:25.006339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb4d23-ca26-4df4-8ede-6eeff9394ea0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:25.006339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb4d23-ca26-4df4-8ede-6eeff9394ea0 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:25.007779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 606/1206] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:36:25.013229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7f838-ca38-43ef-9e40-ffd85c184e9e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:25.014010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7f838-ca38-43ef-9e40-ffd85c184e9e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:25.014010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7f838-ca38-43ef-9e40-ffd85c184e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:25.031417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-2fa7f838-ca38-43ef-9e40-ffd85c184e9e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:36:25.032588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2fa7f838-ca38-43ef-9e40-ffd85c184e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:36:25.106088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 601/1207] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:36:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:36:25.130001 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb4d23-ca26-4df4-8ede-6eeff9394ea0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:25.239643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb4d23-ca26-4df4-8ede-6eeff9394ea0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:25.275669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e1842-2eab-459a-94ae-b84acb58bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:25.276487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e1842-2eab-459a-94ae-b84acb58bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:25.276745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e1842-2eab-459a-94ae-b84acb58bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:25.277041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e1842-2eab-459a-94ae-b84acb58bcb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:25.288217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e1842-2eab-459a-94ae-b84acb58bcb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-876e1842-2eab-459a-94ae-b84acb58bcb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:36:25.296463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:25.298666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:25.299624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 607/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:36:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:25.304991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7f838-ca38-43ef-9e40-ffd85c184e9e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:25.415383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7f838-ca38-43ef-9e40-ffd85c184e9e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:25.456738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71e5dc-e28c-4f2b-a32c-d609e5d74562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:25.457423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71e5dc-e28c-4f2b-a32c-d609e5d74562 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:25.457744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71e5dc-e28c-4f2b-a32c-d609e5d74562 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:25.458019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71e5dc-e28c-4f2b-a32c-d609e5d74562 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:25.458829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71e5dc-e28c-4f2b-a32c-d609e5d74562 None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:25.459196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71e5dc-e28c-4f2b-a32c-d609e5d74562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:25.460479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71e5dc-e28c-4f2b-a32c-d609e5d74562 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:25.473258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 602/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:36:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:36:25.479092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e1842-2eab-459a-94ae-b84acb58bcb3 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:25.583569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e1842-2eab-459a-94ae-b84acb58bcb3 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:25.620047 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac9a52-240a-48d0-88c3-b042a9a7c422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:25.621021 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9a52-240a-48d0-88c3-b042a9a7c422 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:25.621322 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9a52-240a-48d0-88c3-b042a9a7c422 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:25.621629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac9a52-240a-48d0-88c3-b042a9a7c422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:25.634039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac9a52-240a-48d0-88c3-b042a9a7c422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:25.635697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac9a52-240a-48d0-88c3-b042a9a7c422 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-f3ac9a52-240a-48d0-88c3-b042a9a7c422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:25.656324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:25.657480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:25.663749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:25.663749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:25.663749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:25.663749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:25.663749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 608/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:36:25.664108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71e5dc-e28c-4f2b-a32c-d609e5d74562 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:25.791575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71e5dc-e28c-4f2b-a32c-d609e5d74562 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:25.833455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd19a3-bbc3-4ef5-b800-1ae4e7694827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:25.834277 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd19a3-bbc3-4ef5-b800-1ae4e7694827 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:25.834680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd19a3-bbc3-4ef5-b800-1ae4e7694827 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:25.835061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd19a3-bbc3-4ef5-b800-1ae4e7694827 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:25.835995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd19a3-bbc3-4ef5-b800-1ae4e7694827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:25.836397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd19a3-bbc3-4ef5-b800-1ae4e7694827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:25.837846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd19a3-bbc3-4ef5-b800-1ae4e7694827 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:25.856762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 603/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:25.858539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac9a52-240a-48d0-88c3-b042a9a7c422 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:25.970904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac9a52-240a-48d0-88c3-b042a9a7c422 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:26.009014 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296c424-cfc8-4f1f-850c-df77bae4d21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:26.010879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296c424-cfc8-4f1f-850c-df77bae4d21e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:26.010879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296c424-cfc8-4f1f-850c-df77bae4d21e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:26.010879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296c424-cfc8-4f1f-850c-df77bae4d21e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:26.019819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296c424-cfc8-4f1f-850c-df77bae4d21e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:26.022375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296c424-cfc8-4f1f-850c-df77bae4d21e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-6296c424-cfc8-4f1f-850c-df77bae4d21e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:36:26.040483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:26.041786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:26.042811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:26.042811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:26.042811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:36:26.042811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:36:26.042811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:36:26.042811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:36:26.042811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:36:26.042811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:36:26.042811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:26.042811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:26.042811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 609/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:36:26.047477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd19a3-bbc3-4ef5-b800-1ae4e7694827 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:26.171175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd19a3-bbc3-4ef5-b800-1ae4e7694827 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:26.207007 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36428009-236a-45f1-8b9a-b822784d3d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:26.208266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428009-236a-45f1-8b9a-b822784d3d64 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:26.208548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428009-236a-45f1-8b9a-b822784d3d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:26.208853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428009-236a-45f1-8b9a-b822784d3d64 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:26.209701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36428009-236a-45f1-8b9a-b822784d3d64 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:26.209986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36428009-236a-45f1-8b9a-b822784d3d64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:26.211585 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36428009-236a-45f1-8b9a-b822784d3d64 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:26.234280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 604/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Sat May 14 15:36:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:36:26.241545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296c424-cfc8-4f1f-850c-df77bae4d21e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:26.365121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296c424-cfc8-4f1f-850c-df77bae4d21e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:26.403994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fe084-f471-4563-b51d-6357e543acbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:26.404922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fe084-f471-4563-b51d-6357e543acbe None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:26.405157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fe084-f471-4563-b51d-6357e543acbe None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:26.405431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fe084-f471-4563-b51d-6357e543acbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:26.487650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fe084-f471-4563-b51d-6357e543acbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:26.489962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fe084-f471-4563-b51d-6357e543acbe None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:26.607119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 610/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:36:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 15:36:26.613081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36428009-236a-45f1-8b9a-b822784d3d64 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:26.727714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36428009-236a-45f1-8b9a-b822784d3d64 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:26.768735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2468835-c817-48d7-8599-a50394a11dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:26.769838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2468835-c817-48d7-8599-a50394a11dfd None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:26.770646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2468835-c817-48d7-8599-a50394a11dfd None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:26.770646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2468835-c817-48d7-8599-a50394a11dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:26.782869 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2468835-c817-48d7-8599-a50394a11dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:26.784568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2468835-c817-48d7-8599-a50394a11dfd None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-b2468835-c817-48d7-8599-a50394a11dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:26.802899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:26.804024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:26.805082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:26.805082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:26.805082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:26.805082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:26.805082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 605/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:26.810076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fe084-f471-4563-b51d-6357e543acbe None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:26.921013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fe084-f471-4563-b51d-6357e543acbe None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:26.956167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0620a2-2a56-4803-af57-95c3e5405bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:26.957130 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0620a2-2a56-4803-af57-95c3e5405bde None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:26.957635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0620a2-2a56-4803-af57-95c3e5405bde None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:26.958077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0620a2-2a56-4803-af57-95c3e5405bde None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:26.958980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0620a2-2a56-4803-af57-95c3e5405bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:26.959445 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0620a2-2a56-4803-af57-95c3e5405bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:26.960959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0620a2-2a56-4803-af57-95c3e5405bde None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:26.972803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 611/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:26.978641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2468835-c817-48d7-8599-a50394a11dfd None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:27.088865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2468835-c817-48d7-8599-a50394a11dfd None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:27.123977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cdc43-f724-47f6-8587-f3689897f3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:27.125032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cdc43-f724-47f6-8587-f3689897f3f4 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:27.125287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cdc43-f724-47f6-8587-f3689897f3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:27.125500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cdc43-f724-47f6-8587-f3689897f3f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:27.133884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cdc43-f724-47f6-8587-f3689897f3f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:27.135368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cdc43-f724-47f6-8587-f3689897f3f4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-7e3cdc43-f724-47f6-8587-f3689897f3f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:36:27.149798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:27.151042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:27.156775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:36:27.156775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:36:27.156775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:36:27.156775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:36:27.156775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:36:27.156775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:36:27.156775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:27.156775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:27.156775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 606/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:36:27.157294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0620a2-2a56-4803-af57-95c3e5405bde None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:27.259395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0620a2-2a56-4803-af57-95c3e5405bde None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:27.298884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bee23-7b9c-410d-a7d5-a7ff4427a10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:27.299782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bee23-7b9c-410d-a7d5-a7ff4427a10f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:27.300236 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bee23-7b9c-410d-a7d5-a7ff4427a10f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:27.300689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bee23-7b9c-410d-a7d5-a7ff4427a10f None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:27.302171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bee23-7b9c-410d-a7d5-a7ff4427a10f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:27.302617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bee23-7b9c-410d-a7d5-a7ff4427a10f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:27.304394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9bee23-7b9c-410d-a7d5-a7ff4427a10f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:27.319331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 612/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:36:27.325257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cdc43-f724-47f6-8587-f3689897f3f4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:27.437263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cdc43-f724-47f6-8587-f3689897f3f4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:27.475433 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad55ac-1cef-4fa8-8ccc-bed5c860e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:27.476703 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad55ac-1cef-4fa8-8ccc-bed5c860e391 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:27.477197 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad55ac-1cef-4fa8-8ccc-bed5c860e391 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:27.477732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad55ac-1cef-4fa8-8ccc-bed5c860e391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:27.478804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad55ac-1cef-4fa8-8ccc-bed5c860e391 None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=8fac310b740a40718191e905723222ba) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:27.479162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad55ac-1cef-4fa8-8ccc-bed5c860e391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:27.481152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad55ac-1cef-4fa8-8ccc-bed5c860e391 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:27.487388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 607/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:36:27 2022] GET /identity/v3/role_assignments?user.id=8fac310b740a40718191e905723222ba&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:29.889656 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08c69a-2541-48d3-aac3-8ac3585fdb57 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:29.890169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08c69a-2541-48d3-aac3-8ac3585fdb57 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:29.890247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08c69a-2541-48d3-aac3-8ac3585fdb57 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:29.891772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 613/1220] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:36:29.897642 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456fe77-c407-43f0-b301-9a8a29a8468a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:29.898117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456fe77-c407-43f0-b301-9a8a29a8468a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:29.898204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456fe77-c407-43f0-b301-9a8a29a8468a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:29.915504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-d456fe77-c407-43f0-b301-9a8a29a8468a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:36:29.916681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d456fe77-c407-43f0-b301-9a8a29a8468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:36:29.994357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 608/1221] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:36:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:36:30.016417 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08c69a-2541-48d3-aac3-8ac3585fdb57 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:30.135378 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08c69a-2541-48d3-aac3-8ac3585fdb57 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:30.172562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140251fe-0549-43d9-bea6-ab68a7425d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:30.173353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140251fe-0549-43d9-bea6-ab68a7425d14 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:30.173632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140251fe-0549-43d9-bea6-ab68a7425d14 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:30.173900 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140251fe-0549-43d9-bea6-ab68a7425d14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:30.184997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140251fe-0549-43d9-bea6-ab68a7425d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-140251fe-0549-43d9-bea6-ab68a7425d14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:36:30.192702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:30.193730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:30.195259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 614/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:36:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:30.199873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456fe77-c407-43f0-b301-9a8a29a8468a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:30.318122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456fe77-c407-43f0-b301-9a8a29a8468a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:30.354855 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039631c8-4c99-4a17-a4c0-f3459d15cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:30.355595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039631c8-4c99-4a17-a4c0-f3459d15cc68 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:30.355879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039631c8-4c99-4a17-a4c0-f3459d15cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:30.356154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039631c8-4c99-4a17-a4c0-f3459d15cc68 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:30.356997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039631c8-4c99-4a17-a4c0-f3459d15cc68 None admin] RBAC: Adding query filter params (name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:30.357377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039631c8-4c99-4a17-a4c0-f3459d15cc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:30.358931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039631c8-4c99-4a17-a4c0-f3459d15cc68 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:30.367824 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 609/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:36:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:30.373628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140251fe-0549-43d9-bea6-ab68a7425d14 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:30.483371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140251fe-0549-43d9-bea6-ab68a7425d14 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:30.522380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed88de7-0877-4c71-a921-0a10cda4c396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:30.523171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed88de7-0877-4c71-a921-0a10cda4c396 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:30.523454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed88de7-0877-4c71-a921-0a10cda4c396 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:30.523734 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed88de7-0877-4c71-a921-0a10cda4c396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:30.534331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed88de7-0877-4c71-a921-0a10cda4c396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:30.536467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed88de7-0877-4c71-a921-0a10cda4c396 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-fed88de7-0877-4c71-a921-0a10cda4c396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:30.557533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:30.558641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:30.559728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:30.559728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:30.559728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:30.559728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:30.559728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 615/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:30.566251 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039631c8-4c99-4a17-a4c0-f3459d15cc68 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:30.671816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039631c8-4c99-4a17-a4c0-f3459d15cc68 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:30.706880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193fb38-6420-4403-b526-a4f06d380ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:30.708143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193fb38-6420-4403-b526-a4f06d380ce4 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:30.708415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193fb38-6420-4403-b526-a4f06d380ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:30.708681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193fb38-6420-4403-b526-a4f06d380ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:30.709397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193fb38-6420-4403-b526-a4f06d380ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:30.709749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193fb38-6420-4403-b526-a4f06d380ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:30.711092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193fb38-6420-4403-b526-a4f06d380ce4 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:30.723879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 610/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:30.729840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed88de7-0877-4c71-a921-0a10cda4c396 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:30.835350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed88de7-0877-4c71-a921-0a10cda4c396 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:30.867916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7fadc-9295-44ca-8820-aad6e36bdead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:30.868683 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7fadc-9295-44ca-8820-aad6e36bdead None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:30.868966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7fadc-9295-44ca-8820-aad6e36bdead None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:30.869238 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7fadc-9295-44ca-8820-aad6e36bdead None admin] PATH_INFO: `/v3/users/placement` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:30.876977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7fadc-9295-44ca-8820-aad6e36bdead None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:30.878465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7fadc-9295-44ca-8820-aad6e36bdead None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-03d7fadc-9295-44ca-8820-aad6e36bdead None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:36:30.893912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:30.896294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:30.897288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:30.897288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:30.897288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:36:30.897288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:36:30.897288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:36:30.897288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:36:30.897288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:36:30.897288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:36:30.897288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:30.897288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:30.897288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 616/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:30.901056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193fb38-6420-4403-b526-a4f06d380ce4 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:31.003757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193fb38-6420-4403-b526-a4f06d380ce4 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:31.041542 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c63149-c0b9-45eb-be41-efa69d6d2ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:31.042605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c63149-c0b9-45eb-be41-efa69d6d2ba1 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:31.042960 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c63149-c0b9-45eb-be41-efa69d6d2ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:31.043179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c63149-c0b9-45eb-be41-efa69d6d2ba1 None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:31.044034 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c63149-c0b9-45eb-be41-efa69d6d2ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:31.044342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c63149-c0b9-45eb-be41-efa69d6d2ba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:31.045837 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c63149-c0b9-45eb-be41-efa69d6d2ba1 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:31.064534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 611/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Sat May 14 15:36:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:31.070861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7fadc-9295-44ca-8820-aad6e36bdead None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:31.183981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7fadc-9295-44ca-8820-aad6e36bdead None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:31.219186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1617c-2754-496f-bd0b-8b02b249c990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:31.220023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1617c-2754-496f-bd0b-8b02b249c990 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:31.220254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1617c-2754-496f-bd0b-8b02b249c990 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:31.220605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1617c-2754-496f-bd0b-8b02b249c990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:31.231990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1617c-2754-496f-bd0b-8b02b249c990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:31.233438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1617c-2754-496f-bd0b-8b02b249c990 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-e1e1617c-2754-496f-bd0b-8b02b249c990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:31.249985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:31.251173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:31.252101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:31.252101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:31.252101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:31.252101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:31.252101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 617/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:36:31.257344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c63149-c0b9-45eb-be41-efa69d6d2ba1 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:31.364652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c63149-c0b9-45eb-be41-efa69d6d2ba1 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:31.400576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675071ee-3ddb-4cb8-bfd1-ed0c2698b916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:31.401356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675071ee-3ddb-4cb8-bfd1-ed0c2698b916 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:31.401636 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675071ee-3ddb-4cb8-bfd1-ed0c2698b916 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:31.401979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675071ee-3ddb-4cb8-bfd1-ed0c2698b916 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:31.402790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675071ee-3ddb-4cb8-bfd1-ed0c2698b916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:31.403179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675071ee-3ddb-4cb8-bfd1-ed0c2698b916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:31.404859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675071ee-3ddb-4cb8-bfd1-ed0c2698b916 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:31.418261 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 612/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:31.424324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1617c-2754-496f-bd0b-8b02b249c990 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:31.531531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1617c-2754-496f-bd0b-8b02b249c990 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:31.567914 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cc4ed-2717-4d11-8c59-095c372cf36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:31.568872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cc4ed-2717-4d11-8c59-095c372cf36d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:31.569262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cc4ed-2717-4d11-8c59-095c372cf36d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:31.569654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cc4ed-2717-4d11-8c59-095c372cf36d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:31.577592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cc4ed-2717-4d11-8c59-095c372cf36d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:31.579199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cc4ed-2717-4d11-8c59-095c372cf36d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-1a1cc4ed-2717-4d11-8c59-095c372cf36d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:36:31.594953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:31.596068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:31.597480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:36:31.597480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:36:31.597480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:36:31.597480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:36:31.597480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:36:31.597480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:36:31.597480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:31.597480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:31.597480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 618/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:31.602146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675071ee-3ddb-4cb8-bfd1-ed0c2698b916 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:31.702152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675071ee-3ddb-4cb8-bfd1-ed0c2698b916 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:31.738387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f29bd-4bdd-4610-996d-be9006633b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:31.739182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f29bd-4bdd-4610-996d-be9006633b75 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:31.739536 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f29bd-4bdd-4610-996d-be9006633b75 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:31.739845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f29bd-4bdd-4610-996d-be9006633b75 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:31.740799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f29bd-4bdd-4610-996d-be9006633b75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:31.741141 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f29bd-4bdd-4610-996d-be9006633b75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:31.742757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f29bd-4bdd-4610-996d-be9006633b75 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:31.755852 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 613/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:36:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:31.761687 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cc4ed-2717-4d11-8c59-095c372cf36d None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:31.870120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cc4ed-2717-4d11-8c59-095c372cf36d None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:31.904789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673774e8-d349-4577-80d3-9ad9f2e42a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:31.905805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673774e8-d349-4577-80d3-9ad9f2e42a7f None admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:31.906143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673774e8-d349-4577-80d3-9ad9f2e42a7f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:31.906563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673774e8-d349-4577-80d3-9ad9f2e42a7f None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/8fac310b740a40718191e905723222ba/roles/28455344d2b44d699796e0163a62e252` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:31.921807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673774e8-d349-4577-80d3-9ad9f2e42a7f None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=8fac310b740a40718191e905723222ba, role_id=28455344d2b44d699796e0163a62e252)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:31.923719 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673774e8-d349-4577-80d3-9ad9f2e42a7f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:31.937021 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 619/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:36:31 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/8fac310b740a40718191e905723222ba/roles/28455344d2b44d699796e0163a62e252 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:36:34.201357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6d6e9-89b4-496e-89df-f2a3f817b538 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:34.201882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6d6e9-89b4-496e-89df-f2a3f817b538 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:34.201882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6d6e9-89b4-496e-89df-f2a3f817b538 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:34.203228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 614/1233] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:36:34.209221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570d75-14d3-46de-b02f-5b9539f18de4 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:34.209641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570d75-14d3-46de-b02f-5b9539f18de4 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:34.209753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6570d75-14d3-46de-b02f-5b9539f18de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:34.226206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-a6570d75-14d3-46de-b02f-5b9539f18de4 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:36:34.227437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a6570d75-14d3-46de-b02f-5b9539f18de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:36:34.293926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 620/1234] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:36:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:36:34.319755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6d6e9-89b4-496e-89df-f2a3f817b538 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:34.433280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6d6e9-89b4-496e-89df-f2a3f817b538 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:34.468060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a827b1d-42da-4831-a112-0cabd54a9c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:34.468832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a827b1d-42da-4831-a112-0cabd54a9c87 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:34.469083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a827b1d-42da-4831-a112-0cabd54a9c87 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:34.469355 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a827b1d-42da-4831-a112-0cabd54a9c87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:34.480055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a827b1d-42da-4831-a112-0cabd54a9c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-0a827b1d-42da-4831-a112-0cabd54a9c87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:36:34.488195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:34.490415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:34.491288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 615/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Sat May 14 15:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:34.498337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6570d75-14d3-46de-b02f-5b9539f18de4 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:34.608852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6570d75-14d3-46de-b02f-5b9539f18de4 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:34.646129 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c3b13-9f3d-4ac6-ba8b-9054b1dc287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:34.646890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c3b13-9f3d-4ac6-ba8b-9054b1dc287f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:34.647183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c3b13-9f3d-4ac6-ba8b-9054b1dc287f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:34.647516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c3b13-9f3d-4ac6-ba8b-9054b1dc287f None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:34.648516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c3b13-9f3d-4ac6-ba8b-9054b1dc287f None admin] RBAC: Adding query filter params (name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:34.648845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c3b13-9f3d-4ac6-ba8b-9054b1dc287f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:34.650298 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c3b13-9f3d-4ac6-ba8b-9054b1dc287f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:34.659269 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 621/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Sat May 14 15:36:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:34.665417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a827b1d-42da-4831-a112-0cabd54a9c87 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:34.772113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a827b1d-42da-4831-a112-0cabd54a9c87 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:34.807753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b671874-3d68-43d6-a60d-aa6caa829340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:34.808543 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b671874-3d68-43d6-a60d-aa6caa829340 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:34.808822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b671874-3d68-43d6-a60d-aa6caa829340 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:34.809092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b671874-3d68-43d6-a60d-aa6caa829340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:34.821303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b671874-3d68-43d6-a60d-aa6caa829340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:34.822875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b671874-3d68-43d6-a60d-aa6caa829340 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-0b671874-3d68-43d6-a60d-aa6caa829340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:34.840967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:34.842237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:34.843401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:34.843401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:34.843401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:34.843401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:34.843401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 616/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:34.848591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c3b13-9f3d-4ac6-ba8b-9054b1dc287f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:34.955444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c3b13-9f3d-4ac6-ba8b-9054b1dc287f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:34.993369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e7a1d-9870-4af0-838d-7785e669758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:34.994033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e7a1d-9870-4af0-838d-7785e669758a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:34.994329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e7a1d-9870-4af0-838d-7785e669758a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:34.994624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e7a1d-9870-4af0-838d-7785e669758a None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:34.995349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e7a1d-9870-4af0-838d-7785e669758a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:34.995651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e7a1d-9870-4af0-838d-7785e669758a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:34.997015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e7a1d-9870-4af0-838d-7785e669758a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:35.013567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 622/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:36:35.014926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b671874-3d68-43d6-a60d-aa6caa829340 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:35.115835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b671874-3d68-43d6-a60d-aa6caa829340 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:35.153580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ffb27-91bd-4ef0-b623-fac534dfd501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:35.154486 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ffb27-91bd-4ef0-b623-fac534dfd501 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:35.154800 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ffb27-91bd-4ef0-b623-fac534dfd501 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:35.155134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ffb27-91bd-4ef0-b623-fac534dfd501 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:35.165479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ffb27-91bd-4ef0-b623-fac534dfd501 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:35.167095 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ffb27-91bd-4ef0-b623-fac534dfd501 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-407ffb27-91bd-4ef0-b623-fac534dfd501 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:36:35.182509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:35.183696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:35.185009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:35.185009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:35.185009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:36:35.185009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:36:35.185009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:36:35.185009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:36:35.185009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:36:35.185009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:36:35.185009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:35.185009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:35.185009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 617/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:35.189715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e7a1d-9870-4af0-838d-7785e669758a None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:35.299605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e7a1d-9870-4af0-838d-7785e669758a None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:35.336241 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bc7ac-1c62-4a44-bd97-9b8d48e023e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:35.336998 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc7ac-1c62-4a44-bd97-9b8d48e023e7 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:35.337318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc7ac-1c62-4a44-bd97-9b8d48e023e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:35.337584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc7ac-1c62-4a44-bd97-9b8d48e023e7 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:35.338554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bc7ac-1c62-4a44-bd97-9b8d48e023e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:35.338880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bc7ac-1c62-4a44-bd97-9b8d48e023e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:35.340498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bc7ac-1c62-4a44-bd97-9b8d48e023e7 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:35.362880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 623/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Sat May 14 15:36:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:35.364187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ffb27-91bd-4ef0-b623-fac534dfd501 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:35.467315 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ffb27-91bd-4ef0-b623-fac534dfd501 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:35.500810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b82f4-0a38-426e-8e90-4763acc5db0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:35.501466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b82f4-0a38-426e-8e90-4763acc5db0f None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:35.501748 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b82f4-0a38-426e-8e90-4763acc5db0f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:35.502021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b82f4-0a38-426e-8e90-4763acc5db0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:35.569592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b82f4-0a38-426e-8e90-4763acc5db0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:35.571076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3b82f4-0a38-426e-8e90-4763acc5db0f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:35.671255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 618/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:36:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:36:35.678085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bc7ac-1c62-4a44-bd97-9b8d48e023e7 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:35.779618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bc7ac-1c62-4a44-bd97-9b8d48e023e7 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:35.816367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be45a-3cd1-46df-9d1c-2b8eb8ee27fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:35.817607 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be45a-3cd1-46df-9d1c-2b8eb8ee27fb None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:35.817911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be45a-3cd1-46df-9d1c-2b8eb8ee27fb None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:35.818193 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be45a-3cd1-46df-9d1c-2b8eb8ee27fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:35.828713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5be45a-3cd1-46df-9d1c-2b8eb8ee27fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:35.832069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5be45a-3cd1-46df-9d1c-2b8eb8ee27fb None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-8a5be45a-3cd1-46df-9d1c-2b8eb8ee27fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:35.850736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:35.851794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:35.852703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:35.852703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:35.852703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:35.852703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:35.852703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 624/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:35.858749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b82f4-0a38-426e-8e90-4763acc5db0f None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:35.967158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b82f4-0a38-426e-8e90-4763acc5db0f None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:36.002790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10be74-32c4-49eb-bbf7-22ac8365b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:36.003448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10be74-32c4-49eb-bbf7-22ac8365b9ad None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:36.003726 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10be74-32c4-49eb-bbf7-22ac8365b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:36.003995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10be74-32c4-49eb-bbf7-22ac8365b9ad None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:36.005284 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10be74-32c4-49eb-bbf7-22ac8365b9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:36.005583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10be74-32c4-49eb-bbf7-22ac8365b9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:36.007225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10be74-32c4-49eb-bbf7-22ac8365b9ad None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:36.020292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 619/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:36.026248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be45a-3cd1-46df-9d1c-2b8eb8ee27fb None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:36.133151 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be45a-3cd1-46df-9d1c-2b8eb8ee27fb None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:36.170330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35404a92-0deb-4473-befb-9cb94c7d5003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:36.171275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404a92-0deb-4473-befb-9cb94c7d5003 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:36.171525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404a92-0deb-4473-befb-9cb94c7d5003 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:36.171797 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404a92-0deb-4473-befb-9cb94c7d5003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:36.178980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35404a92-0deb-4473-befb-9cb94c7d5003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:36.180630 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35404a92-0deb-4473-befb-9cb94c7d5003 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-35404a92-0deb-4473-befb-9cb94c7d5003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:36:36.196601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:36.197755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:36.202749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:36:36.202749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:36:36.202749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:36:36.202749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:36:36.202749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:36:36.202749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:36:36.202749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:36.202749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:36.202749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 625/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:36:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:36.203548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10be74-32c4-49eb-bbf7-22ac8365b9ad None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:36.313114 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10be74-32c4-49eb-bbf7-22ac8365b9ad None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:36.350096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b2527d-3aee-485a-95e4-0a12022b2d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:36.350922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2527d-3aee-485a-95e4-0a12022b2d42 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:36.351397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2527d-3aee-485a-95e4-0a12022b2d42 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:36.351690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b2527d-3aee-485a-95e4-0a12022b2d42 None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:36.352600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2527d-3aee-485a-95e4-0a12022b2d42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:36.352908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2527d-3aee-485a-95e4-0a12022b2d42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:36.354802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b2527d-3aee-485a-95e4-0a12022b2d42 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:36.367799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 620/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:36:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:36:36.373784 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35404a92-0deb-4473-befb-9cb94c7d5003 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:36.479879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35404a92-0deb-4473-befb-9cb94c7d5003 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:36.515011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5268cd-37e5-4884-a32b-6f78506d7a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:36.515792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5268cd-37e5-4884-a32b-6f78506d7a9a None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:36.516131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5268cd-37e5-4884-a32b-6f78506d7a9a None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:36.516433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5268cd-37e5-4884-a32b-6f78506d7a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:36.517315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5268cd-37e5-4884-a32b-6f78506d7a9a None admin] RBAC: Adding query filter params (role.id=28455344d2b44d699796e0163a62e252, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=8fac310b740a40718191e905723222ba) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:36.517622 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5268cd-37e5-4884-a32b-6f78506d7a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:36.519118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5268cd-37e5-4884-a32b-6f78506d7a9a None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:36.534989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 626/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:36:36 2022] GET /identity/v3/role_assignments?user.id=8fac310b740a40718191e905723222ba&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=28455344d2b44d699796e0163a62e252 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:38.990421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb9181-1bca-4c2a-8785-8596108f16de None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:38.991058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb9181-1bca-4c2a-8785-8596108f16de None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:38.991058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb9181-1bca-4c2a-8785-8596108f16de None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:38.992501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 621/1247] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:36:38.997875 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae232ace-cf39-495f-8e52-391e0e60fdb7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:38.998342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae232ace-cf39-495f-8e52-391e0e60fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:38.998450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae232ace-cf39-495f-8e52-391e0e60fdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:39.015984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-ae232ace-cf39-495f-8e52-391e0e60fdb7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:36:39.017171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ae232ace-cf39-495f-8e52-391e0e60fdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:36:39.095191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 627/1248] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:36:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:36:39.119491 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb9181-1bca-4c2a-8785-8596108f16de None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:39.238435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb9181-1bca-4c2a-8785-8596108f16de None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:39.275694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdf614-6f35-4cd1-838f-decc61609dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:39.276529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdf614-6f35-4cd1-838f-decc61609dda None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:39.276812 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdf614-6f35-4cd1-838f-decc61609dda None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:39.277088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfdf614-6f35-4cd1-838f-decc61609dda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:39.287550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfdf614-6f35-4cd1-838f-decc61609dda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-4dfdf614-6f35-4cd1-838f-decc61609dda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:36:39.295508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:39.296937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:39.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 622/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:36:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:39.302983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae232ace-cf39-495f-8e52-391e0e60fdb7 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:39.411223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae232ace-cf39-495f-8e52-391e0e60fdb7 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:39.445745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0278b-134a-4855-9294-65ea47069437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:39.446448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0278b-134a-4855-9294-65ea47069437 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:39.446733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0278b-134a-4855-9294-65ea47069437 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:39.447012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0278b-134a-4855-9294-65ea47069437 None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:39.447761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0278b-134a-4855-9294-65ea47069437 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:39.448068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0278b-134a-4855-9294-65ea47069437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:39.449433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0278b-134a-4855-9294-65ea47069437 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:39.457268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 628/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:36:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:39.463129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdf614-6f35-4cd1-838f-decc61609dda None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:39.568468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfdf614-6f35-4cd1-838f-decc61609dda None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:39.607421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793d9dc-5199-49b0-bcc5-526be966b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:39.608247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793d9dc-5199-49b0-bcc5-526be966b18c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:39.608531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793d9dc-5199-49b0-bcc5-526be966b18c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:39.608822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793d9dc-5199-49b0-bcc5-526be966b18c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:39.619844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793d9dc-5199-49b0-bcc5-526be966b18c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:39.621285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793d9dc-5199-49b0-bcc5-526be966b18c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-a793d9dc-5199-49b0-bcc5-526be966b18c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:39.639445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:39.640439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:39.641867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:39.641867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:39.641867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:39.641867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:39.641867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 623/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:39.647322 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0278b-134a-4855-9294-65ea47069437 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:39.757835 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0278b-134a-4855-9294-65ea47069437 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:39.794059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94fa2a-ade2-4ad2-9ab2-b430dd6b5eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:39.794764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94fa2a-ade2-4ad2-9ab2-b430dd6b5eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:39.795051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94fa2a-ade2-4ad2-9ab2-b430dd6b5eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:39.795374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94fa2a-ade2-4ad2-9ab2-b430dd6b5eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:39.796146 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94fa2a-ade2-4ad2-9ab2-b430dd6b5eb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:39.796458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94fa2a-ade2-4ad2-9ab2-b430dd6b5eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:39.798015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94fa2a-ade2-4ad2-9ab2-b430dd6b5eb0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:39.810925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 629/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:39.817283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793d9dc-5199-49b0-bcc5-526be966b18c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:39.932200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793d9dc-5199-49b0-bcc5-526be966b18c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:39.968027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6242542-d177-4340-9503-27e55655d883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:39.968816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242542-d177-4340-9503-27e55655d883 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:39.969094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242542-d177-4340-9503-27e55655d883 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:39.969365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242542-d177-4340-9503-27e55655d883 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:39.977457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6242542-d177-4340-9503-27e55655d883 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:39.979011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6242542-d177-4340-9503-27e55655d883 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-d6242542-d177-4340-9503-27e55655d883 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:36:39.994021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:39.995621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:39.996576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:39.996576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:39.996576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:36:39.996576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:36:39.996576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:36:39.996576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:36:39.996576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:36:39.996576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:36:39.996576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:39.996576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:39.996576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 624/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:40.001705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94fa2a-ade2-4ad2-9ab2-b430dd6b5eb0 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:40.108298 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94fa2a-ade2-4ad2-9ab2-b430dd6b5eb0 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:40.142546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d712c80-0e78-4a81-b049-379d1ce369e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:40.143219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d712c80-0e78-4a81-b049-379d1ce369e3 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:40.143503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d712c80-0e78-4a81-b049-379d1ce369e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:40.143776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d712c80-0e78-4a81-b049-379d1ce369e3 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:40.144635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d712c80-0e78-4a81-b049-379d1ce369e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:40.146024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d712c80-0e78-4a81-b049-379d1ce369e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:40.147708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d712c80-0e78-4a81-b049-379d1ce369e3 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:40.167528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 630/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Sat May 14 15:36:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:36:40.173181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6242542-d177-4340-9503-27e55655d883 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:40.278963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6242542-d177-4340-9503-27e55655d883 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:40.312698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01e5d2-df20-4a9e-b0da-dca3b855dbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:40.313344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e5d2-df20-4a9e-b0da-dca3b855dbd7 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:40.313649 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e5d2-df20-4a9e-b0da-dca3b855dbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:40.313908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01e5d2-df20-4a9e-b0da-dca3b855dbd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:40.383791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01e5d2-df20-4a9e-b0da-dca3b855dbd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:40.385191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01e5d2-df20-4a9e-b0da-dca3b855dbd7 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:40.487125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 625/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:36:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 14 15:36:40.493385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d712c80-0e78-4a81-b049-379d1ce369e3 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:40.598786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d712c80-0e78-4a81-b049-379d1ce369e3 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:40.633290 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4f987-4dea-414b-a3ab-c7aeb21081a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:40.634163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4f987-4dea-414b-a3ab-c7aeb21081a9 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:40.634426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4f987-4dea-414b-a3ab-c7aeb21081a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:40.634707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4f987-4dea-414b-a3ab-c7aeb21081a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:40.646438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4f987-4dea-414b-a3ab-c7aeb21081a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:40.648035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4f987-4dea-414b-a3ab-c7aeb21081a9 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-dbb4f987-4dea-414b-a3ab-c7aeb21081a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:40.667212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:40.668409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:40.669629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:40.669629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:40.669629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:40.669629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:40.669629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 631/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:36:40.674366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01e5d2-df20-4a9e-b0da-dca3b855dbd7 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:40.776226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01e5d2-df20-4a9e-b0da-dca3b855dbd7 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:40.810050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f38f16-7861-42cc-9fe9-fa1517f9c9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:40.810757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38f16-7861-42cc-9fe9-fa1517f9c9ef None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:40.811046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38f16-7861-42cc-9fe9-fa1517f9c9ef None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:40.811321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f38f16-7861-42cc-9fe9-fa1517f9c9ef None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:40.812058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f38f16-7861-42cc-9fe9-fa1517f9c9ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:40.812364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f38f16-7861-42cc-9fe9-fa1517f9c9ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:40.813756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f38f16-7861-42cc-9fe9-fa1517f9c9ef None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:40.826550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 626/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:40.833249 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4f987-4dea-414b-a3ab-c7aeb21081a9 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:40.933073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4f987-4dea-414b-a3ab-c7aeb21081a9 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:40.967932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc5717-e6f4-43f2-8dbd-e3afd6903c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:40.968982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc5717-e6f4-43f2-8dbd-e3afd6903c47 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:40.969406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc5717-e6f4-43f2-8dbd-e3afd6903c47 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:40.969841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc5717-e6f4-43f2-8dbd-e3afd6903c47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:40.976727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc5717-e6f4-43f2-8dbd-e3afd6903c47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:40.978173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc5717-e6f4-43f2-8dbd-e3afd6903c47 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-cadc5717-e6f4-43f2-8dbd-e3afd6903c47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:36:40.992525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:40.993505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:40.994488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:36:40.994488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:36:40.994488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:36:40.994488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:36:40.994488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:36:40.994488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:36:40.994488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:40.994488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:40.994488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 632/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:40.999509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f38f16-7861-42cc-9fe9-fa1517f9c9ef None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:41.107782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f38f16-7861-42cc-9fe9-fa1517f9c9ef None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:41.140500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbe141-7a95-40e2-8c4f-efb933a413aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:41.141158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe141-7a95-40e2-8c4f-efb933a413aa None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:41.141440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe141-7a95-40e2-8c4f-efb933a413aa None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:41.141713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbe141-7a95-40e2-8c4f-efb933a413aa None admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:41.142524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbe141-7a95-40e2-8c4f-efb933a413aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:41.142830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbe141-7a95-40e2-8c4f-efb933a413aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:41.145413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbe141-7a95-40e2-8c4f-efb933a413aa None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:41.157083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 627/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:41.163692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc5717-e6f4-43f2-8dbd-e3afd6903c47 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:41.258547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc5717-e6f4-43f2-8dbd-e3afd6903c47 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:41.291196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6989d3-73c5-451e-a4c4-7c3fe01d38ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:41.291836 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6989d3-73c5-451e-a4c4-7c3fe01d38ce None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:41.292115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6989d3-73c5-451e-a4c4-7c3fe01d38ce None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:41.292386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6989d3-73c5-451e-a4c4-7c3fe01d38ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:41.293209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6989d3-73c5-451e-a4c4-7c3fe01d38ce None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=8fac310b740a40718191e905723222ba) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:41.293514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6989d3-73c5-451e-a4c4-7c3fe01d38ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:41.294969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6989d3-73c5-451e-a4c4-7c3fe01d38ce None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:41.300140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 633/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:36:41 2022] GET /identity/v3/role_assignments?user.id=8fac310b740a40718191e905723222ba&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:43.456162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615463b-f5a4-44f8-bc2a-76c41d19de4c None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:43.456727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615463b-f5a4-44f8-bc2a-76c41d19de4c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:43.456727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615463b-f5a4-44f8-bc2a-76c41d19de4c None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:43.458678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 628/1261] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:36:43.463700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2ccee-d4bf-4b7f-98e0-874911a5cd1e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:43.464099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2ccee-d4bf-4b7f-98e0-874911a5cd1e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:43.464257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2ccee-d4bf-4b7f-98e0-874911a5cd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:43.481998 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f4a2ccee-d4bf-4b7f-98e0-874911a5cd1e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:36:43.483203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f4a2ccee-d4bf-4b7f-98e0-874911a5cd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:36:43.547614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 634/1262] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:36:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:36:43.570242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615463b-f5a4-44f8-bc2a-76c41d19de4c None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:43.665842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615463b-f5a4-44f8-bc2a-76c41d19de4c None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:43.697218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798210a9-3336-4b76-9c97-cd3af5337e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:43.697983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798210a9-3336-4b76-9c97-cd3af5337e36 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:43.698262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798210a9-3336-4b76-9c97-cd3af5337e36 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:43.698560 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798210a9-3336-4b76-9c97-cd3af5337e36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:43.708698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798210a9-3336-4b76-9c97-cd3af5337e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-798210a9-3336-4b76-9c97-cd3af5337e36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:36:43.716176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:43.717245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:43.718127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 629/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:43.723247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2ccee-d4bf-4b7f-98e0-874911a5cd1e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:43.815005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2ccee-d4bf-4b7f-98e0-874911a5cd1e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:43.847444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94faef-7ad7-47bb-ae50-2537caab692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:43.848256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94faef-7ad7-47bb-ae50-2537caab692c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:43.848539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94faef-7ad7-47bb-ae50-2537caab692c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:43.848811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94faef-7ad7-47bb-ae50-2537caab692c None admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:43.849557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94faef-7ad7-47bb-ae50-2537caab692c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:43.849862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94faef-7ad7-47bb-ae50-2537caab692c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:43.851264 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94faef-7ad7-47bb-ae50-2537caab692c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:43.859252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 635/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:43.865032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798210a9-3336-4b76-9c97-cd3af5337e36 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:43.958898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798210a9-3336-4b76-9c97-cd3af5337e36 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:43.990420 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa75591-bef2-47c3-841a-f2e9a46da746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:43.991183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa75591-bef2-47c3-841a-f2e9a46da746 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:43.991461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa75591-bef2-47c3-841a-f2e9a46da746 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:43.991730 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa75591-bef2-47c3-841a-f2e9a46da746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:44.001578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa75591-bef2-47c3-841a-f2e9a46da746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:44.003051 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa75591-bef2-47c3-841a-f2e9a46da746 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-9fa75591-bef2-47c3-841a-f2e9a46da746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:44.020896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:44.022010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:44.023140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:44.023140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:44.023140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:44.023140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:44.023140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 630/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:44.027815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94faef-7ad7-47bb-ae50-2537caab692c None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:44.125549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94faef-7ad7-47bb-ae50-2537caab692c None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:44.156733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a7e4b-09e2-4dd6-acdd-4dfb3911ef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:44.157382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a7e4b-09e2-4dd6-acdd-4dfb3911ef73 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:44.157664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a7e4b-09e2-4dd6-acdd-4dfb3911ef73 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:44.157938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a7e4b-09e2-4dd6-acdd-4dfb3911ef73 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:44.158679 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a7e4b-09e2-4dd6-acdd-4dfb3911ef73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:44.158990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a7e4b-09e2-4dd6-acdd-4dfb3911ef73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:44.160392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a7e4b-09e2-4dd6-acdd-4dfb3911ef73 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:44.171402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 636/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:44.177807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa75591-bef2-47c3-841a-f2e9a46da746 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:44.272150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa75591-bef2-47c3-841a-f2e9a46da746 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:44.303382 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61484a2a-dfa0-481a-8fc4-403855ed95fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:44.304159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61484a2a-dfa0-481a-8fc4-403855ed95fb None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:44.304443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61484a2a-dfa0-481a-8fc4-403855ed95fb None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:44.304719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61484a2a-dfa0-481a-8fc4-403855ed95fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:44.312451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61484a2a-dfa0-481a-8fc4-403855ed95fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:44.313883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61484a2a-dfa0-481a-8fc4-403855ed95fb None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-61484a2a-dfa0-481a-8fc4-403855ed95fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:36:44.328325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:44.329414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:44.330629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:44.330629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:44.330629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:36:44.330629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:36:44.330629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:36:44.330629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:36:44.330629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:36:44.330629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:36:44.330629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:44.330629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:44.330629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 631/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:44.335990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a7e4b-09e2-4dd6-acdd-4dfb3911ef73 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:44.429823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a7e4b-09e2-4dd6-acdd-4dfb3911ef73 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:44.461474 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad7d7f-1abd-4a89-a6e5-14be1daa5f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:44.462123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad7d7f-1abd-4a89-a6e5-14be1daa5f67 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:44.462434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad7d7f-1abd-4a89-a6e5-14be1daa5f67 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:44.462704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad7d7f-1abd-4a89-a6e5-14be1daa5f67 None admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:44.463523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad7d7f-1abd-4a89-a6e5-14be1daa5f67 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:44.463823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad7d7f-1abd-4a89-a6e5-14be1daa5f67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:44.465229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad7d7f-1abd-4a89-a6e5-14be1daa5f67 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:44.482142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 637/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Sat May 14 15:36:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:44.487702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61484a2a-dfa0-481a-8fc4-403855ed95fb None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:44.582873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61484a2a-dfa0-481a-8fc4-403855ed95fb None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:44.615328 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3450948-a5e6-40cc-ae6a-5dc27af4ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:44.616098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3450948-a5e6-40cc-ae6a-5dc27af4ff9b None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:44.616377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3450948-a5e6-40cc-ae6a-5dc27af4ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:44.616646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3450948-a5e6-40cc-ae6a-5dc27af4ff9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:44.626565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3450948-a5e6-40cc-ae6a-5dc27af4ff9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:44.627999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3450948-a5e6-40cc-ae6a-5dc27af4ff9b None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-a3450948-a5e6-40cc-ae6a-5dc27af4ff9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:44.644375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:44.645908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:44.647220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:44.647220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:44.647220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:44.647220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:44.647220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 632/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:44.651621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad7d7f-1abd-4a89-a6e5-14be1daa5f67 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:44.743600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad7d7f-1abd-4a89-a6e5-14be1daa5f67 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:44.774878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0937d-8587-4337-b766-d37199543780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:44.775517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0937d-8587-4337-b766-d37199543780 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:44.775794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0937d-8587-4337-b766-d37199543780 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:44.776065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0937d-8587-4337-b766-d37199543780 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:44.776772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0937d-8587-4337-b766-d37199543780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:44.777070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0937d-8587-4337-b766-d37199543780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:44.778440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0937d-8587-4337-b766-d37199543780 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:44.789765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 638/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:44.795111 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3450948-a5e6-40cc-ae6a-5dc27af4ff9b None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:44.888441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3450948-a5e6-40cc-ae6a-5dc27af4ff9b None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:44.919453 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa7b57-57a2-4e31-a989-162606232dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:44.920228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa7b57-57a2-4e31-a989-162606232dee None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:44.920506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa7b57-57a2-4e31-a989-162606232dee None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:44.920774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa7b57-57a2-4e31-a989-162606232dee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:44.927809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa7b57-57a2-4e31-a989-162606232dee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:44.929224 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa7b57-57a2-4e31-a989-162606232dee None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-67aa7b57-57a2-4e31-a989-162606232dee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:36:44.943701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:44.944771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:44.946019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:36:44.946019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:36:44.946019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:36:44.946019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:36:44.946019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:36:44.946019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:36:44.946019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:44.946019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:44.946019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 633/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:44.950572 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0937d-8587-4337-b766-d37199543780 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:45.048070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0937d-8587-4337-b766-d37199543780 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:45.081013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fa997-3db6-44f2-9fea-c8387dd0b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:45.081671 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fa997-3db6-44f2-9fea-c8387dd0b82d None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:45.081955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fa997-3db6-44f2-9fea-c8387dd0b82d None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:45.082373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fa997-3db6-44f2-9fea-c8387dd0b82d None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:45.083252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fa997-3db6-44f2-9fea-c8387dd0b82d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:45.083561 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fa997-3db6-44f2-9fea-c8387dd0b82d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:45.084994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fa997-3db6-44f2-9fea-c8387dd0b82d None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:45.096300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 639/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:45.102791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa7b57-57a2-4e31-a989-162606232dee None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:45.195753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa7b57-57a2-4e31-a989-162606232dee None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:45.227432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509d8e8-69e7-4691-acd7-c325f28a686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:45.228288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509d8e8-69e7-4691-acd7-c325f28a686f None admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:45.228572 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509d8e8-69e7-4691-acd7-c325f28a686f None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:45.228850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509d8e8-69e7-4691-acd7-c325f28a686f None admin] PATH_INFO: `/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/8fac310b740a40718191e905723222ba/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:45.231033 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509d8e8-69e7-4691-acd7-c325f28a686f None admin] RBAC: Authorizing `identity:create_grant(project_id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user_id=8fac310b740a40718191e905723222ba, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:45.232442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509d8e8-69e7-4691-acd7-c325f28a686f None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:45.245707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 634/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Sat May 14 15:36:45 2022] PUT /identity/v3/projects/b979a4ee39014bb2bd5b3b6de1ecc2fc/users/8fac310b740a40718191e905723222ba/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:36:47.408587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b4dbb-cf33-4767-aa55-1a69c7149d11 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:47.409139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b4dbb-cf33-4767-aa55-1a69c7149d11 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:47.409139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b4dbb-cf33-4767-aa55-1a69c7149d11 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:47.411314 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 640/1274] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:36:47.416505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411a88b-ab18-4f51-8dc7-1e34b7d58034 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:47.416903 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411a88b-ab18-4f51-8dc7-1e34b7d58034 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:47.417057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411a88b-ab18-4f51-8dc7-1e34b7d58034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:47.433859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-0411a88b-ab18-4f51-8dc7-1e34b7d58034 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:36:47.435053 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-0411a88b-ab18-4f51-8dc7-1e34b7d58034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:36:47.497367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 635/1275] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:36:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:36:47.520327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b4dbb-cf33-4767-aa55-1a69c7149d11 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:47.615553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b4dbb-cf33-4767-aa55-1a69c7149d11 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:47.648039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fbb74-ae89-4c49-8a70-f3c4aa5003d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:47.648816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fbb74-ae89-4c49-8a70-f3c4aa5003d8 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:47.649097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fbb74-ae89-4c49-8a70-f3c4aa5003d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:47.649369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fbb74-ae89-4c49-8a70-f3c4aa5003d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:47.659076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fbb74-ae89-4c49-8a70-f3c4aa5003d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-fe5fbb74-ae89-4c49-8a70-f3c4aa5003d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(role_id) May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 14 15:36:47.667137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:47.668271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:47.669327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 641/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Sat May 14 15:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:47.674186 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411a88b-ab18-4f51-8dc7-1e34b7d58034 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:47.766020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411a88b-ab18-4f51-8dc7-1e34b7d58034 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:47.798664 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3ee3-bdbe-4018-8304-59b0fb278b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:47.799305 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3ee3-bdbe-4018-8304-59b0fb278b54 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:47.799584 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3ee3-bdbe-4018-8304-59b0fb278b54 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:47.799853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3ee3-bdbe-4018-8304-59b0fb278b54 None admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:47.800587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b3ee3-bdbe-4018-8304-59b0fb278b54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:47.800912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b3ee3-bdbe-4018-8304-59b0fb278b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:47.802260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98b3ee3-bdbe-4018-8304-59b0fb278b54 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:47.809826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 636/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Sat May 14 15:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:47.815287 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fbb74-ae89-4c49-8a70-f3c4aa5003d8 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:47.909929 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fbb74-ae89-4c49-8a70-f3c4aa5003d8 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:47.940964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecc0ef-8ab2-47ea-8f47-f45d5b64f96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:47.941782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecc0ef-8ab2-47ea-8f47-f45d5b64f96f None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:47.942059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecc0ef-8ab2-47ea-8f47-f45d5b64f96f None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:47.942355 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecc0ef-8ab2-47ea-8f47-f45d5b64f96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:47.952524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecc0ef-8ab2-47ea-8f47-f45d5b64f96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:47.953972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecc0ef-8ab2-47ea-8f47-f45d5b64f96f None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-a4ecc0ef-8ab2-47ea-8f47-f45d5b64f96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:47.970471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:47.971524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:47.972487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:47.972487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:47.972487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:47.972487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:47.972487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 642/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:36:47.977899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3ee3-bdbe-4018-8304-59b0fb278b54 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:48.080190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3ee3-bdbe-4018-8304-59b0fb278b54 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:48.112129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ecd9b-4334-488d-8215-94796be58b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:48.112779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ecd9b-4334-488d-8215-94796be58b42 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:48.113060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ecd9b-4334-488d-8215-94796be58b42 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:48.113372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ecd9b-4334-488d-8215-94796be58b42 None admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:48.114115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ecd9b-4334-488d-8215-94796be58b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:48.114443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ecd9b-4334-488d-8215-94796be58b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:48.115819 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ecd9b-4334-488d-8215-94796be58b42 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:48.126900 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 637/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:48.132956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecc0ef-8ab2-47ea-8f47-f45d5b64f96f None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:48.225704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecc0ef-8ab2-47ea-8f47-f45d5b64f96f None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:48.256786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef408b-1169-40f4-b6c9-43a6f35504bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:48.257554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef408b-1169-40f4-b6c9-43a6f35504bd None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:48.257832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef408b-1169-40f4-b6c9-43a6f35504bd None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:48.258101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef408b-1169-40f4-b6c9-43a6f35504bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:48.265112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef408b-1169-40f4-b6c9-43a6f35504bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:48.266570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef408b-1169-40f4-b6c9-43a6f35504bd None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-9cef408b-1169-40f4-b6c9-43a6f35504bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_user(user_id) May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 14 15:36:48.280739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:48.281837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:48.283035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:48.283035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:48.283035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 14 15:36:48.283035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 14 15:36:48.283035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 14 15:36:48.283035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 14 15:36:48.283035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 14 15:36:48.283035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 14 15:36:48.283035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 14 15:36:48.283035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:48.283035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 643/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:48.287722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ecd9b-4334-488d-8215-94796be58b42 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:48.380060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ecd9b-4334-488d-8215-94796be58b42 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:48.411848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b385b81-3ae1-4a22-b9af-7d8cbd37741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:48.412498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385b81-3ae1-4a22-b9af-7d8cbd37741c None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:48.412780 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385b81-3ae1-4a22-b9af-7d8cbd37741c None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:48.413049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b385b81-3ae1-4a22-b9af-7d8cbd37741c None admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:48.413867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b385b81-3ae1-4a22-b9af-7d8cbd37741c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:48.414170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b385b81-3ae1-4a22-b9af-7d8cbd37741c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:48.415603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b385b81-3ae1-4a22-b9af-7d8cbd37741c None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:48.432271 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 638/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Sat May 14 15:36:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:48.437924 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef408b-1169-40f4-b6c9-43a6f35504bd None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:48.534388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef408b-1169-40f4-b6c9-43a6f35504bd None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:48.565766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fc116-5e3d-4404-a0a0-54832958f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:48.570987 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fc116-5e3d-4404-a0a0-54832958f39c None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:48.571272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fc116-5e3d-4404-a0a0-54832958f39c None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:48.571543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fc116-5e3d-4404-a0a0-54832958f39c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:48.635475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fc116-5e3d-4404-a0a0-54832958f39c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:48.636901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fc116-5e3d-4404-a0a0-54832958f39c None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:48.726694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 644/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Sat May 14 15:36:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 14 15:36:48.732672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b385b81-3ae1-4a22-b9af-7d8cbd37741c None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:48.825221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b385b81-3ae1-4a22-b9af-7d8cbd37741c None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:48.857973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacb261-c47a-4c12-90c5-6773bb157700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:48.858790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacb261-c47a-4c12-90c5-6773bb157700 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:48.859069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacb261-c47a-4c12-90c5-6773bb157700 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:48.859337 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacb261-c47a-4c12-90c5-6773bb157700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:48.869413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacb261-c47a-4c12-90c5-6773bb157700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:48.870868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacb261-c47a-4c12-90c5-6773bb157700 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-ffacb261-c47a-4c12-90c5-6773bb157700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 14 15:36:48.887459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:48.888373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:48.889310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 14 15:36:48.889310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 14 15:36:48.889310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 14 15:36:48.889310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:48.889310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 639/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:36:48.894203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fc116-5e3d-4404-a0a0-54832958f39c None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:48.988840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fc116-5e3d-4404-a0a0-54832958f39c None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:49.021320 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a312e-9d82-4a59-acb5-84f46ac11687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:49.021974 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a312e-9d82-4a59-acb5-84f46ac11687 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:49.022256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a312e-9d82-4a59-acb5-84f46ac11687 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:49.022560 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a312e-9d82-4a59-acb5-84f46ac11687 None admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:49.023280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a312e-9d82-4a59-acb5-84f46ac11687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:49.023584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a312e-9d82-4a59-acb5-84f46ac11687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:49.024950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a312e-9d82-4a59-acb5-84f46ac11687 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:49.036243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 645/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Sat May 14 15:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:36:49.041850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacb261-c47a-4c12-90c5-6773bb157700 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:49.134567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacb261-c47a-4c12-90c5-6773bb157700 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:49.166753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22ed45-2216-446e-a2d4-765a65c0990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:49.167517 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22ed45-2216-446e-a2d4-765a65c0990a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:49.167799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22ed45-2216-446e-a2d4-765a65c0990a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:49.168072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22ed45-2216-446e-a2d4-765a65c0990a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:49.174373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22ed45-2216-446e-a2d4-765a65c0990a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:49.175866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22ed45-2216-446e-a2d4-765a65c0990a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application [None req-1d22ed45-2216-446e-a2d4-765a65c0990a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(project_id) May 14 15:36:49.188941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application with Lock( May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:49.189943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:49.191072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 14 15:36:49.191072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 14 15:36:49.191072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 14 15:36:49.191072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 14 15:36:49.191072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 14 15:36:49.191072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 14 15:36:49.191072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 14 15:36:49.191072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: ERROR keystone.server.flask.application May 14 15:36:49.191072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 640/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Sat May 14 15:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 14 15:36:49.195900 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a312e-9d82-4a59-acb5-84f46ac11687 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:49.290728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a312e-9d82-4a59-acb5-84f46ac11687 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:49.322193 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809bc18-0323-433b-ad18-36aed40c6fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:49.322871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809bc18-0323-433b-ad18-36aed40c6fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:49.323153 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809bc18-0323-433b-ad18-36aed40c6fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:49.323427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809bc18-0323-433b-ad18-36aed40c6fd0 None admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:49.324205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809bc18-0323-433b-ad18-36aed40c6fd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:49.324510 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809bc18-0323-433b-ad18-36aed40c6fd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:49.325933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809bc18-0323-433b-ad18-36aed40c6fd0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:49.338171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 646/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Sat May 14 15:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:36:49.344314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22ed45-2216-446e-a2d4-765a65c0990a None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:49.442092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22ed45-2216-446e-a2d4-765a65c0990a None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:49.474242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b597477-3f5b-47e1-ac4f-b20cdd9c77f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:49.474906 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b597477-3f5b-47e1-ac4f-b20cdd9c77f2 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:49.475190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b597477-3f5b-47e1-ac4f-b20cdd9c77f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:49.475468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b597477-3f5b-47e1-ac4f-b20cdd9c77f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:49.476298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b597477-3f5b-47e1-ac4f-b20cdd9c77f2 None admin] RBAC: Adding query filter params (role.id=e4796ab51a014dec8c68e61b88dedfdf, scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc, user.id=8fac310b740a40718191e905723222ba) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:49.476610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b597477-3f5b-47e1-ac4f-b20cdd9c77f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:49.478040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b597477-3f5b-47e1-ac4f-b20cdd9c77f2 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:49.483858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 641/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Sat May 14 15:36:49 2022] GET /identity/v3/role_assignments?user.id=8fac310b740a40718191e905723222ba&scope.project.id=b979a4ee39014bb2bd5b3b6de1ecc2fc&role.id=e4796ab51a014dec8c68e61b88dedfdf => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:51.694904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e3c05-0941-47e7-bfa9-9a4175d00946 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:51.695432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e3c05-0941-47e7-bfa9-9a4175d00946 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:51.695432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e3c05-0941-47e7-bfa9-9a4175d00946 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:51.696815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 647/1288] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:36:51.702005 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f9332-5c97-4ff1-b969-e88eb9ca66a6 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:51.702408 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f9332-5c97-4ff1-b969-e88eb9ca66a6 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:51.702575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f9332-5c97-4ff1-b969-e88eb9ca66a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:51.718774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-414f9332-5c97-4ff1-b969-e88eb9ca66a6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:36:51.719924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-414f9332-5c97-4ff1-b969-e88eb9ca66a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:36:51.781838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 642/1289] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:36:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:36:51.805069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e3c05-0941-47e7-bfa9-9a4175d00946 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:51.900534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e3c05-0941-47e7-bfa9-9a4175d00946 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:51.932826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7437f7-369b-4534-8c11-0b690c54ac5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:51.933604 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7437f7-369b-4534-8c11-0b690c54ac5e None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:51.933881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7437f7-369b-4534-8c11-0b690c54ac5e None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:51.934149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7437f7-369b-4534-8c11-0b690c54ac5e None admin] PATH_INFO: `/v3/services/placement` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:51.934821 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7437f7-369b-4534-8c11-0b690c54ac5e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:51.936170 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7437f7-369b-4534-8c11-0b690c54ac5e None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-de7437f7-369b-4534-8c11-0b690c54ac5e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:51.947449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:51.948771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:51.949920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 648/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Sat May 14 15:36:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:51.954596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f9332-5c97-4ff1-b969-e88eb9ca66a6 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:52.049149 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f9332-5c97-4ff1-b969-e88eb9ca66a6 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:52.083689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6d1f6-1d0e-4b1c-8a8e-33e750afa02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:52.084342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6d1f6-1d0e-4b1c-8a8e-33e750afa02a None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:52.084624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6d1f6-1d0e-4b1c-8a8e-33e750afa02a None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:52.084895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6d1f6-1d0e-4b1c-8a8e-33e750afa02a None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:52.085596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6d1f6-1d0e-4b1c-8a8e-33e750afa02a None admin] RBAC: Adding query filter params (name=placement) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:52.085899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6d1f6-1d0e-4b1c-8a8e-33e750afa02a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:52.087281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6d1f6-1d0e-4b1c-8a8e-33e750afa02a None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:52.091880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 643/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Sat May 14 15:36:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:52.098084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7437f7-369b-4534-8c11-0b690c54ac5e None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:52.191659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7437f7-369b-4534-8c11-0b690c54ac5e None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:52.223176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd0bc1-2b41-457a-bac3-50c9fdd4536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:52.223754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd0bc1-2b41-457a-bac3-50c9fdd4536b None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:52.224031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd0bc1-2b41-457a-bac3-50c9fdd4536b None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:52.224305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd0bc1-2b41-457a-bac3-50c9fdd4536b None admin] PATH_INFO: `/v3/services` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:52.224997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd0bc1-2b41-457a-bac3-50c9fdd4536b None admin] RBAC: Adding query filter params (type=placement) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:52.225297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd0bc1-2b41-457a-bac3-50c9fdd4536b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:52.226670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd0bc1-2b41-457a-bac3-50c9fdd4536b None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:52.231225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 649/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Sat May 14 15:36:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:54.390842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202866-bfe1-4a42-8c53-da7f2f49f712 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:54.391369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202866-bfe1-4a42-8c53-da7f2f49f712 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:54.391369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202866-bfe1-4a42-8c53-da7f2f49f712 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:54.392751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 644/1293] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:36:54.398473 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870b0b-80c7-410a-a3f0-42b40adf39d5 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:54.398896 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870b0b-80c7-410a-a3f0-42b40adf39d5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:54.399033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c870b0b-80c7-410a-a3f0-42b40adf39d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:54.415797 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7c870b0b-80c7-410a-a3f0-42b40adf39d5 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:36:54.416971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7c870b0b-80c7-410a-a3f0-42b40adf39d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:36:54.481404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 650/1294] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:36:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:36:54.503652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202866-bfe1-4a42-8c53-da7f2f49f712 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:54.598743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202866-bfe1-4a42-8c53-da7f2f49f712 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:54.631367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206a4b3-13cd-4b26-a6d7-1d17f789bd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:54.632065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a4b3-13cd-4b26-a6d7-1d17f789bd03 None admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:54.632349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a4b3-13cd-4b26-a6d7-1d17f789bd03 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:54.632625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a4b3-13cd-4b26-a6d7-1d17f789bd03 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:54.633339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206a4b3-13cd-4b26-a6d7-1d17f789bd03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:54.634743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206a4b3-13cd-4b26-a6d7-1d17f789bd03 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:54.648005 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 645/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Sat May 14 15:36:54 2022] POST /identity/v3/services => generated 246 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:36:56.827279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564259-796a-4673-b022-fc63f1cdb376 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:56.827848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564259-796a-4673-b022-fc63f1cdb376 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:56.827848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3564259-796a-4673-b022-fc63f1cdb376 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:56.829215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 651/1296] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:36:56.835494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce39a-7ec1-4c34-ba08-65f3e5bd3d11 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:56.835874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce39a-7ec1-4c34-ba08-65f3e5bd3d11 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:56.835984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ce39a-7ec1-4c34-ba08-65f3e5bd3d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:56.852670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-8a6ce39a-7ec1-4c34-ba08-65f3e5bd3d11 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:36:56.853816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8a6ce39a-7ec1-4c34-ba08-65f3e5bd3d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:36:56.921697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 646/1297] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:36:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:36:56.943706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3564259-796a-4673-b022-fc63f1cdb376 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:57.047280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3564259-796a-4673-b022-fc63f1cdb376 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:57.085307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099d315-7fa0-49b6-86be-398a6ea3dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:57.086018 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d315-7fa0-49b6-86be-398a6ea3dd57 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:57.086293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d315-7fa0-49b6-86be-398a6ea3dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:57.086594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099d315-7fa0-49b6-86be-398a6ea3dd57 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:57.087234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099d315-7fa0-49b6-86be-398a6ea3dd57 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:57.088592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099d315-7fa0-49b6-86be-398a6ea3dd57 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-2099d315-7fa0-49b6-86be-398a6ea3dd57 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:57.100486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:57.101646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:57.102760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 652/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Sat May 14 15:36:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:57.108008 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ce39a-7ec1-4c34-ba08-65f3e5bd3d11 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:57.199667 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ce39a-7ec1-4c34-ba08-65f3e5bd3d11 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:57.231433 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f3fc6-3f00-457f-a23a-d09840cfca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:57.232080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3fc6-3f00-457f-a23a-d09840cfca47 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:57.232364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3fc6-3f00-457f-a23a-d09840cfca47 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:57.232639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f3fc6-3f00-457f-a23a-d09840cfca47 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:57.233346 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f3fc6-3f00-457f-a23a-d09840cfca47 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:57.233649 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f3fc6-3f00-457f-a23a-d09840cfca47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:57.235039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f3fc6-3f00-457f-a23a-d09840cfca47 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:57.240191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 647/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Sat May 14 15:36:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:57.245954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099d315-7fa0-49b6-86be-398a6ea3dd57 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:57.345113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099d315-7fa0-49b6-86be-398a6ea3dd57 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:57.375900 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101484a-054a-4c53-bf3b-e9e6cc7b9cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:57.376533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101484a-054a-4c53-bf3b-e9e6cc7b9cfc None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:57.376809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101484a-054a-4c53-bf3b-e9e6cc7b9cfc None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:57.377078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101484a-054a-4c53-bf3b-e9e6cc7b9cfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:57.377853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101484a-054a-4c53-bf3b-e9e6cc7b9cfc None admin] RBAC: Adding query filter params (interface=public, service_id=84012d4bad704af2af39f7608dff89e1, region_id=RegionOne) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:36:57.378159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101484a-054a-4c53-bf3b-e9e6cc7b9cfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:57.380144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101484a-054a-4c53-bf3b-e9e6cc7b9cfc None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:57.384873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 653/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Sat May 14 15:36:57 2022] GET /identity/v3/endpoints?service_id=84012d4bad704af2af39f7608dff89e1&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:36:57.390357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f3fc6-3f00-457f-a23a-d09840cfca47 None admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:57.484257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f3fc6-3f00-457f-a23a-d09840cfca47 None admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:57.515842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b349e-d3d5-4288-8fff-add6cdd5bdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:57.516492 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b349e-d3d5-4288-8fff-add6cdd5bdbe None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:57.516772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b349e-d3d5-4288-8fff-add6cdd5bdbe None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:57.517044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b349e-d3d5-4288-8fff-add6cdd5bdbe None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:57.517718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b349e-d3d5-4288-8fff-add6cdd5bdbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:57.519091 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b349e-d3d5-4288-8fff-add6cdd5bdbe None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:57.525664 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 648/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Sat May 14 15:36:57 2022] GET /identity/v3/services => generated 2191 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:36:59.700325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532dea1-7e1c-41af-9144-10eefbcfd8e9 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:59.700884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532dea1-7e1c-41af-9144-10eefbcfd8e9 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:59.700884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532dea1-7e1c-41af-9144-10eefbcfd8e9 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:59.702227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 654/1302] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:36:59.707962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9dc24-b3e3-43e1-a8e2-c0641acbb12a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:59.708334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9dc24-b3e3-43e1-a8e2-c0641acbb12a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:59.708503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9dc24-b3e3-43e1-a8e2-c0641acbb12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:59.724426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-3fd9dc24-b3e3-43e1-a8e2-c0641acbb12a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:36:59.725577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3fd9dc24-b3e3-43e1-a8e2-c0641acbb12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:36:59.786710 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 649/1303] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:36:59 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 14 15:36:59.808902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532dea1-7e1c-41af-9144-10eefbcfd8e9 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:36:59.907364 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532dea1-7e1c-41af-9144-10eefbcfd8e9 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:36:59.939051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8164ee-44c7-47f0-b081-802e931e5cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:36:59.939830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8164ee-44c7-47f0-b081-802e931e5cb4 None admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:36:59.940107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8164ee-44c7-47f0-b081-802e931e5cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:36:59.940378 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8164ee-44c7-47f0-b081-802e931e5cb4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:36:59.941028 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8164ee-44c7-47f0-b081-802e931e5cb4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:36:59.942409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8164ee-44c7-47f0-b081-802e931e5cb4 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application [None req-2d8164ee-44c7-47f0-b081-802e931e5cb4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application Traceback (most recent call last): May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 14 15:36:59.953678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._get_service(service_id) May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 14 15:36:59.954860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.get_or_create( May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application with Lock( May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self._enter() May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application return self.creator() May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application created_value = creator( May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: ERROR keystone.server.flask.application May 14 15:36:59.955798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 655/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Sat May 14 15:36:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 14 15:36:59.961506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9dc24-b3e3-43e1-a8e2-c0641acbb12a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:37:00.059420 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9dc24-b3e3-43e1-a8e2-c0641acbb12a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:37:00.090384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3202652-7f75-4e78-be88-0d305389ae86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:37:00.091041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202652-7f75-4e78-be88-0d305389ae86 None admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:37:00.091322 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202652-7f75-4e78-be88-0d305389ae86 None admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:37:00.091596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202652-7f75-4e78-be88-0d305389ae86 None admin] PATH_INFO: `/v3/services` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:37:00.092298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3202652-7f75-4e78-be88-0d305389ae86 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:37:00.092599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3202652-7f75-4e78-be88-0d305389ae86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:37:00.093949 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3202652-7f75-4e78-be88-0d305389ae86 None admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:37:00.099331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 650/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Sat May 14 15:36:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:37:00.105310 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8164ee-44c7-47f0-b081-802e931e5cb4 None admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:37:00.201260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8164ee-44c7-47f0-b081-802e931e5cb4 None admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:37:00.233852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a0f8a-0e7d-47fe-9a03-76fc1555e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:37:00.234460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0f8a-0e7d-47fe-9a03-76fc1555e5f0 None admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:37:00.234746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0f8a-0e7d-47fe-9a03-76fc1555e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:37:00.235019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a0f8a-0e7d-47fe-9a03-76fc1555e5f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:37:00.235756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a0f8a-0e7d-47fe-9a03-76fc1555e5f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:37:00.237114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a0f8a-0e7d-47fe-9a03-76fc1555e5f0 None admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:37:00.255094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 656/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Sat May 14 15:37:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:38:03.965130 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183476d-503f-4fbe-b5a4-11973c2f7c56 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:03.966153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183476d-503f-4fbe-b5a4-11973c2f7c56 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:03.966681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183476d-503f-4fbe-b5a4-11973c2f7c56 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:03.974412 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1694f5-69d2-4e4e-ac75-e658db9e9c9d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:03.975318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1694f5-69d2-4e4e-ac75-e658db9e9c9d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:03.975805 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1694f5-69d2-4e4e-ac75-e658db9e9c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:03.979655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 651/1307] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:03 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:04.171770 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-db1694f5-69d2-4e4e-ac75-e658db9e9c9d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:04.175390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-db1694f5-69d2-4e4e-ac75-e658db9e9c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:04.338871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 657/1308] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:38:04.378286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e4afc-d1ee-4b54-854d-28b8d20fff85 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:04.378646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e4afc-d1ee-4b54-854d-28b8d20fff85 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:04.378877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e4afc-d1ee-4b54-854d-28b8d20fff85 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:04.380319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 652/1309] 10.222.0.61 () {54 vars in 964 bytes} [Sat May 14 15:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:04.386890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41e39-290b-4d38-b41f-230bff126364 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:04.387441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41e39-290b-4d38-b41f-230bff126364 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:04.387947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41e39-290b-4d38-b41f-230bff126364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:04.469083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-16e41e39-290b-4d38-b41f-230bff126364 None None] MFA Rules not processed for user `abfc1e35362a4495a05475878db260f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:04.470938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-16e41e39-290b-4d38-b41f-230bff126364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:04.566412 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 658/1310] 10.222.0.61 () {58 vars in 1061 bytes} [Sat May 14 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:04.567137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e4afc-d1ee-4b54-854d-28b8d20fff85 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:04.568882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-660e4afc-d1ee-4b54-854d-28b8d20fff85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:04.687261 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e4afc-d1ee-4b54-854d-28b8d20fff85 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:04.776063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f11d3b-fd0e-4916-a176-fc50ebb46dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:04.777215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f11d3b-fd0e-4916-a176-fc50ebb46dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:04.777698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f11d3b-fd0e-4916-a176-fc50ebb46dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:04.778170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f11d3b-fd0e-4916-a176-fc50ebb46dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:04.780452 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-37f11d3b-fd0e-4916-a176-fc50ebb46dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:04.918069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f11d3b-fd0e-4916-a176-fc50ebb46dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:04.920214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f11d3b-fd0e-4916-a176-fc50ebb46dc9 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:04.958323 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 653/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:38:07.609465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1244c2-4b6f-4b64-9e8a-0fb97b94e819 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:07.610054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1244c2-4b6f-4b64-9e8a-0fb97b94e819 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:07.610054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1244c2-4b6f-4b64-9e8a-0fb97b94e819 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:07.611843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 659/1312] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:07.617755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab018337-f62b-492d-954b-0f40a0edd805 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:07.618216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab018337-f62b-492d-954b-0f40a0edd805 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:07.618393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab018337-f62b-492d-954b-0f40a0edd805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:07.685271 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-ab018337-f62b-492d-954b-0f40a0edd805 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:07.686431 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ab018337-f62b-492d-954b-0f40a0edd805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:07.779122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 654/1313] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:07.816160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1244c2-4b6f-4b64-9e8a-0fb97b94e819 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:07.817696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ed1244c2-4b6f-4b64-9e8a-0fb97b94e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:07.918858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1244c2-4b6f-4b64-9e8a-0fb97b94e819 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:07.991502 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c19d93-2623-440b-980f-0c00caf704e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:07.992149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19d93-2623-440b-980f-0c00caf704e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:07.992431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19d93-2623-440b-980f-0c00caf704e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:07.992706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19d93-2623-440b-980f-0c00caf704e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:07.994383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-54c19d93-2623-440b-980f-0c00caf704e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:08.101054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c19d93-2623-440b-980f-0c00caf704e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:08.102527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c19d93-2623-440b-980f-0c00caf704e6 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:08.120864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 660/1314] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:10.666396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95558d-517f-4a38-bb32-b5914218c4b0 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:10.666963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95558d-517f-4a38-bb32-b5914218c4b0 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:10.666963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a95558d-517f-4a38-bb32-b5914218c4b0 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:10.668337 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 655/1315] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:10.673368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46becc08-8059-4151-b9f0-726657dfd3a7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:10.673778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46becc08-8059-4151-b9f0-726657dfd3a7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:10.673927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46becc08-8059-4151-b9f0-726657dfd3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:10.736702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-46becc08-8059-4151-b9f0-726657dfd3a7 None None] MFA Rules not processed for user `bfcb42b66d894bf19c19d3ce4885a45f`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:10.737911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-46becc08-8059-4151-b9f0-726657dfd3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:10.829631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 661/1316] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:10.869316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95558d-517f-4a38-bb32-b5914218c4b0 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:10.870876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6a95558d-517f-4a38-bb32-b5914218c4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:10.968759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a95558d-517f-4a38-bb32-b5914218c4b0 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:11.039214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca03eaa-5f53-4bd3-924b-f293d36a30b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:11.039856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03eaa-5f53-4bd3-924b-f293d36a30b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:11.040142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03eaa-5f53-4bd3-924b-f293d36a30b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:11.040421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03eaa-5f53-4bd3-924b-f293d36a30b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:11.042070 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-0ca03eaa-5f53-4bd3-924b-f293d36a30b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:11.144442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca03eaa-5f53-4bd3-924b-f293d36a30b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:11.145855 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca03eaa-5f53-4bd3-924b-f293d36a30b1 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:11.164833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 656/1317] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:13.998639 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8eccb-f3d7-41fb-bf11-c9b51da64392 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:13.999163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8eccb-f3d7-41fb-bf11-c9b51da64392 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:13.999260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8eccb-f3d7-41fb-bf11-c9b51da64392 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:14.000838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 662/1318] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:14.006829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27419915-e0c4-4cea-a855-5137dcd7027d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:14.007223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27419915-e0c4-4cea-a855-5137dcd7027d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:14.007377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27419915-e0c4-4cea-a855-5137dcd7027d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:14.071530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-27419915-e0c4-4cea-a855-5137dcd7027d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:14.072706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-27419915-e0c4-4cea-a855-5137dcd7027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:14.164978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 657/1319] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:14.204315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8eccb-f3d7-41fb-bf11-c9b51da64392 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:14.205832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-49e8eccb-f3d7-41fb-bf11-c9b51da64392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:14.304715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8eccb-f3d7-41fb-bf11-c9b51da64392 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:14.373616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa622956-1444-4f41-a3fd-8a4647741641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:14.374253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa622956-1444-4f41-a3fd-8a4647741641 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:14.374563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa622956-1444-4f41-a3fd-8a4647741641 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:14.374840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa622956-1444-4f41-a3fd-8a4647741641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:14.376468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-aa622956-1444-4f41-a3fd-8a4647741641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:14.487335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa622956-1444-4f41-a3fd-8a4647741641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:14.488690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa622956-1444-4f41-a3fd-8a4647741641 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:14.507363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 663/1320] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:17.382411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af861-6da6-4de2-8a44-00005c3402e6 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:17.382989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af861-6da6-4de2-8a44-00005c3402e6 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:17.382989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49af861-6da6-4de2-8a44-00005c3402e6 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:17.384326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 658/1321] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:17.389438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37520a-c382-4d01-b9e4-5a29472ce095 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:17.389870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37520a-c382-4d01-b9e4-5a29472ce095 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:17.389981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37520a-c382-4d01-b9e4-5a29472ce095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:17.451779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4f37520a-c382-4d01-b9e4-5a29472ce095 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:17.452967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4f37520a-c382-4d01-b9e4-5a29472ce095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:17.544796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 664/1322] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:17.580643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af861-6da6-4de2-8a44-00005c3402e6 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:17.582161 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a49af861-6da6-4de2-8a44-00005c3402e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:17.682810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49af861-6da6-4de2-8a44-00005c3402e6 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:17.754600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb1377-85ce-4b63-aee1-edc2e6f97af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:17.755245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb1377-85ce-4b63-aee1-edc2e6f97af9 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:17.755522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb1377-85ce-4b63-aee1-edc2e6f97af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:17.755790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb1377-85ce-4b63-aee1-edc2e6f97af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:17.757418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b9cb1377-85ce-4b63-aee1-edc2e6f97af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:17.863073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb1377-85ce-4b63-aee1-edc2e6f97af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:17.864523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb1377-85ce-4b63-aee1-edc2e6f97af9 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:17.882819 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 659/1323] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:20.168916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdca0-44cf-4119-9c07-7a48c08d6d0a None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:20.169444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdca0-44cf-4119-9c07-7a48c08d6d0a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:20.169444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdca0-44cf-4119-9c07-7a48c08d6d0a None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:20.170777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 665/1324] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:20.176095 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083101ea-4965-43c3-8a2d-c17b45479e37 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:20.176540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083101ea-4965-43c3-8a2d-c17b45479e37 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:20.176650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083101ea-4965-43c3-8a2d-c17b45479e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:20.241389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-083101ea-4965-43c3-8a2d-c17b45479e37 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:20.242611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-083101ea-4965-43c3-8a2d-c17b45479e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:20.334934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 660/1325] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:20.370714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bdca0-44cf-4119-9c07-7a48c08d6d0a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:20.372272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0e8bdca0-44cf-4119-9c07-7a48c08d6d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:20.471286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bdca0-44cf-4119-9c07-7a48c08d6d0a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:20.540356 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e497c47-2537-46a4-aeb7-5bf8b35600fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:20.540999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497c47-2537-46a4-aeb7-5bf8b35600fb service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:20.541296 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497c47-2537-46a4-aeb7-5bf8b35600fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:20.541553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497c47-2537-46a4-aeb7-5bf8b35600fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:20.543281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8e497c47-2537-46a4-aeb7-5bf8b35600fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:20.647177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e497c47-2537-46a4-aeb7-5bf8b35600fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:20.648606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e497c47-2537-46a4-aeb7-5bf8b35600fb service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:20.665817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 666/1326] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:22.951958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8578b-76e3-4c2f-b7d1-5241a341dc8e None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:22.952485 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8578b-76e3-4c2f-b7d1-5241a341dc8e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:22.952485 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8578b-76e3-4c2f-b7d1-5241a341dc8e None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:22.953875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 661/1327] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:22.959249 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1eb916-f5e3-449c-bf22-eb87c3086b0f None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:22.959646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1eb916-f5e3-449c-bf22-eb87c3086b0f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:22.959813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1eb916-f5e3-449c-bf22-eb87c3086b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:23.024156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-fa1eb916-f5e3-449c-bf22-eb87c3086b0f None None] MFA Rules not processed for user `bfcb42b66d894bf19c19d3ce4885a45f`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:23.025595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-fa1eb916-f5e3-449c-bf22-eb87c3086b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:23.119288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 667/1328] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:23.156047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8578b-76e3-4c2f-b7d1-5241a341dc8e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:23.157589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c3a8578b-76e3-4c2f-b7d1-5241a341dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:23.258216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8578b-76e3-4c2f-b7d1-5241a341dc8e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:23.329317 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb9dd1-7e2a-433c-a622-ba17c4c34da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:23.329989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb9dd1-7e2a-433c-a622-ba17c4c34da6 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:23.330266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb9dd1-7e2a-433c-a622-ba17c4c34da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:23.330573 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb9dd1-7e2a-433c-a622-ba17c4c34da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:23.332176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-11fb9dd1-7e2a-433c-a622-ba17c4c34da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:23.436959 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb9dd1-7e2a-433c-a622-ba17c4c34da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:23.438335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb9dd1-7e2a-433c-a622-ba17c4c34da6 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:23.456050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 662/1329] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:25.913983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19541601-8ba7-40ab-9baa-6c5f4b9ac990 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:25.914525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19541601-8ba7-40ab-9baa-6c5f4b9ac990 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:25.914525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19541601-8ba7-40ab-9baa-6c5f4b9ac990 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:25.915811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 668/1330] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:25.921540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936674a1-a0e1-461f-b102-576cb2743db2 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:25.921985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936674a1-a0e1-461f-b102-576cb2743db2 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:25.922101 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936674a1-a0e1-461f-b102-576cb2743db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:25.997986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-936674a1-a0e1-461f-b102-576cb2743db2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:25.999281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-936674a1-a0e1-461f-b102-576cb2743db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:26.098168 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 663/1331] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:26.148691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f6d9a-dfb4-4659-8832-45cf09f5b7da None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:26.149006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f6d9a-dfb4-4659-8832-45cf09f5b7da None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:26.149284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f6d9a-dfb4-4659-8832-45cf09f5b7da None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:26.150692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 669/1332] 10.222.0.61 () {54 vars in 964 bytes} [Sat May 14 15:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:26.156815 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422fdb4-c872-4dfe-8a38-dfb689e158c9 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:26.157098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422fdb4-c872-4dfe-8a38-dfb689e158c9 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:26.157367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422fdb4-c872-4dfe-8a38-dfb689e158c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:26.247649 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6422fdb4-c872-4dfe-8a38-dfb689e158c9 None None] MFA Rules not processed for user `abfc1e35362a4495a05475878db260f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:26.248842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6422fdb4-c872-4dfe-8a38-dfb689e158c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:26.328210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 664/1333] 10.222.0.61 () {58 vars in 1061 bytes} [Sat May 14 15:38:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:38:26.338300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f6d9a-dfb4-4659-8832-45cf09f5b7da None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:26.339881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-248f6d9a-dfb4-4659-8832-45cf09f5b7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:26.440130 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f6d9a-dfb4-4659-8832-45cf09f5b7da None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:26.516161 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf5da1-f87c-4883-8fef-0d8c13bec646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:26.516730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5da1-f87c-4883-8fef-0d8c13bec646 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:26.517656 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5da1-f87c-4883-8fef-0d8c13bec646 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:26.517937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf5da1-f87c-4883-8fef-0d8c13bec646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:26.519652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9eaf5da1-f87c-4883-8fef-0d8c13bec646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:26.635279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf5da1-f87c-4883-8fef-0d8c13bec646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:26.636731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf5da1-f87c-4883-8fef-0d8c13bec646 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:26.655929 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 670/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:29.136793 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8adae-c5f9-4384-bef2-05f7014f2b1b None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:29.137308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8adae-c5f9-4384-bef2-05f7014f2b1b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:29.137308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8adae-c5f9-4384-bef2-05f7014f2b1b None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:29.138720 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 665/1335] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:29.144120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39f79-2dce-495d-90d8-2e5fc9e6f298 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:29.144546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39f79-2dce-495d-90d8-2e5fc9e6f298 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:29.144680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39f79-2dce-495d-90d8-2e5fc9e6f298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:29.206646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4ae39f79-2dce-495d-90d8-2e5fc9e6f298 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:29.207838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4ae39f79-2dce-495d-90d8-2e5fc9e6f298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:29.304504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 671/1336] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:29.343534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8adae-c5f9-4384-bef2-05f7014f2b1b None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:29.345556 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-fdf8adae-c5f9-4384-bef2-05f7014f2b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:29.446814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8adae-c5f9-4384-bef2-05f7014f2b1b None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:29.517285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9633-59c6-46cc-bfcd-2229a7bf5553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:29.517849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9633-59c6-46cc-bfcd-2229a7bf5553 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:29.518127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9633-59c6-46cc-bfcd-2229a7bf5553 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:29.518426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9633-59c6-46cc-bfcd-2229a7bf5553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:29.520060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-60bc9633-59c6-46cc-bfcd-2229a7bf5553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:29.624498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc9633-59c6-46cc-bfcd-2229a7bf5553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:29.625916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc9633-59c6-46cc-bfcd-2229a7bf5553 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:29.644000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 666/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:32.444709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcd109-eb11-428d-b5c5-97a38d786f66 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:32.445275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcd109-eb11-428d-b5c5-97a38d786f66 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:32.445275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcd109-eb11-428d-b5c5-97a38d786f66 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:32.446659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 672/1338] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:32.452177 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc42d-1c48-4f08-ba65-44ef9a23745d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:32.452615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc42d-1c48-4f08-ba65-44ef9a23745d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:32.452735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970bc42d-1c48-4f08-ba65-44ef9a23745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:32.514420 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-970bc42d-1c48-4f08-ba65-44ef9a23745d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:32.515610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-970bc42d-1c48-4f08-ba65-44ef9a23745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:32.606918 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 667/1339] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:32.642981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcd109-eb11-428d-b5c5-97a38d786f66 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:32.644511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8efcd109-eb11-428d-b5c5-97a38d786f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:32.741744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efcd109-eb11-428d-b5c5-97a38d786f66 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:32.811172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d633db7-2450-41c5-8dcc-2865e6a79d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:32.811816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d633db7-2450-41c5-8dcc-2865e6a79d7c service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:32.812098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d633db7-2450-41c5-8dcc-2865e6a79d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:32.812370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d633db7-2450-41c5-8dcc-2865e6a79d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:32.815097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4d633db7-2450-41c5-8dcc-2865e6a79d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:32.920710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d633db7-2450-41c5-8dcc-2865e6a79d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:32.922135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d633db7-2450-41c5-8dcc-2865e6a79d7c service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:32.940651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 673/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:37.264259 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18a933-4009-4ac6-ae65-d4e5fcd57a2f None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:37.264784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18a933-4009-4ac6-ae65-d4e5fcd57a2f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:37.264784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18a933-4009-4ac6-ae65-d4e5fcd57a2f None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:37.266092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 668/1341] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:37.272115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9395d5-1bad-4964-a37c-43e5d24a85d5 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:37.272978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9395d5-1bad-4964-a37c-43e5d24a85d5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:37.273459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9395d5-1bad-4964-a37c-43e5d24a85d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:37.344588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-ef9395d5-1bad-4964-a37c-43e5d24a85d5 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:37.345817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ef9395d5-1bad-4964-a37c-43e5d24a85d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:37.446332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 674/1342] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:37.484185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18a933-4009-4ac6-ae65-d4e5fcd57a2f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:37.486872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4a18a933-4009-4ac6-ae65-d4e5fcd57a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:37.581383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18a933-4009-4ac6-ae65-d4e5fcd57a2f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:37.585064 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782e5b6-4831-4aee-842b-3af0efdd0060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:37.585738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782e5b6-4831-4aee-842b-3af0efdd0060 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:37.586018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782e5b6-4831-4aee-842b-3af0efdd0060 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:37.586288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782e5b6-4831-4aee-842b-3af0efdd0060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:37.595990 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782e5b6-4831-4aee-842b-3af0efdd0060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:37.597419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782e5b6-4831-4aee-842b-3af0efdd0060 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:37.607063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 669/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:40.417014 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e138a-1dfa-45fb-88e7-3133f00cb18f None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:40.417547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e138a-1dfa-45fb-88e7-3133f00cb18f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:40.417547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e138a-1dfa-45fb-88e7-3133f00cb18f None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:40.418905 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 675/1344] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:40.424893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3b88-345c-40d9-9a8b-d43001a138fd None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:40.425340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3b88-345c-40d9-9a8b-d43001a138fd None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:40.425443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3b88-345c-40d9-9a8b-d43001a138fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:40.452721 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-d93e3b88-345c-40d9-9a8b-d43001a138fd None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:40.454006 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d93e3b88-345c-40d9-9a8b-d43001a138fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:40.531023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 670/1345] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:40.568233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e138a-1dfa-45fb-88e7-3133f00cb18f None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:40.578541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e138a-1dfa-45fb-88e7-3133f00cb18f None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:40.582112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36234b-11cb-4a04-a504-3819b5f8bf08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:40.582779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36234b-11cb-4a04-a504-3819b5f8bf08 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:40.583059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36234b-11cb-4a04-a504-3819b5f8bf08 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:40.583438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36234b-11cb-4a04-a504-3819b5f8bf08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:40.591983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36234b-11cb-4a04-a504-3819b5f8bf08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:40.593402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36234b-11cb-4a04-a504-3819b5f8bf08 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:40.603564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 676/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:44.922746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ff381-a5f7-4232-a399-70704fd9baa8 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:44.923397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ff381-a5f7-4232-a399-70704fd9baa8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:44.923397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ff381-a5f7-4232-a399-70704fd9baa8 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:44.924733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 671/1347] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:44.930172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1920d-1907-4813-a938-cd513ee6e18a None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:44.930649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1920d-1907-4813-a938-cd513ee6e18a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:44.930820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1920d-1907-4813-a938-cd513ee6e18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:44.948452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-73e1920d-1907-4813-a938-cd513ee6e18a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:44.949642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-73e1920d-1907-4813-a938-cd513ee6e18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:44.958062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 677/1348] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:44.995984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ff381-a5f7-4232-a399-70704fd9baa8 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:38:45.007236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ff381-a5f7-4232-a399-70704fd9baa8 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:38:45.010717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f30ea5-91ff-4759-baed-456b22769be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:38:45.011353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f30ea5-91ff-4759-baed-456b22769be7 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:45.011770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f30ea5-91ff-4759-baed-456b22769be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:45.011969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f30ea5-91ff-4759-baed-456b22769be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:45.022825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f30ea5-91ff-4759-baed-456b22769be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:38:45.024362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f30ea5-91ff-4759-baed-456b22769be7 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:38:45.034057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 672/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:38:50.483651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7b25-0ae9-4611-b616-9fadd8d5fa71 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:50.484207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7b25-0ae9-4611-b616-9fadd8d5fa71 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:50.484292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d7b25-0ae9-4611-b616-9fadd8d5fa71 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:50.486360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 678/1350] 10.222.0.61 () {54 vars in 921 bytes} [Sat May 14 15:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:50.491597 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357dad4-b6b1-4eaa-9fa4-40561c75a646 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:50.492017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357dad4-b6b1-4eaa-9fa4-40561c75a646 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:50.492286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357dad4-b6b1-4eaa-9fa4-40561c75a646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:50.579245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-9357dad4-b6b1-4eaa-9fa4-40561c75a646 None None] MFA Rules not processed for user `8fac310b740a40718191e905723222ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:50.581276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9357dad4-b6b1-4eaa-9fa4-40561c75a646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:50.713961 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 673/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Sat May 14 15:38:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:54.790802 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16311f-422f-4476-9f66-b2982fb0a240 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:54.791330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16311f-422f-4476-9f66-b2982fb0a240 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:54.791628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16311f-422f-4476-9f66-b2982fb0a240 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:54.793149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 679/1352] 10.222.0.61 () {54 vars in 921 bytes} [Sat May 14 15:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:54.799397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45ae17-0cc6-4392-b544-c01eaef6ceff None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:54.800232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45ae17-0cc6-4392-b544-c01eaef6ceff None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:54.800590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45ae17-0cc6-4392-b544-c01eaef6ceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:54.820052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-4e45ae17-0cc6-4392-b544-c01eaef6ceff None None] MFA Rules not processed for user `8fac310b740a40718191e905723222ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:54.821249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4e45ae17-0cc6-4392-b544-c01eaef6ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:54.836481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 674/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Sat May 14 15:38:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:38:56.396952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55d404-bcf6-49e2-a788-4c4d778ef1b1 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:56.397515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55d404-bcf6-49e2-a788-4c4d778ef1b1 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:56.397515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55d404-bcf6-49e2-a788-4c4d778ef1b1 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:56.398898 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 680/1354] 10.222.0.61 () {54 vars in 921 bytes} [Sat May 14 15:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:38:56.403983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec066c0f-8681-4ca2-bb68-14a1e39e153f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:38:56.404427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec066c0f-8681-4ca2-bb68-14a1e39e153f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:38:56.404538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec066c0f-8681-4ca2-bb68-14a1e39e153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:38:56.424600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-ec066c0f-8681-4ca2-bb68-14a1e39e153f None None] MFA Rules not processed for user `8fac310b740a40718191e905723222ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:38:56.425798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ec066c0f-8681-4ca2-bb68-14a1e39e153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:38:56.434799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 675/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Sat May 14 15:38:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:39:00.410964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5116b8a-edca-412a-9e46-d89dcae4837b None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:00.411471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5116b8a-edca-412a-9e46-d89dcae4837b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:00.411471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5116b8a-edca-412a-9e46-d89dcae4837b None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:00.416986 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 681/1356] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:00.418362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beda8a-c09f-4238-acd3-ae2a08448e10 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:00.418964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beda8a-c09f-4238-acd3-ae2a08448e10 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:00.418964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beda8a-c09f-4238-acd3-ae2a08448e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:00.441284 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-66beda8a-c09f-4238-acd3-ae2a08448e10 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:00.443204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-66beda8a-c09f-4238-acd3-ae2a08448e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:00.451324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 676/1357] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:39:00.499009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541288-3c45-4eb8-9cbf-61fe395d80d0 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:00.499294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541288-3c45-4eb8-9cbf-61fe395d80d0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:00.499773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541288-3c45-4eb8-9cbf-61fe395d80d0 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:00.501985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 682/1358] 10.222.0.61 () {54 vars in 961 bytes} [Sat May 14 15:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:00.507315 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526c13-cd10-4bfc-8c80-dcc5464b23b7 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:00.507670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526c13-cd10-4bfc-8c80-dcc5464b23b7 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:00.508019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77526c13-cd10-4bfc-8c80-dcc5464b23b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:00.555088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-77526c13-cd10-4bfc-8c80-dcc5464b23b7 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:00.556252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-77526c13-cd10-4bfc-8c80-dcc5464b23b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:00.635356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 677/1359] 10.222.0.61 () {58 vars in 1058 bytes} [Sat May 14 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:00.643294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03541288-3c45-4eb8-9cbf-61fe395d80d0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:00.657464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03541288-3c45-4eb8-9cbf-61fe395d80d0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:00.663183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7da5c-6d29-4f32-ba16-05207d7dd3f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:00.663848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7da5c-6d29-4f32-ba16-05207d7dd3f7 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:00.664202 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7da5c-6d29-4f32-ba16-05207d7dd3f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:00.664548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7da5c-6d29-4f32-ba16-05207d7dd3f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:00.675073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7da5c-6d29-4f32-ba16-05207d7dd3f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:00.676750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7da5c-6d29-4f32-ba16-05207d7dd3f7 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:00.686286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 683/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:03.132464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf825-8a44-494f-bbfe-d3c17d765178 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:03.132987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf825-8a44-494f-bbfe-d3c17d765178 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:03.132987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecf825-8a44-494f-bbfe-d3c17d765178 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:03.134479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 678/1361] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:03.139756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddcd1e-12cd-498e-b852-a59da9e494eb None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:03.140170 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddcd1e-12cd-498e-b852-a59da9e494eb None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:03.140301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddcd1e-12cd-498e-b852-a59da9e494eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:03.159674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-0eddcd1e-12cd-498e-b852-a59da9e494eb None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:03.161004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0eddcd1e-12cd-498e-b852-a59da9e494eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:03.170636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 684/1362] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:03.214415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf825-8a44-494f-bbfe-d3c17d765178 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:03.233105 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecf825-8a44-494f-bbfe-d3c17d765178 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:03.239481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10a467-e5ba-42d7-b8ac-2e62f10ff46f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:03.240492 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a467-e5ba-42d7-b8ac-2e62f10ff46f service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:03.240995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a467-e5ba-42d7-b8ac-2e62f10ff46f service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:03.241472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a467-e5ba-42d7-b8ac-2e62f10ff46f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:03.253410 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10a467-e5ba-42d7-b8ac-2e62f10ff46f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:03.255193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10a467-e5ba-42d7-b8ac-2e62f10ff46f service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:03.265255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 679/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:05.856145 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26835563-5801-4abf-abc1-801c85a31486 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:05.856919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26835563-5801-4abf-abc1-801c85a31486 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:05.857018 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26835563-5801-4abf-abc1-801c85a31486 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:05.858351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 685/1364] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:39:05.864284 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8750123-b49a-485a-9491-75286d3f7ed1 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:05.864718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8750123-b49a-485a-9491-75286d3f7ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:05.864822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8750123-b49a-485a-9491-75286d3f7ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:05.884081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-f8750123-b49a-485a-9491-75286d3f7ed1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:05.885262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f8750123-b49a-485a-9491-75286d3f7ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:05.893954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 680/1365] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:05.940821 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452ed7c-638a-4aa8-87c2-7b435dbdb3b8 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:05.940821 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452ed7c-638a-4aa8-87c2-7b435dbdb3b8 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:05.941156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452ed7c-638a-4aa8-87c2-7b435dbdb3b8 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:05.943100 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 686/1366] 10.222.0.61 () {54 vars in 961 bytes} [Sat May 14 15:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:05.949715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fc492-1f26-410f-b48a-e6139f9166c1 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:05.950205 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fc492-1f26-410f-b48a-e6139f9166c1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:05.950518 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fc492-1f26-410f-b48a-e6139f9166c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:05.968697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-896fc492-1f26-410f-b48a-e6139f9166c1 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:05.970610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-896fc492-1f26-410f-b48a-e6139f9166c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:05.979754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 681/1367] 10.222.0.61 () {58 vars in 1058 bytes} [Sat May 14 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:05.988048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452ed7c-638a-4aa8-87c2-7b435dbdb3b8 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:06.002858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452ed7c-638a-4aa8-87c2-7b435dbdb3b8 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:06.008247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d565c-e82e-42da-96b2-e218398c6d9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:06.008827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d565c-e82e-42da-96b2-e218398c6d9a service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:06.009108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d565c-e82e-42da-96b2-e218398c6d9a service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:06.009383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d565c-e82e-42da-96b2-e218398c6d9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:06.018816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d565c-e82e-42da-96b2-e218398c6d9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:06.020411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d565c-e82e-42da-96b2-e218398c6d9a service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:06.029626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 687/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:08.397599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e76f-34d2-45dd-8a6e-0f33c85dfff0 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:08.398254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e76f-34d2-45dd-8a6e-0f33c85dfff0 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:08.398386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e76f-34d2-45dd-8a6e-0f33c85dfff0 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:08.400156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 682/1369] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:08.405412 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786f3c-4ce4-41c4-ad3e-87cac479e365 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:08.405858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786f3c-4ce4-41c4-ad3e-87cac479e365 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:08.405965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786f3c-4ce4-41c4-ad3e-87cac479e365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:08.425943 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2c786f3c-4ce4-41c4-ad3e-87cac479e365 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:08.427167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2c786f3c-4ce4-41c4-ad3e-87cac479e365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:08.438201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 688/1370] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:08.486806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00e76f-34d2-45dd-8a6e-0f33c85dfff0 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:08.521150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00e76f-34d2-45dd-8a6e-0f33c85dfff0 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:08.527191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c6628-6974-4638-a530-9d2fd4b3be10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:08.528063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6628-6974-4638-a530-9d2fd4b3be10 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:08.528504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6628-6974-4638-a530-9d2fd4b3be10 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:08.529590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6628-6974-4638-a530-9d2fd4b3be10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:08.538787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c6628-6974-4638-a530-9d2fd4b3be10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:08.541230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c6628-6974-4638-a530-9d2fd4b3be10 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:08.556103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 683/1371] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:08.677949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2eaaf-487a-4256-a06e-1044b712d132 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:08.678432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2eaaf-487a-4256-a06e-1044b712d132 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:08.678812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2eaaf-487a-4256-a06e-1044b712d132 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:08.680336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 689/1372] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:08.686602 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c7eee-122b-4c03-a411-c90aafbdb484 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:08.687033 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c7eee-122b-4c03-a411-c90aafbdb484 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:08.687413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c7eee-122b-4c03-a411-c90aafbdb484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:08.707764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-323c7eee-122b-4c03-a411-c90aafbdb484 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:08.709670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-323c7eee-122b-4c03-a411-c90aafbdb484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:08.720119 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 684/1373] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:09.043232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54015bc4-44f6-41c9-8c98-f99c1e60624a None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:09.043517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54015bc4-44f6-41c9-8c98-f99c1e60624a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:09.043797 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54015bc4-44f6-41c9-8c98-f99c1e60624a None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:09.045169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 690/1374] 10.222.0.61 () {54 vars in 963 bytes} [Sat May 14 15:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:09.050514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c295c4b-5e68-4552-8a2f-95a907f7ebd6 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:09.050802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c295c4b-5e68-4552-8a2f-95a907f7ebd6 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:09.051073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c295c4b-5e68-4552-8a2f-95a907f7ebd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:09.102835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-5c295c4b-5e68-4552-8a2f-95a907f7ebd6 None None] MFA Rules not processed for user `b9b7a0202f394b16800af94487a21ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:09.104023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-5c295c4b-5e68-4552-8a2f-95a907f7ebd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:09.168026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 685/1375] 10.222.0.61 () {58 vars in 1060 bytes} [Sat May 14 15:39:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:09.176473 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54015bc4-44f6-41c9-8c98-f99c1e60624a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:09.187509 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54015bc4-44f6-41c9-8c98-f99c1e60624a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:09.192117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce6ace-e835-4299-bfd8-4193e3469690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:09.192751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6ace-e835-4299-bfd8-4193e3469690 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:09.193030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6ace-e835-4299-bfd8-4193e3469690 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:09.193304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce6ace-e835-4299-bfd8-4193e3469690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:09.202521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce6ace-e835-4299-bfd8-4193e3469690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:09.204746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce6ace-e835-4299-bfd8-4193e3469690 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:09.214693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 691/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:10.888493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d017-0041-4204-9320-bb77fb5ea11c None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:10.889055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d017-0041-4204-9320-bb77fb5ea11c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:10.889055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d017-0041-4204-9320-bb77fb5ea11c None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:10.890462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 686/1377] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:10.897037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bb853-021d-49d7-83a1-81595b0ddbf5 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:10.897577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bb853-021d-49d7-83a1-81595b0ddbf5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:10.897766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bb853-021d-49d7-83a1-81595b0ddbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:10.916769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-247bb853-021d-49d7-83a1-81595b0ddbf5 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:10.917978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-247bb853-021d-49d7-83a1-81595b0ddbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:10.927870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 692/1378] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:39:10.972772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4d017-0041-4204-9320-bb77fb5ea11c None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:10.987583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4d017-0041-4204-9320-bb77fb5ea11c None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:10.993184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f9730-7531-4326-845c-37271a2f7932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:10.993826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9730-7531-4326-845c-37271a2f7932 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:10.994109 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9730-7531-4326-845c-37271a2f7932 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:10.994422 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f9730-7531-4326-845c-37271a2f7932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:11.002810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f9730-7531-4326-845c-37271a2f7932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:11.004411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f9730-7531-4326-845c-37271a2f7932 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:11.013871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 687/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:13.309090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231116d8-af97-4f87-a71c-e0e2158fd6c7 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:13.310078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231116d8-af97-4f87-a71c-e0e2158fd6c7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:13.310529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231116d8-af97-4f87-a71c-e0e2158fd6c7 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:13.312115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 693/1380] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:39:13.317901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d96e0-344a-442c-8850-67599fbea5c8 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:13.318374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d96e0-344a-442c-8850-67599fbea5c8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:13.318479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d96e0-344a-442c-8850-67599fbea5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:13.336829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-983d96e0-344a-442c-8850-67599fbea5c8 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:13.338249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-983d96e0-344a-442c-8850-67599fbea5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:13.352175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 688/1381] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:13.391242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231116d8-af97-4f87-a71c-e0e2158fd6c7 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:13.405701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231116d8-af97-4f87-a71c-e0e2158fd6c7 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:13.411858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64c94e-7038-4056-be5c-bba33263ebf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:13.412616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64c94e-7038-4056-be5c-bba33263ebf3 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:13.413007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64c94e-7038-4056-be5c-bba33263ebf3 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:13.413388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64c94e-7038-4056-be5c-bba33263ebf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:13.422326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64c94e-7038-4056-be5c-bba33263ebf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:13.424115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64c94e-7038-4056-be5c-bba33263ebf3 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:13.433834 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 694/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:39:15.787797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54ef34-9090-49bd-9d0d-2f88b4609423 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:15.788348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54ef34-9090-49bd-9d0d-2f88b4609423 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:15.788348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54ef34-9090-49bd-9d0d-2f88b4609423 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:15.790839 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 689/1383] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:15.795537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a63b87-6af1-4a1b-8d36-825103a98748 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:15.796066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a63b87-6af1-4a1b-8d36-825103a98748 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:15.796066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a63b87-6af1-4a1b-8d36-825103a98748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:15.814890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-a8a63b87-6af1-4a1b-8d36-825103a98748 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:15.816086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a8a63b87-6af1-4a1b-8d36-825103a98748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:15.823904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 695/1384] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:15.865595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54ef34-9090-49bd-9d0d-2f88b4609423 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:15.880946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54ef34-9090-49bd-9d0d-2f88b4609423 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:15.886696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fe741-ff8f-4d55-800f-069c8bbe0a61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:15.887444 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fe741-ff8f-4d55-800f-069c8bbe0a61 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:15.887828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fe741-ff8f-4d55-800f-069c8bbe0a61 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:15.888218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fe741-ff8f-4d55-800f-069c8bbe0a61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:15.897641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fe741-ff8f-4d55-800f-069c8bbe0a61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:15.899380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fe741-ff8f-4d55-800f-069c8bbe0a61 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:15.909540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 690/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:18.388025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852996-6dc1-4698-acdc-bbaf7d93c551 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:18.388582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852996-6dc1-4698-acdc-bbaf7d93c551 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:18.388684 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38852996-6dc1-4698-acdc-bbaf7d93c551 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:18.390268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 696/1386] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:18.397023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706f081-6e73-4e77-bb46-c157fe92390e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:18.397500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706f081-6e73-4e77-bb46-c157fe92390e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:18.397707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706f081-6e73-4e77-bb46-c157fe92390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:18.417541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a706f081-6e73-4e77-bb46-c157fe92390e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:18.418751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a706f081-6e73-4e77-bb46-c157fe92390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:18.429064 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 691/1387] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:18.487159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38852996-6dc1-4698-acdc-bbaf7d93c551 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:18.503408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38852996-6dc1-4698-acdc-bbaf7d93c551 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:18.509504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8074a3-a9b7-4d4d-96db-7b0140509f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:18.510227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8074a3-a9b7-4d4d-96db-7b0140509f70 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:18.510591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8074a3-a9b7-4d4d-96db-7b0140509f70 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:18.510918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8074a3-a9b7-4d4d-96db-7b0140509f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:18.521197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8074a3-a9b7-4d4d-96db-7b0140509f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:18.523108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8074a3-a9b7-4d4d-96db-7b0140509f70 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:18.534829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 697/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:39:20.914533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3edf7-15e2-4223-a3a8-24bdd971767f None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:20.915198 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3edf7-15e2-4223-a3a8-24bdd971767f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:20.915198 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3edf7-15e2-4223-a3a8-24bdd971767f None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:20.916466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 692/1389] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:39:20.921921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957ccf2-9bcc-4bca-90c7-f3fcecc60105 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:20.922413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957ccf2-9bcc-4bca-90c7-f3fcecc60105 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:20.922523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957ccf2-9bcc-4bca-90c7-f3fcecc60105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:20.939941 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-6957ccf2-9bcc-4bca-90c7-f3fcecc60105 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:20.941152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6957ccf2-9bcc-4bca-90c7-f3fcecc60105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:20.949000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 698/1390] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:20.994376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3edf7-15e2-4223-a3a8-24bdd971767f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:21.009895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3edf7-15e2-4223-a3a8-24bdd971767f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:21.015963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389c5fd-e9e4-44cd-8d3b-303b85bf17ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:21.016727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389c5fd-e9e4-44cd-8d3b-303b85bf17ee service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:21.016985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389c5fd-e9e4-44cd-8d3b-303b85bf17ee service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:21.017419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389c5fd-e9e4-44cd-8d3b-303b85bf17ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:21.026794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389c5fd-e9e4-44cd-8d3b-303b85bf17ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:21.028432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389c5fd-e9e4-44cd-8d3b-303b85bf17ee service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:21.038880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 693/1391] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:23.311225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5bcf5-3523-414c-9ba5-2c830538bd25 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:23.311798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5bcf5-3523-414c-9ba5-2c830538bd25 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:23.311798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5bcf5-3523-414c-9ba5-2c830538bd25 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:23.313338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 699/1392] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:23.318526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f67436-3968-46c4-8906-88eaaae8aeba None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:23.318948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f67436-3968-46c4-8906-88eaaae8aeba None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:23.319086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f67436-3968-46c4-8906-88eaaae8aeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:23.336688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-f9f67436-3968-46c4-8906-88eaaae8aeba None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:23.337938 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f9f67436-3968-46c4-8906-88eaaae8aeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:23.346371 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 694/1393] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:23.389334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5bcf5-3523-414c-9ba5-2c830538bd25 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:23.403484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5bcf5-3523-414c-9ba5-2c830538bd25 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:23.409563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dd38c-a4da-4662-a409-d987fb37d07f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:23.410219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd38c-a4da-4662-a409-d987fb37d07f service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:23.410526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd38c-a4da-4662-a409-d987fb37d07f service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:23.410798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd38c-a4da-4662-a409-d987fb37d07f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:23.418784 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dd38c-a4da-4662-a409-d987fb37d07f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:23.420347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dd38c-a4da-4662-a409-d987fb37d07f service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:23.430065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 700/1394] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:24.944313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541f68-e791-4733-a470-486bf4dd1ece None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:24.944843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541f68-e791-4733-a470-486bf4dd1ece None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:24.944843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0541f68-e791-4733-a470-486bf4dd1ece None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:24.946217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 695/1395] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:24.951595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d88fe-3b7a-4e9d-89ba-67d20d80c240 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:24.952026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d88fe-3b7a-4e9d-89ba-67d20d80c240 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:24.952283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d88fe-3b7a-4e9d-89ba-67d20d80c240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:24.970196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-a22d88fe-3b7a-4e9d-89ba-67d20d80c240 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:24.971441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a22d88fe-3b7a-4e9d-89ba-67d20d80c240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:24.979275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 701/1396] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:25.035056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a6f50-7a17-4a75-95ed-2b63cce8c1bb None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:25.035345 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a6f50-7a17-4a75-95ed-2b63cce8c1bb None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:25.035624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a6f50-7a17-4a75-95ed-2b63cce8c1bb None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:25.036985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 696/1397] 10.222.0.61 () {54 vars in 962 bytes} [Sat May 14 15:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:25.041964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b5fb9-2e7f-401f-a7e7-37a5688d4323 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:25.042256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b5fb9-2e7f-401f-a7e7-37a5688d4323 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:25.042572 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b5fb9-2e7f-401f-a7e7-37a5688d4323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:25.089148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-e51b5fb9-2e7f-401f-a7e7-37a5688d4323 None None] MFA Rules not processed for user `d346be1ef7604f1f87371f5d322fd010`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:25.090257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e51b5fb9-2e7f-401f-a7e7-37a5688d4323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:25.149433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 702/1398] 10.222.0.61 () {58 vars in 1059 bytes} [Sat May 14 15:39:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:25.157558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a6f50-7a17-4a75-95ed-2b63cce8c1bb None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:25.168003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a6f50-7a17-4a75-95ed-2b63cce8c1bb None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:25.171438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787574fc-51b8-4e1e-adb6-6f45ca91d46a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd346be1ef7604f1f87371f5d322fd010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:25.172104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787574fc-51b8-4e1e-adb6-6f45ca91d46a service glance] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:25.172379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787574fc-51b8-4e1e-adb6-6f45ca91d46a service glance] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:25.172675 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787574fc-51b8-4e1e-adb6-6f45ca91d46a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:25.181290 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787574fc-51b8-4e1e-adb6-6f45ca91d46a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:25.182754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787574fc-51b8-4e1e-adb6-6f45ca91d46a service glance] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:25.192021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 697/1399] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:39:25.605796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647314e1-a1c0-4844-9bb5-7be1e1bd6fae None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:25.606082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647314e1-a1c0-4844-9bb5-7be1e1bd6fae None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:25.606642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647314e1-a1c0-4844-9bb5-7be1e1bd6fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:25.653691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-647314e1-a1c0-4844-9bb5-7be1e1bd6fae None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:25.654820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-647314e1-a1c0-4844-9bb5-7be1e1bd6fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:25.688582 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999904-0265-4e25-a372-e3ddd0601747 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:25.688954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999904-0265-4e25-a372-e3ddd0601747 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:25.689238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999904-0265-4e25-a372-e3ddd0601747 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:25.690672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 698/1400] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:39:25.695728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd1526-ab1d-4660-8555-bb2782581031 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:25.696281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd1526-ab1d-4660-8555-bb2782581031 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:25.696281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd1526-ab1d-4660-8555-bb2782581031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:25.713134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-9dcd1526-ab1d-4660-8555-bb2782581031 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:25.714333 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9dcd1526-ab1d-4660-8555-bb2782581031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:25.717832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 703/1401] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:39:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:25.722574 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 699/1402] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:39:25.763858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c483359-baf7-4112-9f26-7f6fd52a22e3 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:25.764150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c483359-baf7-4112-9f26-7f6fd52a22e3 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:25.764432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c483359-baf7-4112-9f26-7f6fd52a22e3 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:25.766244 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 704/1403] 10.222.0.61 () {54 vars in 942 bytes} [Sat May 14 15:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:25.766609 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd1526-ab1d-4660-8555-bb2782581031 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:25.772620 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b9c43-2d83-4e2e-b26c-aa7f2a251f7e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:25.772909 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b9c43-2d83-4e2e-b26c-aa7f2a251f7e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:25.773191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b9c43-2d83-4e2e-b26c-aa7f2a251f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:25.779162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd1526-ab1d-4660-8555-bb2782581031 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:25.785071 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422a649-0d4f-4206-a226-878ed7e419b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:25.785795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422a649-0d4f-4206-a226-878ed7e419b7 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:25.786080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422a649-0d4f-4206-a226-878ed7e419b7 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:25.786385 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422a649-0d4f-4206-a226-878ed7e419b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:25.794719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422a649-0d4f-4206-a226-878ed7e419b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:25.796291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422a649-0d4f-4206-a226-878ed7e419b7 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:25.806140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 700/1404] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:39:25.824310 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2c7b9c43-2d83-4e2e-b26c-aa7f2a251f7e None None] MFA Rules not processed for user `1713718ff95744b9bd42f21d4ec8bb91`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:25.825682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2c7b9c43-2d83-4e2e-b26c-aa7f2a251f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:25.913598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 705/1405] 10.222.0.61 () {58 vars in 1039 bytes} [Sat May 14 15:39:25 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:39:25.927580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422a649-0d4f-4206-a226-878ed7e419b7 service nova] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:25.939554 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422a649-0d4f-4206-a226-878ed7e419b7 service nova] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:25.944986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73a5f4-5864-43a3-9f5d-8a02aef9819e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:25.945769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73a5f4-5864-43a3-9f5d-8a02aef9819e service swift] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:25.946060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73a5f4-5864-43a3-9f5d-8a02aef9819e service swift] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:25.946278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73a5f4-5864-43a3-9f5d-8a02aef9819e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:25.957025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73a5f4-5864-43a3-9f5d-8a02aef9819e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:25.958860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73a5f4-5864-43a3-9f5d-8a02aef9819e service swift] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:25.969178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 701/1406] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:39:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:39:28.184536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934865e-8a6b-42f7-82db-566a21af9429 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:28.185139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934865e-8a6b-42f7-82db-566a21af9429 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:28.185139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934865e-8a6b-42f7-82db-566a21af9429 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:28.186630 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 706/1407] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:28.191861 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae2cae-4648-4c35-87aa-18dd425857d0 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:28.192292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae2cae-4648-4c35-87aa-18dd425857d0 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:28.192407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae2cae-4648-4c35-87aa-18dd425857d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:28.211628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-19ae2cae-4648-4c35-87aa-18dd425857d0 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:28.213109 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-19ae2cae-4648-4c35-87aa-18dd425857d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:28.223173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 702/1408] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:28.267286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934865e-8a6b-42f7-82db-566a21af9429 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:28.281997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934865e-8a6b-42f7-82db-566a21af9429 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:28.287830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5587c-9402-4158-b1b5-cb4be79b7315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:28.289139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5587c-9402-4158-b1b5-cb4be79b7315 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:28.289426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5587c-9402-4158-b1b5-cb4be79b7315 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:28.289704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5587c-9402-4158-b1b5-cb4be79b7315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:28.300232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5587c-9402-4158-b1b5-cb4be79b7315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:28.301991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5587c-9402-4158-b1b5-cb4be79b7315 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:28.316432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 707/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:49.243134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f2e6-dcb2-48e7-8424-7e63949f3e90 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:49.243738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f2e6-dcb2-48e7-8424-7e63949f3e90 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:49.243738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383f2e6-dcb2-48e7-8424-7e63949f3e90 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:49.244996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 703/1410] 10.222.0.61 () {54 vars in 918 bytes} [Sat May 14 15:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:49.250222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb929a-d083-4f9d-82ca-dc72f98d2013 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:49.250745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb929a-d083-4f9d-82ca-dc72f98d2013 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:49.250853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb929a-d083-4f9d-82ca-dc72f98d2013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:49.268653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2bdb929a-d083-4f9d-82ca-dc72f98d2013 None None] MFA Rules not processed for user `8fac310b740a40718191e905723222ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:49.269827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2bdb929a-d083-4f9d-82ca-dc72f98d2013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:49.278076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 708/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Sat May 14 15:39:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:49.292728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c519-b6a5-408c-8816-c7dd752c75c6 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:49.293016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c519-b6a5-408c-8816-c7dd752c75c6 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:49.293296 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9c519-b6a5-408c-8816-c7dd752c75c6 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:49.294695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 704/1412] 10.222.0.61 () {54 vars in 918 bytes} [Sat May 14 15:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:49.299444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472190b6-e819-491f-bb93-6c2986241d82 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:49.299728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472190b6-e819-491f-bb93-6c2986241d82 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:49.300002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472190b6-e819-491f-bb93-6c2986241d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:49.317528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-472190b6-e819-491f-bb93-6c2986241d82 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:49.318746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-472190b6-e819-491f-bb93-6c2986241d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:49.328264 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 709/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Sat May 14 15:39:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:51.985392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472cbc1-be8c-4027-bccc-3cb7acf639a1 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:51.985835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472cbc1-be8c-4027-bccc-3cb7acf639a1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:51.985943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472cbc1-be8c-4027-bccc-3cb7acf639a1 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:51.987357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:39:51.992617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489ff7c-6aac-4033-b987-d8cea660c96f None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:51.993068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489ff7c-6aac-4033-b987-d8cea660c96f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:51.993166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489ff7c-6aac-4033-b987-d8cea660c96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:52.011225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9489ff7c-6aac-4033-b987-d8cea660c96f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:52.012406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9489ff7c-6aac-4033-b987-d8cea660c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:52.020701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:52.063056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472cbc1-be8c-4027-bccc-3cb7acf639a1 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:52.076875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472cbc1-be8c-4027-bccc-3cb7acf639a1 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:52.082394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da153315-3395-4054-af27-00c6a72a0cc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:52.083021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153315-3395-4054-af27-00c6a72a0cc4 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:52.083302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153315-3395-4054-af27-00c6a72a0cc4 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:52.083577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153315-3395-4054-af27-00c6a72a0cc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:52.091518 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da153315-3395-4054-af27-00c6a72a0cc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:52.093693 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da153315-3395-4054-af27-00c6a72a0cc4 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:52.102827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 706/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:53.095160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49adad-656a-44fe-b438-58ce744d73a8 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:53.095691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49adad-656a-44fe-b438-58ce744d73a8 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:53.095691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49adad-656a-44fe-b438-58ce744d73a8 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:53.097007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:53.101983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef07116-6b99-4c62-9006-08bd24dcb664 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:53.102414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef07116-6b99-4c62-9006-08bd24dcb664 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:53.102581 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef07116-6b99-4c62-9006-08bd24dcb664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:53.120215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-aef07116-6b99-4c62-9006-08bd24dcb664 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:53.121427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-aef07116-6b99-4c62-9006-08bd24dcb664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:53.129356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:53.293217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49adad-656a-44fe-b438-58ce744d73a8 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:53.307148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49adad-656a-44fe-b438-58ce744d73a8 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:53.312964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a18b77-fd6e-43d9-a7ee-6d76769d14ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:53.313584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a18b77-fd6e-43d9-a7ee-6d76769d14ac service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:53.313860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a18b77-fd6e-43d9-a7ee-6d76769d14ac service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:53.314131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a18b77-fd6e-43d9-a7ee-6d76769d14ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:53.321908 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a18b77-fd6e-43d9-a7ee-6d76769d14ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:53.323501 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a18b77-fd6e-43d9-a7ee-6d76769d14ac service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:53.333108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 712/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:54.272647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091dacd-8cf7-4749-a22a-a9bc522c0d57 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:54.273218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091dacd-8cf7-4749-a22a-a9bc522c0d57 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:54.273218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091dacd-8cf7-4749-a22a-a9bc522c0d57 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:54.274501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:54.279491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cdf5a-a906-4550-9d53-3c31074e9497 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:54.279878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cdf5a-a906-4550-9d53-3c31074e9497 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:54.280595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cdf5a-a906-4550-9d53-3c31074e9497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:54.298668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-6f3cdf5a-a906-4550-9d53-3c31074e9497 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:54.299845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6f3cdf5a-a906-4550-9d53-3c31074e9497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:54.307420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:54.454795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091dacd-8cf7-4749-a22a-a9bc522c0d57 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:54.469649 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091dacd-8cf7-4749-a22a-a9bc522c0d57 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:54.474958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2eb69-021e-4953-b2c8-de77fa1ce642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:54.475584 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2eb69-021e-4953-b2c8-de77fa1ce642 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:54.475864 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2eb69-021e-4953-b2c8-de77fa1ce642 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:54.476139 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2eb69-021e-4953-b2c8-de77fa1ce642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:54.484460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2eb69-021e-4953-b2c8-de77fa1ce642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:54.486032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2eb69-021e-4953-b2c8-de77fa1ce642 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:54.495136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 709/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:55.416613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89896313-85ba-4ebb-b61c-cb3c3c77b778 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:55.417184 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89896313-85ba-4ebb-b61c-cb3c3c77b778 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:55.417184 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89896313-85ba-4ebb-b61c-cb3c3c77b778 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:55.418559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:55.424163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162246f-e0fe-4831-8c76-8f4fd8ea77db None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:55.424593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162246f-e0fe-4831-8c76-8f4fd8ea77db None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:55.424756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162246f-e0fe-4831-8c76-8f4fd8ea77db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:55.442766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b162246f-e0fe-4831-8c76-8f4fd8ea77db None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:55.443940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b162246f-e0fe-4831-8c76-8f4fd8ea77db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:55.451544 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:55.600081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89896313-85ba-4ebb-b61c-cb3c3c77b778 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:55.615106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89896313-85ba-4ebb-b61c-cb3c3c77b778 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:55.620316 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae191103-224a-4ec4-8642-693cfd4ce767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:55.620940 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae191103-224a-4ec4-8642-693cfd4ce767 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:55.621219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae191103-224a-4ec4-8642-693cfd4ce767 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:55.621493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae191103-224a-4ec4-8642-693cfd4ce767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:55.629244 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae191103-224a-4ec4-8642-693cfd4ce767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:55.630852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae191103-224a-4ec4-8642-693cfd4ce767 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:55.640018 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 715/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:56.565191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196eeca-5383-40ad-8da9-c622b0d09376 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:56.565777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196eeca-5383-40ad-8da9-c622b0d09376 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:56.565777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196eeca-5383-40ad-8da9-c622b0d09376 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:56.567144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:56.572017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf7ad7-b8cf-4ace-b548-df09a4a32fa2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:56.572409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf7ad7-b8cf-4ace-b548-df09a4a32fa2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:56.572548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf7ad7-b8cf-4ace-b548-df09a4a32fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:56.590053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-8acf7ad7-b8cf-4ace-b548-df09a4a32fa2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:56.591264 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8acf7ad7-b8cf-4ace-b548-df09a4a32fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:56.599561 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:56.748379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196eeca-5383-40ad-8da9-c622b0d09376 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:56.762429 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196eeca-5383-40ad-8da9-c622b0d09376 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:56.768403 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc0ba4-0a3a-4df4-9846-eb97a58c3992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:56.769030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc0ba4-0a3a-4df4-9846-eb97a58c3992 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:56.769310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc0ba4-0a3a-4df4-9846-eb97a58c3992 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:56.769583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc0ba4-0a3a-4df4-9846-eb97a58c3992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:56.777416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc0ba4-0a3a-4df4-9846-eb97a58c3992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:56.779029 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc0ba4-0a3a-4df4-9846-eb97a58c3992 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:56.788676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 712/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:57.661670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b7b3-e15d-4304-9d95-7a002764b0e8 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:57.662290 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b7b3-e15d-4304-9d95-7a002764b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:57.662290 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b7b3-e15d-4304-9d95-7a002764b0e8 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:57.663665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:57.668671 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8530f5-af7d-42ce-8771-28c2898c550b None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:57.669066 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8530f5-af7d-42ce-8771-28c2898c550b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:57.669219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8530f5-af7d-42ce-8771-28c2898c550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:57.686709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-bb8530f5-af7d-42ce-8771-28c2898c550b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:57.687866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-bb8530f5-af7d-42ce-8771-28c2898c550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:57.695420 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:57.844514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3b7b3-e15d-4304-9d95-7a002764b0e8 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:57.859665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3b7b3-e15d-4304-9d95-7a002764b0e8 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:57.864966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced3593-6622-41f3-8c97-f7dc039195ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:57.865623 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced3593-6622-41f3-8c97-f7dc039195ac service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:57.865904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced3593-6622-41f3-8c97-f7dc039195ac service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:57.866177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced3593-6622-41f3-8c97-f7dc039195ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:57.873991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced3593-6622-41f3-8c97-f7dc039195ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:57.875656 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced3593-6622-41f3-8c97-f7dc039195ac service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:57.884591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 718/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:58.744885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09fa0-79a5-440a-8779-14e80917f93b None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:58.745430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09fa0-79a5-440a-8779-14e80917f93b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:58.745430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09fa0-79a5-440a-8779-14e80917f93b None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:58.746843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:39:58.752169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d8e2-d1af-4529-bae7-dfa22fe1c185 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:58.752577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d8e2-d1af-4529-bae7-dfa22fe1c185 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:58.752732 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d8e2-d1af-4529-bae7-dfa22fe1c185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:58.770826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-ac94d8e2-d1af-4529-bae7-dfa22fe1c185 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:58.772014 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ac94d8e2-d1af-4529-bae7-dfa22fe1c185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:58.779746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:39:58.929003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09fa0-79a5-440a-8779-14e80917f93b None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:39:58.944178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09fa0-79a5-440a-8779-14e80917f93b None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:39:58.949564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984a1fa-6599-43c4-988f-46e0e253c021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:39:58.950192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984a1fa-6599-43c4-988f-46e0e253c021 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:58.950506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984a1fa-6599-43c4-988f-46e0e253c021 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:58.950782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984a1fa-6599-43c4-988f-46e0e253c021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:58.959127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984a1fa-6599-43c4-988f-46e0e253c021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:39:58.960696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984a1fa-6599-43c4-988f-46e0e253c021 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:39:58.969917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 715/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:39:59.828958 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8fd28-8d32-43e5-b4bd-b65dcc9c22a5 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:59.829503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8fd28-8d32-43e5-b4bd-b65dcc9c22a5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:59.829503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8fd28-8d32-43e5-b4bd-b65dcc9c22a5 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:59.830902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:39:59.835969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d05c-80d7-40ff-8d05-370cf041f9be None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:39:59.836399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d05c-80d7-40ff-8d05-370cf041f9be None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:39:59.836507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d05c-80d7-40ff-8d05-370cf041f9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:39:59.854638 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-75d0d05c-80d7-40ff-8d05-370cf041f9be None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:39:59.855816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-75d0d05c-80d7-40ff-8d05-370cf041f9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:39:59.863849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:00.010989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8fd28-8d32-43e5-b4bd-b65dcc9c22a5 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:00.026362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8fd28-8d32-43e5-b4bd-b65dcc9c22a5 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:00.032311 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb386c-87fe-44b4-a11f-c91044e44a7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:00.032938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb386c-87fe-44b4-a11f-c91044e44a7e service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:00.033221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb386c-87fe-44b4-a11f-c91044e44a7e service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:00.033496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb386c-87fe-44b4-a11f-c91044e44a7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:00.041395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb386c-87fe-44b4-a11f-c91044e44a7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:00.043009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb386c-87fe-44b4-a11f-c91044e44a7e service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:00.052611 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 721/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:00.922861 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f4c4-35a3-4944-add0-a8384fd81d51 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:00.923419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f4c4-35a3-4944-add0-a8384fd81d51 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:00.923419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f4c4-35a3-4944-add0-a8384fd81d51 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:00.924835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:00.930118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243881-9539-4cbf-80b7-883ca837364f None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:00.930584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243881-9539-4cbf-80b7-883ca837364f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:00.930709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243881-9539-4cbf-80b7-883ca837364f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:00.948409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4f243881-9539-4cbf-80b7-883ca837364f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:00.949617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4f243881-9539-4cbf-80b7-883ca837364f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:00.957315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:01.105773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388f4c4-35a3-4944-add0-a8384fd81d51 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:01.120656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388f4c4-35a3-4944-add0-a8384fd81d51 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:01.126114 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e64ab0-f628-434d-9a61-4b20e2129d7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:01.126783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e64ab0-f628-434d-9a61-4b20e2129d7a service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:01.127065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e64ab0-f628-434d-9a61-4b20e2129d7a service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:01.127336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e64ab0-f628-434d-9a61-4b20e2129d7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:01.135305 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e64ab0-f628-434d-9a61-4b20e2129d7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:01.137206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e64ab0-f628-434d-9a61-4b20e2129d7a service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:01.146718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 718/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:03.231366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f719a6-574c-4914-b047-d1f2b9758c79 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:03.232128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f719a6-574c-4914-b047-d1f2b9758c79 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:03.232128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f719a6-574c-4914-b047-d1f2b9758c79 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:03.234426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:03.239989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b80b1-00f1-4e85-811a-7df580a28433 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:03.240421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b80b1-00f1-4e85-811a-7df580a28433 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:03.240529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b80b1-00f1-4e85-811a-7df580a28433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:03.257879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c66b80b1-00f1-4e85-811a-7df580a28433 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:03.259088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c66b80b1-00f1-4e85-811a-7df580a28433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:03.267016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:03.305680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f719a6-574c-4914-b047-d1f2b9758c79 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:03.316094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f719a6-574c-4914-b047-d1f2b9758c79 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:03.319596 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ece52d-cb88-422d-9175-e79d27e9456c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:03.320222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece52d-cb88-422d-9175-e79d27e9456c service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:03.320508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece52d-cb88-422d-9175-e79d27e9456c service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:03.320784 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ece52d-cb88-422d-9175-e79d27e9456c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:03.329645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ece52d-cb88-422d-9175-e79d27e9456c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:03.331102 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ece52d-cb88-422d-9175-e79d27e9456c service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:03.340147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 724/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:05.681460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26b5ef-b281-4cdd-8e3a-6ebc5f6d4830 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:05.682035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26b5ef-b281-4cdd-8e3a-6ebc5f6d4830 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:05.682152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26b5ef-b281-4cdd-8e3a-6ebc5f6d4830 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:05.683507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:05.689358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b13cc-958f-47e1-b8af-cf5e450d722d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:05.689768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b13cc-958f-47e1-b8af-cf5e450d722d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:05.689949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b13cc-958f-47e1-b8af-cf5e450d722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:05.707693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-cf8b13cc-958f-47e1-b8af-cf5e450d722d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:05.708891 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-cf8b13cc-958f-47e1-b8af-cf5e450d722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:05.716598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:05.754536 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26b5ef-b281-4cdd-8e3a-6ebc5f6d4830 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:05.764915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26b5ef-b281-4cdd-8e3a-6ebc5f6d4830 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:05.768779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207d8f2-802b-4775-a744-1e54b48e3089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:05.769445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207d8f2-802b-4775-a744-1e54b48e3089 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:05.769816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207d8f2-802b-4775-a744-1e54b48e3089 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:05.770099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207d8f2-802b-4775-a744-1e54b48e3089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:05.779341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207d8f2-802b-4775-a744-1e54b48e3089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:05.780978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207d8f2-802b-4775-a744-1e54b48e3089 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:05.790972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 721/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:08.313934 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8932-8845-4c67-a062-78e0056d75f1 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:08.314553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8932-8845-4c67-a062-78e0056d75f1 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:08.314553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c8932-8845-4c67-a062-78e0056d75f1 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:08.315836 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:08.321038 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64347bd0-ae23-4176-a9ee-0da56885ec86 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:08.321446 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64347bd0-ae23-4176-a9ee-0da56885ec86 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:08.321593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64347bd0-ae23-4176-a9ee-0da56885ec86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:08.339387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-64347bd0-ae23-4176-a9ee-0da56885ec86 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:08.340563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-64347bd0-ae23-4176-a9ee-0da56885ec86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:08.348395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:08.385737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c8932-8845-4c67-a062-78e0056d75f1 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:08.397279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c8932-8845-4c67-a062-78e0056d75f1 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:08.400808 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a806c-7470-4b5c-8dfa-5f24d524c65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:08.401439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a806c-7470-4b5c-8dfa-5f24d524c65a service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:08.401828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a806c-7470-4b5c-8dfa-5f24d524c65a service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:08.402110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a806c-7470-4b5c-8dfa-5f24d524c65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:08.411272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a806c-7470-4b5c-8dfa-5f24d524c65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:08.412707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a806c-7470-4b5c-8dfa-5f24d524c65a service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:08.422397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 727/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:10.751902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95400144-cd7f-41f0-891d-36b8739948e1 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:10.752522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95400144-cd7f-41f0-891d-36b8739948e1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:10.752522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95400144-cd7f-41f0-891d-36b8739948e1 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:10.753860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:10.759123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27888d4-7f44-4db1-ac5d-1d90b415ec9a None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:10.759529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27888d4-7f44-4db1-ac5d-1d90b415ec9a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:10.759668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27888d4-7f44-4db1-ac5d-1d90b415ec9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:10.776685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f27888d4-7f44-4db1-ac5d-1d90b415ec9a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:10.777856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f27888d4-7f44-4db1-ac5d-1d90b415ec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:10.786519 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:10.824395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95400144-cd7f-41f0-891d-36b8739948e1 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:10.826081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-95400144-cd7f-41f0-891d-36b8739948e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:10.839077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95400144-cd7f-41f0-891d-36b8739948e1 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:10.843226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e177c411-9a4c-453b-b907-227a11bf1a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:10.843786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c411-9a4c-453b-b907-227a11bf1a2f service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:10.844061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c411-9a4c-453b-b907-227a11bf1a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:10.844331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e177c411-9a4c-453b-b907-227a11bf1a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:10.852986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177c411-9a4c-453b-b907-227a11bf1a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:10.854434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e177c411-9a4c-453b-b907-227a11bf1a2f service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:10.864566 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 724/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:13.195827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49557-2db8-44eb-b870-47739bf20017 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:13.196340 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49557-2db8-44eb-b870-47739bf20017 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:13.196340 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a49557-2db8-44eb-b870-47739bf20017 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:13.197656 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:13.203943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c179a5-3861-4bad-bf5e-247821d5f613 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:13.204388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c179a5-3861-4bad-bf5e-247821d5f613 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:13.204494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c179a5-3861-4bad-bf5e-247821d5f613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:13.223036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-97c179a5-3861-4bad-bf5e-247821d5f613 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:13.224213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-97c179a5-3861-4bad-bf5e-247821d5f613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:13.232063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:13.269298 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a49557-2db8-44eb-b870-47739bf20017 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:13.280105 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a49557-2db8-44eb-b870-47739bf20017 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:13.283571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7fa03-f3ae-48d9-9a49-0068af7720a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:13.284191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7fa03-f3ae-48d9-9a49-0068af7720a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:13.284469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7fa03-f3ae-48d9-9a49-0068af7720a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:13.284738 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7fa03-f3ae-48d9-9a49-0068af7720a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:13.293231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7fa03-f3ae-48d9-9a49-0068af7720a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:13.294681 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7fa03-f3ae-48d9-9a49-0068af7720a6 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:13.303551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 730/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:15.625685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e981bf9-6a15-4a0e-9cdc-1feb18f9f474 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:15.626262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e981bf9-6a15-4a0e-9cdc-1feb18f9f474 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:15.626262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e981bf9-6a15-4a0e-9cdc-1feb18f9f474 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:15.627620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:15.632984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2160c-e541-4807-8872-f42581dad3a5 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:15.633426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2160c-e541-4807-8872-f42581dad3a5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:15.633526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2160c-e541-4807-8872-f42581dad3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:15.651756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-3dc2160c-e541-4807-8872-f42581dad3a5 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:15.652925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-3dc2160c-e541-4807-8872-f42581dad3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:15.661065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:15.697798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e981bf9-6a15-4a0e-9cdc-1feb18f9f474 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:15.708957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e981bf9-6a15-4a0e-9cdc-1feb18f9f474 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:15.712350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ae867-2f3a-4c4a-8a65-4d04a108b9aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:15.712973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ae867-2f3a-4c4a-8a65-4d04a108b9aa service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:15.713250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ae867-2f3a-4c4a-8a65-4d04a108b9aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:15.713520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ae867-2f3a-4c4a-8a65-4d04a108b9aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:15.722918 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ae867-2f3a-4c4a-8a65-4d04a108b9aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:15.724331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ae867-2f3a-4c4a-8a65-4d04a108b9aa service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:15.733520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 727/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:18.020752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58053366-f094-4751-8401-0a5f063c4e54 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:18.021249 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58053366-f094-4751-8401-0a5f063c4e54 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:18.021352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58053366-f094-4751-8401-0a5f063c4e54 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:18.022729 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:18.028087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfbbcd-bd45-4562-9765-dbabc9f6d20f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:18.028519 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfbbcd-bd45-4562-9765-dbabc9f6d20f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:18.028615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfbbcd-bd45-4562-9765-dbabc9f6d20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:18.046775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-75bfbbcd-bd45-4562-9765-dbabc9f6d20f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:18.047937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-75bfbbcd-bd45-4562-9765-dbabc9f6d20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:18.055473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:18.091299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58053366-f094-4751-8401-0a5f063c4e54 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:18.102134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58053366-f094-4751-8401-0a5f063c4e54 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:18.105555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dcb5c-2d0b-493d-a758-d024d9c80db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:18.106175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dcb5c-2d0b-493d-a758-d024d9c80db3 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:18.106481 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dcb5c-2d0b-493d-a758-d024d9c80db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:18.106754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dcb5c-2d0b-493d-a758-d024d9c80db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:18.116073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dcb5c-2d0b-493d-a758-d024d9c80db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:18.117493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dcb5c-2d0b-493d-a758-d024d9c80db3 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:18.126545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 733/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:20.366295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca695597-ed84-4c62-bd67-f55b8815c6da None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:20.366893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca695597-ed84-4c62-bd67-f55b8815c6da None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:20.366893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca695597-ed84-4c62-bd67-f55b8815c6da None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:20.368229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:20.373718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074bd0e-b5d4-41ab-b352-84fee09548a6 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:20.374171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074bd0e-b5d4-41ab-b352-84fee09548a6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:20.374275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074bd0e-b5d4-41ab-b352-84fee09548a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:20.391376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2074bd0e-b5d4-41ab-b352-84fee09548a6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:20.392543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2074bd0e-b5d4-41ab-b352-84fee09548a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:20.400177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:40:20.438559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca695597-ed84-4c62-bd67-f55b8815c6da None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:20.449256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca695597-ed84-4c62-bd67-f55b8815c6da None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:20.452867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fdea1-6a38-4f6d-85ae-0f4be42c37a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:20.453496 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fdea1-6a38-4f6d-85ae-0f4be42c37a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:20.453777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fdea1-6a38-4f6d-85ae-0f4be42c37a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:20.454050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fdea1-6a38-4f6d-85ae-0f4be42c37a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:20.462724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fdea1-6a38-4f6d-85ae-0f4be42c37a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:20.464143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fdea1-6a38-4f6d-85ae-0f4be42c37a9 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:20.473838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 730/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:22.684817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68365cd-b11c-407b-bb9e-ac9a5fea95d9 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:22.685865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68365cd-b11c-407b-bb9e-ac9a5fea95d9 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:22.685865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68365cd-b11c-407b-bb9e-ac9a5fea95d9 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:22.687258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:22.692390 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f4c8d-8c2b-47fc-b0dc-20f8d30e2252 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:22.692929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f4c8d-8c2b-47fc-b0dc-20f8d30e2252 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:22.692929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f4c8d-8c2b-47fc-b0dc-20f8d30e2252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:22.710672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-318f4c8d-8c2b-47fc-b0dc-20f8d30e2252 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:22.711882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-318f4c8d-8c2b-47fc-b0dc-20f8d30e2252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:22.719688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:22.755667 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68365cd-b11c-407b-bb9e-ac9a5fea95d9 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:22.766468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68365cd-b11c-407b-bb9e-ac9a5fea95d9 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:22.769834 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5516b2-19e8-470c-848f-3dddd25cbc7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:22.770493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5516b2-19e8-470c-848f-3dddd25cbc7d service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:22.770771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5516b2-19e8-470c-848f-3dddd25cbc7d service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:22.771043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5516b2-19e8-470c-848f-3dddd25cbc7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:22.779479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5516b2-19e8-470c-848f-3dddd25cbc7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:22.780887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5516b2-19e8-470c-848f-3dddd25cbc7d service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:22.789871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 736/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:25.011641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c08a-ae9e-40e8-9145-c9bda381f72e None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:25.012178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c08a-ae9e-40e8-9145-c9bda381f72e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:25.012178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229c08a-ae9e-40e8-9145-c9bda381f72e None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:25.013659 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:25.019098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565da4f-7c97-413a-9919-35156e965db6 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:25.019521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565da4f-7c97-413a-9919-35156e965db6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:25.019677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565da4f-7c97-413a-9919-35156e965db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:25.037559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9565da4f-7c97-413a-9919-35156e965db6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:25.038756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9565da4f-7c97-413a-9919-35156e965db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:25.047731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:25.082976 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229c08a-ae9e-40e8-9145-c9bda381f72e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:25.093975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229c08a-ae9e-40e8-9145-c9bda381f72e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:25.097401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7a804-09d2-4233-b826-ac5a8bd6d4a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:25.098029 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7a804-09d2-4233-b826-ac5a8bd6d4a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:25.098331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7a804-09d2-4233-b826-ac5a8bd6d4a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:25.098612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7a804-09d2-4233-b826-ac5a8bd6d4a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:25.108075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7a804-09d2-4233-b826-ac5a8bd6d4a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:25.109492 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7a804-09d2-4233-b826-ac5a8bd6d4a1 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:25.118652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 733/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:40:58.074153 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfc7e8-ec7b-4f17-97ab-ff8bd320e6cf None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:58.074772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfc7e8-ec7b-4f17-97ab-ff8bd320e6cf None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:58.074772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfc7e8-ec7b-4f17-97ab-ff8bd320e6cf None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:58.076248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 738/1471] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:58.081598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570c0d-5ffd-43b5-b62d-7cf8199886f9 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:58.082014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570c0d-5ffd-43b5-b62d-7cf8199886f9 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:58.082144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570c0d-5ffd-43b5-b62d-7cf8199886f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:58.100158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-13570c0d-5ffd-43b5-b62d-7cf8199886f9 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:58.101255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-13570c0d-5ffd-43b5-b62d-7cf8199886f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:58.109735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 734/1472] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:58.156475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d59e37-10fa-402d-8cff-40502c3c1fca None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:58.156762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d59e37-10fa-402d-8cff-40502c3c1fca None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:58.157041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d59e37-10fa-402d-8cff-40502c3c1fca None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:58.158411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 739/1473] 10.222.0.61 () {54 vars in 962 bytes} [Sat May 14 15:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:40:58.162992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941cbbc-79c0-44e0-8ba6-27ffa838b5d4 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:58.163286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941cbbc-79c0-44e0-8ba6-27ffa838b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:58.163565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941cbbc-79c0-44e0-8ba6-27ffa838b5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:58.180923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a941cbbc-79c0-44e0-8ba6-27ffa838b5d4 None None] MFA Rules not processed for user `d346be1ef7604f1f87371f5d322fd010`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:40:58.182100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a941cbbc-79c0-44e0-8ba6-27ffa838b5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:40:58.188463 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 735/1474] 10.222.0.61 () {58 vars in 1059 bytes} [Sat May 14 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:40:58.195430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d59e37-10fa-402d-8cff-40502c3c1fca None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:40:58.206619 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d59e37-10fa-402d-8cff-40502c3c1fca None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:40:58.210126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732d9a8-5b80-48f4-9617-da3d61d59b51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd346be1ef7604f1f87371f5d322fd010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:40:58.210785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732d9a8-5b80-48f4-9617-da3d61d59b51 service glance] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:40:58.211069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732d9a8-5b80-48f4-9617-da3d61d59b51 service glance] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:40:58.211344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732d9a8-5b80-48f4-9617-da3d61d59b51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:40:58.220497 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732d9a8-5b80-48f4-9617-da3d61d59b51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:40:58.221915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732d9a8-5b80-48f4-9617-da3d61d59b51 service glance] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:40:58.230933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 740/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:41:00.495886 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc2132-e590-45c6-b4d0-220f5d0ebb63 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:00.496454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc2132-e590-45c6-b4d0-220f5d0ebb63 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:00.496454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc2132-e590-45c6-b4d0-220f5d0ebb63 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:00.497935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 736/1476] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:41:00.503045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fbc0a-e505-4112-a9c4-99bdc0c5ce58 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:00.503473 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fbc0a-e505-4112-a9c4-99bdc0c5ce58 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:00.503592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fbc0a-e505-4112-a9c4-99bdc0c5ce58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:00.520931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f98fbc0a-e505-4112-a9c4-99bdc0c5ce58 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:41:00.522115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f98fbc0a-e505-4112-a9c4-99bdc0c5ce58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:41:00.530726 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 741/1477] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:41:00.554555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc2132-e590-45c6-b4d0-220f5d0ebb63 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:41:00.566913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc2132-e590-45c6-b4d0-220f5d0ebb63 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:41:00.571311 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95406479-ac69-4747-977e-9812c6562f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:41:00.571947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95406479-ac69-4747-977e-9812c6562f1a admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:00.572225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95406479-ac69-4747-977e-9812c6562f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:00.572498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95406479-ac69-4747-977e-9812c6562f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:00.573219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95406479-ac69-4747-977e-9812c6562f1a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:41:00.575470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: WARNING py.warnings [None req-95406479-ac69-4747-977e-9812c6562f1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 15:41:00.575470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: warnings.warn(msg) May 14 15:41:00.575470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: May 14 15:41:00.576746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95406479-ac69-4747-977e-9812c6562f1a admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:41:00.595802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 737/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Sat May 14 15:41:00 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:41:02.815413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a6a48-8066-4747-9c46-cfe38771afbb None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:02.815959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a6a48-8066-4747-9c46-cfe38771afbb None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:02.815959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a6a48-8066-4747-9c46-cfe38771afbb None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:02.817394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 742/1479] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:41:02.822772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f9b9-ad70-4bac-a25a-a7bac79046c0 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:02.823182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f9b9-ad70-4bac-a25a-a7bac79046c0 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:02.823328 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f9b9-ad70-4bac-a25a-a7bac79046c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:02.841731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-29d1f9b9-ad70-4bac-a25a-a7bac79046c0 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:41:02.842948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-29d1f9b9-ad70-4bac-a25a-a7bac79046c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:41:02.850737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 738/1480] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:41:02.893649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a6a48-8066-4747-9c46-cfe38771afbb None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:41:02.907425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a6a48-8066-4747-9c46-cfe38771afbb None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:41:02.912669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3774ca-7673-4b13-be51-a371179156aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:41:02.913293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3774ca-7673-4b13-be51-a371179156aa service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:02.913574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3774ca-7673-4b13-be51-a371179156aa service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:02.913841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3774ca-7673-4b13-be51-a371179156aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:02.922024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3774ca-7673-4b13-be51-a371179156aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:41:02.923931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3774ca-7673-4b13-be51-a371179156aa service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:41:02.932867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 743/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:41:05.330045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884cc95-ecb2-49e0-8a4d-944d54b42a74 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:05.330627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884cc95-ecb2-49e0-8a4d-944d54b42a74 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:05.330627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884cc95-ecb2-49e0-8a4d-944d54b42a74 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:05.332020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 739/1482] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:41:05.337182 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7f3d4-c314-4120-8c55-89a037d479c3 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:05.337606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7f3d4-c314-4120-8c55-89a037d479c3 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:05.337734 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7f3d4-c314-4120-8c55-89a037d479c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:05.355726 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c6a7f3d4-c314-4120-8c55-89a037d479c3 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:41:05.357130 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c6a7f3d4-c314-4120-8c55-89a037d479c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:41:05.364978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 744/1483] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:41:05.400698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884cc95-ecb2-49e0-8a4d-944d54b42a74 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:41:05.411984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884cc95-ecb2-49e0-8a4d-944d54b42a74 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:41:05.415460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59400b8-d61b-4b3f-bdc4-1a1a27eaf8bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:41:05.416088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59400b8-d61b-4b3f-bdc4-1a1a27eaf8bf service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:05.416373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59400b8-d61b-4b3f-bdc4-1a1a27eaf8bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:05.416647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59400b8-d61b-4b3f-bdc4-1a1a27eaf8bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:05.425548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59400b8-d61b-4b3f-bdc4-1a1a27eaf8bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:41:05.427015 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59400b8-d61b-4b3f-bdc4-1a1a27eaf8bf service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:41:05.436506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 740/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:41:07.717883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724559ab-bb59-494c-a7a5-b84ec94ab03f None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:07.718493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724559ab-bb59-494c-a7a5-b84ec94ab03f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:07.718493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724559ab-bb59-494c-a7a5-b84ec94ab03f None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:07.719892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 745/1485] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:41:07.725152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5da28-652e-4479-ae4d-d59b150a6b79 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:07.725600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5da28-652e-4479-ae4d-d59b150a6b79 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:07.725699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5da28-652e-4479-ae4d-d59b150a6b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:07.743439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-96f5da28-652e-4479-ae4d-d59b150a6b79 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:41:07.744593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-96f5da28-652e-4479-ae4d-d59b150a6b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:41:07.753022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 741/1486] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:41:07.789471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724559ab-bb59-494c-a7a5-b84ec94ab03f None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:41:07.800380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724559ab-bb59-494c-a7a5-b84ec94ab03f None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:41:07.803866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aeabc6-0fcf-409d-8d6d-a8b0dbc05c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:41:07.804502 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeabc6-0fcf-409d-8d6d-a8b0dbc05c12 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:07.804782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeabc6-0fcf-409d-8d6d-a8b0dbc05c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:07.805056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aeabc6-0fcf-409d-8d6d-a8b0dbc05c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:07.814281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aeabc6-0fcf-409d-8d6d-a8b0dbc05c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:41:07.815732 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aeabc6-0fcf-409d-8d6d-a8b0dbc05c12 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:41:07.824844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 746/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:41:10.188464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d4965-30bf-4e3a-b7ac-7f3a14c4a809 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:10.189072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d4965-30bf-4e3a-b7ac-7f3a14c4a809 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:10.189072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d4965-30bf-4e3a-b7ac-7f3a14c4a809 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:10.190334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 742/1488] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:41:10.195654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70621c78-bc40-4655-9f6d-0264633f814a None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:10.196085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70621c78-bc40-4655-9f6d-0264633f814a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:10.196201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70621c78-bc40-4655-9f6d-0264633f814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:10.213878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-70621c78-bc40-4655-9f6d-0264633f814a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:41:10.215110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-70621c78-bc40-4655-9f6d-0264633f814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:41:10.222898 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 747/1489] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:41:10.263524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d4965-30bf-4e3a-b7ac-7f3a14c4a809 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:41:10.274015 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d4965-30bf-4e3a-b7ac-7f3a14c4a809 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:41:10.277782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0394e-7690-47fb-b202-812d3c484efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:41:10.278446 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0394e-7690-47fb-b202-812d3c484efa service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:10.278738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0394e-7690-47fb-b202-812d3c484efa service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:10.279023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0394e-7690-47fb-b202-812d3c484efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:10.287930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0394e-7690-47fb-b202-812d3c484efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:41:10.289356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0394e-7690-47fb-b202-812d3c484efa service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:41:10.298673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 743/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:41:12.694923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746546-5e29-402c-979c-a4ec210a1e45 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:12.695531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746546-5e29-402c-979c-a4ec210a1e45 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:12.695531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79746546-5e29-402c-979c-a4ec210a1e45 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:12.696873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 748/1491] 10.222.0.61 () {54 vars in 926 bytes} [Sat May 14 15:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:41:12.702754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53a5dc-760d-4ae3-a4fd-1e0152684735 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:12.703211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53a5dc-760d-4ae3-a4fd-1e0152684735 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:12.703314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53a5dc-760d-4ae3-a4fd-1e0152684735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:12.720646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6a53a5dc-760d-4ae3-a4fd-1e0152684735 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:41:12.721825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6a53a5dc-760d-4ae3-a4fd-1e0152684735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:41:12.729528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 744/1492] 10.222.0.61 () {58 vars in 1023 bytes} [Sat May 14 15:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:41:12.768720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746546-5e29-402c-979c-a4ec210a1e45 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:41:12.779122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79746546-5e29-402c-979c-a4ec210a1e45 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:41:12.782610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe86465-c1d9-492a-8e3c-2ca4f32e0941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:41:12.783240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe86465-c1d9-492a-8e3c-2ca4f32e0941 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:41:12.783521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe86465-c1d9-492a-8e3c-2ca4f32e0941 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:41:12.783795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe86465-c1d9-492a-8e3c-2ca4f32e0941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:41:12.792459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe86465-c1d9-492a-8e3c-2ca4f32e0941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:41:12.794546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe86465-c1d9-492a-8e3c-2ca4f32e0941 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:41:12.803510 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 749/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:42:39.881418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612951-2fb1-4022-98cc-cceb81d7e146 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:39.881940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612951-2fb1-4022-98cc-cceb81d7e146 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:39.882037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612951-2fb1-4022-98cc-cceb81d7e146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:39.900343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-80612951-2fb1-4022-98cc-cceb81d7e146 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:42:39.902262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-80612951-2fb1-4022-98cc-cceb81d7e146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:42:39.910005 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 745/1494] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:42:39.919356 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b61a1-c544-44a4-aecf-86881e6ac7c9 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:39.919838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b61a1-c544-44a4-aecf-86881e6ac7c9 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:39.919945 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b61a1-c544-44a4-aecf-86881e6ac7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:39.937450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-8e5b61a1-c544-44a4-aecf-86881e6ac7c9 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:42:39.938651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8e5b61a1-c544-44a4-aecf-86881e6ac7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:42:39.946186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 750/1495] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:42:39.951068 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80612951-2fb1-4022-98cc-cceb81d7e146 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:42:39.960354 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80612951-2fb1-4022-98cc-cceb81d7e146 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:42:39.965640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46942e-9a85-454c-b37c-03005ec3cd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:42:39.966281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46942e-9a85-454c-b37c-03005ec3cd0e admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:39.966594 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46942e-9a85-454c-b37c-03005ec3cd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:39.966869 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46942e-9a85-454c-b37c-03005ec3cd0e admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:39.967642 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46942e-9a85-454c-b37c-03005ec3cd0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:42:39.967945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46942e-9a85-454c-b37c-03005ec3cd0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:42:39.968944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: WARNING py.warnings [None req-8f46942e-9a85-454c-b37c-03005ec3cd0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:42:39.968944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: warnings.warn(msg) May 14 15:42:39.968944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: May 14 15:42:39.969842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46942e-9a85-454c-b37c-03005ec3cd0e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:42:39.981041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 746/1496] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:42:39.989137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b61a1-c544-44a4-aecf-86881e6ac7c9 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:42:39.997855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b61a1-c544-44a4-aecf-86881e6ac7c9 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:42:40.002291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9cb80-3169-4388-8001-cafebae47fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:42:40.002957 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9cb80-3169-4388-8001-cafebae47fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.003238 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9cb80-3169-4388-8001-cafebae47fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.003510 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9cb80-3169-4388-8001-cafebae47fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.004197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9cb80-3169-4388-8001-cafebae47fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:42:40.005908 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: WARNING py.warnings [None req-11c9cb80-3169-4388-8001-cafebae47fc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 15:42:40.005908 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: warnings.warn(msg) May 14 15:42:40.005908 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: May 14 15:42:40.007125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9cb80-3169-4388-8001-cafebae47fc8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:42:40.045037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 751/1497] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:42:39 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:42:40.049443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46942e-9a85-454c-b37c-03005ec3cd0e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:42:40.059245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46942e-9a85-454c-b37c-03005ec3cd0e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:42:40.113807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9dc37-4030-44c4-85ef-47cc11b38af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:42:40.114427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9dc37-4030-44c4-85ef-47cc11b38af8 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.114713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9dc37-4030-44c4-85ef-47cc11b38af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.114988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9dc37-4030-44c4-85ef-47cc11b38af8 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.115678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9dc37-4030-44c4-85ef-47cc11b38af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:42:40.116802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: WARNING py.warnings [None req-4cc9dc37-4030-44c4-85ef-47cc11b38af8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 15:42:40.116802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: warnings.warn(msg) May 14 15:42:40.116802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: May 14 15:42:40.117925 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9dc37-4030-44c4-85ef-47cc11b38af8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:42:40.137714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 747/1498] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:42:40 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:42:40.141839 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9cb80-3169-4388-8001-cafebae47fc8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:42:40.152303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9cb80-3169-4388-8001-cafebae47fc8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:42:40.156793 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35751f0d-bb4d-432d-9571-4591df8a5db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:42:40.157441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35751f0d-bb4d-432d-9571-4591df8a5db1 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.157718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35751f0d-bb4d-432d-9571-4591df8a5db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.157991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35751f0d-bb4d-432d-9571-4591df8a5db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.158742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35751f0d-bb4d-432d-9571-4591df8a5db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:42:40.159739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: WARNING py.warnings [None req-35751f0d-bb4d-432d-9571-4591df8a5db1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:42:40.159739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: warnings.warn(msg) May 14 15:42:40.159739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: May 14 15:42:40.160610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35751f0d-bb4d-432d-9571-4591df8a5db1 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:42:40.173776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 752/1499] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:42:40.177500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9dc37-4030-44c4-85ef-47cc11b38af8 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:42:40.187394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9dc37-4030-44c4-85ef-47cc11b38af8 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:42:40.191896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbb612-8519-419b-a08e-6246bb7e9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:42:40.192549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb612-8519-419b-a08e-6246bb7e9708 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.192829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb612-8519-419b-a08e-6246bb7e9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.193102 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbb612-8519-419b-a08e-6246bb7e9708 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.193827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbb612-8519-419b-a08e-6246bb7e9708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:42:40.194853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: WARNING py.warnings [None req-89bbb612-8519-419b-a08e-6246bb7e9708 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:42:40.194853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: warnings.warn(msg) May 14 15:42:40.194853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: May 14 15:42:40.195724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbb612-8519-419b-a08e-6246bb7e9708 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:42:40.209487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 748/1500] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:42:40.214362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35751f0d-bb4d-432d-9571-4591df8a5db1 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:42:40.223927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35751f0d-bb4d-432d-9571-4591df8a5db1 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:42:40.228416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6299-b4c8-4046-a5ca-83e5f54d8ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:42:40.230261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6299-b4c8-4046-a5ca-83e5f54d8ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.230261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6299-b4c8-4046-a5ca-83e5f54d8ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.230638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6299-b4c8-4046-a5ca-83e5f54d8ebc admin admin] PATH_INFO: `/v3/projects/18e7fe41ca1d49b1a93485146a9297ba/users/f35add922ae64cdeb390740e4a8910ec/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.244931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b6299-b4c8-4046-a5ca-83e5f54d8ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e7fe41ca1d49b1a93485146a9297ba, user_id=f35add922ae64cdeb390740e4a8910ec, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:42:40.246069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: WARNING py.warnings [None req-a83b6299-b4c8-4046-a5ca-83e5f54d8ebc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 15:42:40.246069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: warnings.warn(msg) May 14 15:42:40.246069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: May 14 15:42:40.248023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b6299-b4c8-4046-a5ca-83e5f54d8ebc admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:42:40.260279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 753/1501] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:42:40 2022] PUT /identity/v3/projects/18e7fe41ca1d49b1a93485146a9297ba/users/f35add922ae64cdeb390740e4a8910ec/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:42:40.271630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99450-6dca-4790-9831-8ae17fe011c5 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.271920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99450-6dca-4790-9831-8ae17fe011c5 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.272199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc99450-6dca-4790-9831-8ae17fe011c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.298688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-2fc99450-6dca-4790-9831-8ae17fe011c5 None None] MFA Rules not processed for user `f35add922ae64cdeb390740e4a8910ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:42:40.299876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2fc99450-6dca-4790-9831-8ae17fe011c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:42:40.360622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 749/1502] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:42:40.373730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509f6f-e530-4327-ad62-631216b004c4 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.374017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509f6f-e530-4327-ad62-631216b004c4 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.374297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509f6f-e530-4327-ad62-631216b004c4 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.375767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 754/1503] 10.222.0.61 () {54 vars in 963 bytes} [Sat May 14 15:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:42:40.380882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a9696-347b-45f8-93ad-c8f1d1415ad9 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.381177 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a9696-347b-45f8-93ad-c8f1d1415ad9 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.381456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a9696-347b-45f8-93ad-c8f1d1415ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.399343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b11a9696-347b-45f8-93ad-c8f1d1415ad9 None None] MFA Rules not processed for user `b9b7a0202f394b16800af94487a21ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:42:40.400525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b11a9696-347b-45f8-93ad-c8f1d1415ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:42:40.451242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 750/1504] 10.222.0.61 () {58 vars in 1060 bytes} [Sat May 14 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:42:40.458834 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a509f6f-e530-4327-ad62-631216b004c4 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:42:40.469699 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a509f6f-e530-4327-ad62-631216b004c4 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:42:40.473222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf29cc-66c3-43c7-b177-796b7307078a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:42:40.473846 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf29cc-66c3-43c7-b177-796b7307078a service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.474127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf29cc-66c3-43c7-b177-796b7307078a service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.474444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf29cc-66c3-43c7-b177-796b7307078a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.482984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf29cc-66c3-43c7-b177-796b7307078a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:42:40.484649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf29cc-66c3-43c7-b177-796b7307078a service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:42:40.493006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 755/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:42:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:42:40.535733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a846d83-a7ac-47d9-9a72-08c29bbb3d1f None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.536045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a846d83-a7ac-47d9-9a72-08c29bbb3d1f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.536323 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a846d83-a7ac-47d9-9a72-08c29bbb3d1f None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.537627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 751/1506] 10.222.0.61 () {52 vars in 829 bytes} [Sat May 14 15:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:42:40.541173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf29cc-66c3-43c7-b177-796b7307078a service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:42:40.600537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf29cc-66c3-43c7-b177-796b7307078a service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:42:40.605204 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:42:40.606095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.606419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.606705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] PATH_INFO: `/v3/users/f35add922ae64cdeb390740e4a8910ec` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.607906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35add922ae64cdeb390740e4a8910ec)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:42:40.609255 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: WARNING py.warnings [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 15:42:40.609255 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: warnings.warn(msg) May 14 15:42:40.609255 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: May 14 15:42:40.610625 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:42:40.674154 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35add922ae64cdeb390740e4a8910ec'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:42:40.692956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35add922ae64cdeb390740e4a8910ec'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:42:40.693631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35add922ae64cdeb390740e4a8910ec'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:42:40.694362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35add922ae64cdeb390740e4a8910ec'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:42:40.706918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35add922ae64cdeb390740e4a8910ec'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:42:40.721762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 756/1507] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:42:40 2022] DELETE /identity/v3/users/f35add922ae64cdeb390740e4a8910ec => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:42:40.726282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceae05-a967-4ae8-87a3-da06e543607b None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.726596 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceae05-a967-4ae8-87a3-da06e543607b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.726870 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ceae05-a967-4ae8-87a3-da06e543607b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.743895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-01ceae05-a967-4ae8-87a3-da06e543607b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:42:40.745151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-01ceae05-a967-4ae8-87a3-da06e543607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:42:40.800192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 752/1508] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:42:40.809715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:42:40.811183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:42:40.867465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af212612-fc54-4626-ad5a-518e5c567368 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:42:40.871612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64027959-8f0e-4078-bbda-eef9b8c5a96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:42:40.872256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027959-8f0e-4078-bbda-eef9b8c5a96d service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:40.872539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027959-8f0e-4078-bbda-eef9b8c5a96d service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:40.872815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027959-8f0e-4078-bbda-eef9b8c5a96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:40.881326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64027959-8f0e-4078-bbda-eef9b8c5a96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:42:40.882794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64027959-8f0e-4078-bbda-eef9b8c5a96d service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:42:40.892799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 757/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:42:41.222580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ceae05-a967-4ae8-87a3-da06e543607b None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:42:41.224135 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-01ceae05-a967-4ae8-87a3-da06e543607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:42:41.236238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ceae05-a967-4ae8-87a3-da06e543607b None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:42:41.241717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:42:41.242938 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:42:41.243221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:42:41.243495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] PATH_INFO: `/v3/projects/18e7fe41ca1d49b1a93485146a9297ba` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:42:41.244676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e7fe41ca1d49b1a93485146a9297ba)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:42:41.246229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: WARNING py.warnings [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 15:42:41.246229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: warnings.warn(msg) May 14 15:42:41.246229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: May 14 15:42:41.248689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:42:41.310068 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e7fe41ca1d49b1a93485146a9297ba', 'request_id': 'req-5416c21d-773d-4fdc-a4a2-04aa990f3ced'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:42:41.319867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e7fe41ca1d49b1a93485146a9297ba', 'request_id': 'req-5416c21d-773d-4fdc-a4a2-04aa990f3ced'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:42:41.325988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e7fe41ca1d49b1a93485146a9297ba', 'request_id': 'req-5416c21d-773d-4fdc-a4a2-04aa990f3ced'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:42:41.343478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] The token cache is being invalidate because project 18e7fe41ca1d49b1a93485146a9297ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:42:41.343761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:42:41.344393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5416c21d-773d-4fdc-a4a2-04aa990f3ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:42:41.346012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 753/1510] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:42:41 2022] DELETE /identity/v3/projects/18e7fe41ca1d49b1a93485146a9297ba => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:44:16.877895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db737cd3-f861-4a45-a2a1-78301c5daa0b None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:16.878471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db737cd3-f861-4a45-a2a1-78301c5daa0b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:16.878591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db737cd3-f861-4a45-a2a1-78301c5daa0b None None] PATH_INFO: `/v3` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:16.879832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 758/1511] 10.222.0.36 () {54 vars in 925 bytes} [Sat May 14 15:44:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:44:16.886583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668afc-6500-46ca-980c-e9373e776058 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:16.887004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668afc-6500-46ca-980c-e9373e776058 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:16.887133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10668afc-6500-46ca-980c-e9373e776058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:16.904485 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-10668afc-6500-46ca-980c-e9373e776058 None None] MFA Rules not processed for user `8fac310b740a40718191e905723222ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:44:16.905691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-10668afc-6500-46ca-980c-e9373e776058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:16.966020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 754/1512] 10.222.0.36 () {58 vars in 1015 bytes} [Sat May 14 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:44:18.654077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b713-87b0-4561-8606-4f55b4ceecaa None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:18.654664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b713-87b0-4561-8606-4f55b4ceecaa None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:18.654664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9b713-87b0-4561-8606-4f55b4ceecaa None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:18.656029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 759/1513] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:44:18.660948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5de875-a6c6-4741-ba22-3dfc700438ff None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:18.661396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5de875-a6c6-4741-ba22-3dfc700438ff None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:18.661504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5de875-a6c6-4741-ba22-3dfc700438ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:18.681830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-ab5de875-a6c6-4741-ba22-3dfc700438ff None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:44:18.683040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ab5de875-a6c6-4741-ba22-3dfc700438ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:18.865833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 755/1514] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:44:19.032636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9b713-87b0-4561-8606-4f55b4ceecaa None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:44:19.034259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2be9b713-87b0-4561-8606-4f55b4ceecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:19.105543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9b713-87b0-4561-8606-4f55b4ceecaa None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:44:19.111124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3d5e5-95c7-4336-9502-d4bead6fd2e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:44:19.111752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3d5e5-95c7-4336-9502-d4bead6fd2e1 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:19.112036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3d5e5-95c7-4336-9502-d4bead6fd2e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:19.112307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3d5e5-95c7-4336-9502-d4bead6fd2e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:19.120755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3d5e5-95c7-4336-9502-d4bead6fd2e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:44:19.122369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3d5e5-95c7-4336-9502-d4bead6fd2e1 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:44:19.131501 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 760/1515] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:44:20.021446 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72967a-d255-4dec-a3df-0363cfe1f481 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:20.022003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72967a-d255-4dec-a3df-0363cfe1f481 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:20.022003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72967a-d255-4dec-a3df-0363cfe1f481 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:20.023384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 756/1516] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:44:20.028953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4b8c-bcab-4f6c-a35d-53f0bec905a4 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:20.029387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4b8c-bcab-4f6c-a35d-53f0bec905a4 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:20.029545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4b8c-bcab-4f6c-a35d-53f0bec905a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:20.047892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-6f8f4b8c-bcab-4f6c-a35d-53f0bec905a4 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:44:20.049087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6f8f4b8c-bcab-4f6c-a35d-53f0bec905a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:20.057153 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 761/1517] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:44:20.206320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72967a-d255-4dec-a3df-0363cfe1f481 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:44:20.221451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72967a-d255-4dec-a3df-0363cfe1f481 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:44:20.226729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96493441-7f61-4c02-8188-0820e0198d6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:44:20.227350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96493441-7f61-4c02-8188-0820e0198d6c service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:20.227622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96493441-7f61-4c02-8188-0820e0198d6c service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:20.227889 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96493441-7f61-4c02-8188-0820e0198d6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:20.236174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96493441-7f61-4c02-8188-0820e0198d6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:44:20.237753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96493441-7f61-4c02-8188-0820e0198d6c service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:44:20.246813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 757/1518] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:44:23.875513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffaba-fa52-4529-942f-615933c55273 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:23.876000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffaba-fa52-4529-942f-615933c55273 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:23.876113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffaba-fa52-4529-942f-615933c55273 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:23.877454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 762/1519] 10.222.0.61 () {54 vars in 960 bytes} [Sat May 14 15:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:44:23.882406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2db62-9428-47dc-a77e-bcf8061892c5 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:23.882858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2db62-9428-47dc-a77e-bcf8061892c5 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:23.882960 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2db62-9428-47dc-a77e-bcf8061892c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:23.900813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-fed2db62-9428-47dc-a77e-bcf8061892c5 None None] MFA Rules not processed for user `8fac310b740a40718191e905723222ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:44:23.901979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-fed2db62-9428-47dc-a77e-bcf8061892c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:23.910206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 758/1520] 10.222.0.61 () {58 vars in 1057 bytes} [Sat May 14 15:44:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:44:23.917598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dffaba-fa52-4529-942f-615933c55273 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:44:23.930397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dffaba-fa52-4529-942f-615933c55273 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:44:23.936077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c47c00-75f5-4be3-be5f-4f3d298a849e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fac310b740a40718191e905723222ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:44:23.936699 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c47c00-75f5-4be3-be5f-4f3d298a849e service placement] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:23.936985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c47c00-75f5-4be3-be5f-4f3d298a849e service placement] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:23.937262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c47c00-75f5-4be3-be5f-4f3d298a849e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:23.945361 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c47c00-75f5-4be3-be5f-4f3d298a849e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:44:23.947762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c47c00-75f5-4be3-be5f-4f3d298a849e service placement] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:44:23.957096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 763/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:44:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:44:31.561627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359bc1-f947-4a21-b37d-616fb206dd2c None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:31.562221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359bc1-f947-4a21-b37d-616fb206dd2c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:31.562221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359bc1-f947-4a21-b37d-616fb206dd2c None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:31.563599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:44:31.568436 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95827f3-ff70-40b5-9fa4-db74fac54b40 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:31.568880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95827f3-ff70-40b5-9fa4-db74fac54b40 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:31.568999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95827f3-ff70-40b5-9fa4-db74fac54b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:31.586292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d95827f3-ff70-40b5-9fa4-db74fac54b40 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:44:31.587493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d95827f3-ff70-40b5-9fa4-db74fac54b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:31.595160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:44:31.745865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359bc1-f947-4a21-b37d-616fb206dd2c None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:44:31.759738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359bc1-f947-4a21-b37d-616fb206dd2c None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:44:31.765277 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c5e97-c8a3-4b11-b497-98d8350a4d54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:44:31.765905 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c5e97-c8a3-4b11-b497-98d8350a4d54 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:31.766188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c5e97-c8a3-4b11-b497-98d8350a4d54 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:31.766492 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c5e97-c8a3-4b11-b497-98d8350a4d54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:31.774639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c5e97-c8a3-4b11-b497-98d8350a4d54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:44:31.776517 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c5e97-c8a3-4b11-b497-98d8350a4d54 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:44:31.786719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 760/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:44:32.672155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71ac4-cd8f-4ea6-9704-978c38dd3f5b None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:32.672699 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71ac4-cd8f-4ea6-9704-978c38dd3f5b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:32.672699 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a71ac4-cd8f-4ea6-9704-978c38dd3f5b None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:32.674084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat May 14 15:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:44:32.678853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7368e-9aca-418f-a433-e7752d1159a1 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:32.679274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7368e-9aca-418f-a433-e7752d1159a1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:32.679396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7368e-9aca-418f-a433-e7752d1159a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:32.697208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6ac7368e-9aca-418f-a433-e7752d1159a1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:44:32.699136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6ac7368e-9aca-418f-a433-e7752d1159a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:32.706774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat May 14 15:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:44:32.858521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a71ac4-cd8f-4ea6-9704-978c38dd3f5b None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:44:32.873271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a71ac4-cd8f-4ea6-9704-978c38dd3f5b None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:44:32.878658 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4a75f-3a2b-4522-a887-7ec01db52eb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:44:32.879285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a75f-3a2b-4522-a887-7ec01db52eb0 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:32.879567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a75f-3a2b-4522-a887-7ec01db52eb0 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:32.879843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4a75f-3a2b-4522-a887-7ec01db52eb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:32.888400 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a75f-3a2b-4522-a887-7ec01db52eb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:44:32.889995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4a75f-3a2b-4522-a887-7ec01db52eb0 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:44:32.899052 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 766/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:44:36.852157 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e78699-6802-4ae5-ac9b-da41e39eae5c None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:36.852621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e78699-6802-4ae5-ac9b-da41e39eae5c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:36.852726 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e78699-6802-4ae5-ac9b-da41e39eae5c None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:36.854682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:44:36.859902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dec16b-9745-4517-867a-e5772717b163 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:36.860343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dec16b-9745-4517-867a-e5772717b163 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:36.860449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dec16b-9745-4517-867a-e5772717b163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:36.878517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-66dec16b-9745-4517-867a-e5772717b163 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:44:36.879705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-66dec16b-9745-4517-867a-e5772717b163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:36.887496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:44:36.923212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e78699-6802-4ae5-ac9b-da41e39eae5c None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:44:36.924872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e3e78699-6802-4ae5-ac9b-da41e39eae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:36.979332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e78699-6802-4ae5-ac9b-da41e39eae5c None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:44:36.983025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e73039-141e-4125-acf2-9333d8f8fec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:44:36.983656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e73039-141e-4125-acf2-9333d8f8fec2 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:36.983935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e73039-141e-4125-acf2-9333d8f8fec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:36.984203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e73039-141e-4125-acf2-9333d8f8fec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:36.993132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e73039-141e-4125-acf2-9333d8f8fec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:44:36.995369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e73039-141e-4125-acf2-9333d8f8fec2 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:44:37.004400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 763/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:44:39.268911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6078c03-ec37-41b3-8665-88f99eb54577 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:39.269464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6078c03-ec37-41b3-8665-88f99eb54577 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:39.269464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6078c03-ec37-41b3-8665-88f99eb54577 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:39.270778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:44:39.276500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8a74-b71f-4e8e-836b-201d7273dba7 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:39.276910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8a74-b71f-4e8e-836b-201d7273dba7 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:39.277048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8a74-b71f-4e8e-836b-201d7273dba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:39.294856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-990f8a74-b71f-4e8e-836b-201d7273dba7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:44:39.296028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-990f8a74-b71f-4e8e-836b-201d7273dba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:39.303634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:44:39.338728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6078c03-ec37-41b3-8665-88f99eb54577 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:44:39.349234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6078c03-ec37-41b3-8665-88f99eb54577 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:44:39.352773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99954260-2ff3-433a-98a6-4f728be234cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:44:39.353403 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954260-2ff3-433a-98a6-4f728be234cc service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:39.353699 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954260-2ff3-433a-98a6-4f728be234cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:39.354133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99954260-2ff3-433a-98a6-4f728be234cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:39.363158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99954260-2ff3-433a-98a6-4f728be234cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:44:39.364591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99954260-2ff3-433a-98a6-4f728be234cc service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:44:39.374215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 769/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:44:42.849179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e28f-89cc-49bd-885c-faad0d9ff017 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:42.849628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e28f-89cc-49bd-885c-faad0d9ff017 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:42.849737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e28f-89cc-49bd-885c-faad0d9ff017 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:42.851119 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:44:42.856590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28146c71-78ca-4135-9706-05f4caa7c78d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:42.857008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28146c71-78ca-4135-9706-05f4caa7c78d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:42.857143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28146c71-78ca-4135-9706-05f4caa7c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:42.874768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-28146c71-78ca-4135-9706-05f4caa7c78d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:44:42.875933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-28146c71-78ca-4135-9706-05f4caa7c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:42.883463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:44:43.156732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360e28f-89cc-49bd-885c-faad0d9ff017 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:44:43.158427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e360e28f-89cc-49bd-885c-faad0d9ff017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:43.213552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360e28f-89cc-49bd-885c-faad0d9ff017 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:44:43.217115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67742c00-37e6-4a81-a7c8-731e00197cbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:44:43.217740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67742c00-37e6-4a81-a7c8-731e00197cbb service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:43.218018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67742c00-37e6-4a81-a7c8-731e00197cbb service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:43.218287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67742c00-37e6-4a81-a7c8-731e00197cbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:43.226881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67742c00-37e6-4a81-a7c8-731e00197cbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:44:43.228293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67742c00-37e6-4a81-a7c8-731e00197cbb service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:44:43.237676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 766/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:44:45.499113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448689-ccfa-4993-aa5c-6e7a6540f17c None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:45.499753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448689-ccfa-4993-aa5c-6e7a6540f17c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:45.499753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04448689-ccfa-4993-aa5c-6e7a6540f17c None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:45.501034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Sat May 14 15:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:44:45.506161 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35946ac-b5db-435b-bed2-da33c627e0f5 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:45.506691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35946ac-b5db-435b-bed2-da33c627e0f5 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:45.506797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35946ac-b5db-435b-bed2-da33c627e0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:45.525242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e35946ac-b5db-435b-bed2-da33c627e0f5 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:44:45.526492 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e35946ac-b5db-435b-bed2-da33c627e0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:45.534197 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Sat May 14 15:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:44:45.806769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04448689-ccfa-4993-aa5c-6e7a6540f17c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:44:45.809085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-04448689-ccfa-4993-aa5c-6e7a6540f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:44:45.821606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04448689-ccfa-4993-aa5c-6e7a6540f17c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:44:45.825180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaa991-3130-4de1-a8d2-6a2d88bca269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:44:45.825812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaa991-3130-4de1-a8d2-6a2d88bca269 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:44:45.826091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaa991-3130-4de1-a8d2-6a2d88bca269 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:44:45.826405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaa991-3130-4de1-a8d2-6a2d88bca269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:44:45.837625 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaa991-3130-4de1-a8d2-6a2d88bca269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:44:45.838483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaa991-3130-4de1-a8d2-6a2d88bca269 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:44:45.848379 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 772/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:13.401900 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33508c6-abe6-4abe-a101-460211747175 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.403674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33508c6-abe6-4abe-a101-460211747175 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.404183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33508c6-abe6-4abe-a101-460211747175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.439407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a33508c6-abe6-4abe-a101-460211747175 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:13.441151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a33508c6-abe6-4abe-a101-460211747175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:13.454555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 768/1540] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:13.466530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645877-9e83-40a2-b745-817cda0dd367 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.467535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645877-9e83-40a2-b745-817cda0dd367 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.468068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645877-9e83-40a2-b745-817cda0dd367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.492691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d1645877-9e83-40a2-b745-817cda0dd367 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:13.494358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d1645877-9e83-40a2-b745-817cda0dd367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:13.506867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 773/1541] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:13.511455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33508c6-abe6-4abe-a101-460211747175 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:13.522868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33508c6-abe6-4abe-a101-460211747175 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:13.530948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb95ef4-5c88-4384-a216-1e616e37b0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:13.531933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95ef4-5c88-4384-a216-1e616e37b0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.532605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95ef4-5c88-4384-a216-1e616e37b0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.533086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95ef4-5c88-4384-a216-1e616e37b0b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.534047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb95ef4-5c88-4384-a216-1e616e37b0b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:13.534601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb95ef4-5c88-4384-a216-1e616e37b0b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:13.536466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb95ef4-5c88-4384-a216-1e616e37b0b5 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:13.550276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 769/1542] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:46:13.559078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1645877-9e83-40a2-b745-817cda0dd367 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:13.569865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1645877-9e83-40a2-b745-817cda0dd367 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:13.577966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779477a-e155-4f16-9b2d-fb7a412730f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:13.579087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779477a-e155-4f16-9b2d-fb7a412730f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.579599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779477a-e155-4f16-9b2d-fb7a412730f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.580087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779477a-e155-4f16-9b2d-fb7a412730f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.581027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779477a-e155-4f16-9b2d-fb7a412730f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:13.583334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779477a-e155-4f16-9b2d-fb7a412730f3 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:13.618343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 774/1543] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:13 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:13.623231 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb95ef4-5c88-4384-a216-1e616e37b0b5 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:13.633846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb95ef4-5c88-4384-a216-1e616e37b0b5 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:13.710970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e905be-a15a-4532-a677-d18fe91783f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:13.712036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e905be-a15a-4532-a677-d18fe91783f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.712525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e905be-a15a-4532-a677-d18fe91783f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.713012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e905be-a15a-4532-a677-d18fe91783f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.713925 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e905be-a15a-4532-a677-d18fe91783f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:13.716639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e905be-a15a-4532-a677-d18fe91783f1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:13.720271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394902d-62bf-4d96-b2bf-b53a434b5117 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.720820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394902d-62bf-4d96-b2bf-b53a434b5117 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.721311 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394902d-62bf-4d96-b2bf-b53a434b5117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.750358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2394902d-62bf-4d96-b2bf-b53a434b5117 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:13.752241 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2394902d-62bf-4d96-b2bf-b53a434b5117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:13.767857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 775/1544] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:46:13.771586 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 770/1545] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:13 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:46:13.776163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394902d-62bf-4d96-b2bf-b53a434b5117 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:13.783131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96433076-e12d-4c57-b4a2-0809a8433637 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.783751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96433076-e12d-4c57-b4a2-0809a8433637 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.784251 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96433076-e12d-4c57-b4a2-0809a8433637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.792935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394902d-62bf-4d96-b2bf-b53a434b5117 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:13.807037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0cad0-eebd-41ce-a838-d0d4de250fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:13.807774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0cad0-eebd-41ce-a838-d0d4de250fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.808062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0cad0-eebd-41ce-a838-d0d4de250fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.808341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0cad0-eebd-41ce-a838-d0d4de250fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.814335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0cad0-eebd-41ce-a838-d0d4de250fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:13.814335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0cad0-eebd-41ce-a838-d0d4de250fb9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:13.833553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 776/1546] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:13.837872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0cad0-eebd-41ce-a838-d0d4de250fb9 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:13.843715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-96433076-e12d-4c57-b4a2-0809a8433637 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:13.845442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-96433076-e12d-4c57-b4a2-0809a8433637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:13.861071 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 771/1547] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:46:13.862440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0cad0-eebd-41ce-a838-d0d4de250fb9 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:13.866142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96433076-e12d-4c57-b4a2-0809a8433637 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:13.873229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7126-8589-4175-8cd7-ceb5cb1db74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:13.873921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7126-8589-4175-8cd7-ceb5cb1db74a admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.874233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7126-8589-4175-8cd7-ceb5cb1db74a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.874552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7126-8589-4175-8cd7-ceb5cb1db74a admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.875338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc7126-8589-4175-8cd7-ceb5cb1db74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:13.876983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc7126-8589-4175-8cd7-ceb5cb1db74a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:13.879934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96433076-e12d-4c57-b4a2-0809a8433637 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:13.896801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d4f80-f57e-4893-bd7a-49883c42be17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:13.897920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4f80-f57e-4893-bd7a-49883c42be17 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.898459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4f80-f57e-4893-bd7a-49883c42be17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.898958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4f80-f57e-4893-bd7a-49883c42be17 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.899939 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d4f80-f57e-4893-bd7a-49883c42be17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:13.900474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d4f80-f57e-4893-bd7a-49883c42be17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:13.902291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 777/1548] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:13.903267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d4f80-f57e-4893-bd7a-49883c42be17 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:13.908525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7126-8589-4175-8cd7-ceb5cb1db74a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:13.925094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 772/1549] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:46:13.925482 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7126-8589-4175-8cd7-ceb5cb1db74a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:13.927115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40780c78-c700-4383-9e5b-9628bf39f3f9 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.927644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40780c78-c700-4383-9e5b-9628bf39f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.928143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40780c78-c700-4383-9e5b-9628bf39f3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.942196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3831a53-6d69-43ad-b4d2-a4c224e5bc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:13.943174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3831a53-6d69-43ad-b4d2-a4c224e5bc2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:13.943460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3831a53-6d69-43ad-b4d2-a4c224e5bc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:13.943785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3831a53-6d69-43ad-b4d2-a4c224e5bc2a admin admin] PATH_INFO: `/v3/projects/6388da70b0dc48c1952570af4332dd6d/users/aad828d8ff314a2d82f07fb6d84f36a8/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:13.963525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-40780c78-c700-4383-9e5b-9628bf39f3f9 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:13.965620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-40780c78-c700-4383-9e5b-9628bf39f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:13.970219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3831a53-6d69-43ad-b4d2-a4c224e5bc2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6388da70b0dc48c1952570af4332dd6d, user_id=aad828d8ff314a2d82f07fb6d84f36a8, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:13.973090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3831a53-6d69-43ad-b4d2-a4c224e5bc2a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:13.985809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 773/1550] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:13.987120 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40780c78-c700-4383-9e5b-9628bf39f3f9 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:13.998066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 778/1551] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:13 2022] PUT /identity/v3/projects/6388da70b0dc48c1952570af4332dd6d/users/aad828d8ff314a2d82f07fb6d84f36a8/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:46:14.004779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17964a07-5220-4c24-9fd1-b6eb0124c1fb None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.013396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17964a07-5220-4c24-9fd1-b6eb0124c1fb None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.013396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17964a07-5220-4c24-9fd1-b6eb0124c1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.013751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40780c78-c700-4383-9e5b-9628bf39f3f9 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.029515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-17964a07-5220-4c24-9fd1-b6eb0124c1fb None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.031131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-17964a07-5220-4c24-9fd1-b6eb0124c1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.131828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 779/1552] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.133441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76540-b11a-4367-9715-d611ba4252ac None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.133902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76540-b11a-4367-9715-d611ba4252ac None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.134354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee76540-b11a-4367-9715-d611ba4252ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.153906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-dee76540-b11a-4367-9715-d611ba4252ac None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.155533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-dee76540-b11a-4367-9715-d611ba4252ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.163902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 780/1553] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.165547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab261ece-e0f8-4526-a3cf-77b18544b3b3 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.166042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab261ece-e0f8-4526-a3cf-77b18544b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.177406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab261ece-e0f8-4526-a3cf-77b18544b3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.186335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7338b15a-2214-421a-9e4a-34ce8f8f12ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.186335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338b15a-2214-421a-9e4a-34ce8f8f12ea admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.186335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338b15a-2214-421a-9e4a-34ce8f8f12ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.186335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7338b15a-2214-421a-9e4a-34ce8f8f12ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.186825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338b15a-2214-421a-9e4a-34ce8f8f12ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.186825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: WARNING py.warnings [None req-7338b15a-2214-421a-9e4a-34ce8f8f12ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 15:46:14.186825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: warnings.warn(msg) May 14 15:46:14.186825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: May 14 15:46:14.188063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7338b15a-2214-421a-9e4a-34ce8f8f12ea admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.198417 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-ab261ece-e0f8-4526-a3cf-77b18544b3b3 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.200183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ab261ece-e0f8-4526-a3cf-77b18544b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.209372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 781/1554] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.210217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab261ece-e0f8-4526-a3cf-77b18544b3b3 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.221076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab261ece-e0f8-4526-a3cf-77b18544b3b3 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.228867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10df34-0a77-4b2c-baf0-41e5bc5af50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.229552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10df34-0a77-4b2c-baf0-41e5bc5af50c admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.229825 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10df34-0a77-4b2c-baf0-41e5bc5af50c admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.230106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10df34-0a77-4b2c-baf0-41e5bc5af50c admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.232318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10df34-0a77-4b2c-baf0-41e5bc5af50c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:14.232693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10df34-0a77-4b2c-baf0-41e5bc5af50c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.233827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: WARNING py.warnings [None req-ad10df34-0a77-4b2c-baf0-41e5bc5af50c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 15:46:14.233827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: warnings.warn(msg) May 14 15:46:14.233827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: May 14 15:46:14.235037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10df34-0a77-4b2c-baf0-41e5bc5af50c admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.250600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 774/1555] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:13 2022] POST /identity/v3/projects => generated 393 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:14.252500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a8cc-a489-4387-bb9b-ebc167814c87 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.252792 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a8cc-a489-4387-bb9b-ebc167814c87 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.253116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a8cc-a489-4387-bb9b-ebc167814c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.261397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 782/1556] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:46:14.263342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10df34-0a77-4b2c-baf0-41e5bc5af50c admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.274776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c912a8cc-a489-4387-bb9b-ebc167814c87 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.276240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c912a8cc-a489-4387-bb9b-ebc167814c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.338356 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10df34-0a77-4b2c-baf0-41e5bc5af50c admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.341564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 775/1557] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.342695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a9400-6848-4a76-82c2-9e3a442f4d19 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.342987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a9400-6848-4a76-82c2-9e3a442f4d19 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.343264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a9400-6848-4a76-82c2-9e3a442f4d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.364418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-690a9400-6848-4a76-82c2-9e3a442f4d19 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.365611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-690a9400-6848-4a76-82c2-9e3a442f4d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.375538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 776/1558] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.377393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe695e-837c-4312-b8a0-7a0987301091 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.377677 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe695e-837c-4312-b8a0-7a0987301091 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.377950 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe695e-837c-4312-b8a0-7a0987301091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.389048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9241d6-64dd-4030-bd0e-9176a684ed0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.389693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9241d6-64dd-4030-bd0e-9176a684ed0a service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.389973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9241d6-64dd-4030-bd0e-9176a684ed0a service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.390244 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9241d6-64dd-4030-bd0e-9176a684ed0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.396731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-4afe695e-837c-4312-b8a0-7a0987301091 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.397922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4afe695e-837c-4312-b8a0-7a0987301091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.399923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9241d6-64dd-4030-bd0e-9176a684ed0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.401664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9241d6-64dd-4030-bd0e-9176a684ed0a service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.405933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 777/1559] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.406714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe695e-837c-4312-b8a0-7a0987301091 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.416096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe695e-837c-4312-b8a0-7a0987301091 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.416737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 783/1560] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:14.418615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1096ec8-8073-42e0-b41b-8a7357c9d440 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.418923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1096ec8-8073-42e0-b41b-8a7357c9d440 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.419200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1096ec8-8073-42e0-b41b-8a7357c9d440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.421310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e1048e-d6e2-46bb-bb17-c3bc8d5bf2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.422012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1048e-d6e2-46bb-bb17-c3bc8d5bf2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.422297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1048e-d6e2-46bb-bb17-c3bc8d5bf2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.422618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e1048e-d6e2-46bb-bb17-c3bc8d5bf2e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.423598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1048e-d6e2-46bb-bb17-c3bc8d5bf2e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.425576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e1048e-d6e2-46bb-bb17-c3bc8d5bf2e0 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.437820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b1096ec8-8073-42e0-b41b-8a7357c9d440 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.439308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b1096ec8-8073-42e0-b41b-8a7357c9d440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.448741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 784/1561] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.448882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 778/1562] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:14.449373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1096ec8-8073-42e0-b41b-8a7357c9d440 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.449984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318ec66-a5d8-4068-bc97-a4617d56469f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.450381 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318ec66-a5d8-4068-bc97-a4617d56469f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.450660 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318ec66-a5d8-4068-bc97-a4617d56469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.460221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1096ec8-8073-42e0-b41b-8a7357c9d440 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.464429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68fccb-7d89-4b5d-bf90-293584d79bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.465648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fccb-7d89-4b5d-bf90-293584d79bcf admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.465930 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fccb-7d89-4b5d-bf90-293584d79bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.466197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fccb-7d89-4b5d-bf90-293584d79bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.466989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68fccb-7d89-4b5d-bf90-293584d79bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.468932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68fccb-7d89-4b5d-bf90-293584d79bcf admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.473307 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-8318ec66-a5d8-4068-bc97-a4617d56469f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.474542 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8318ec66-a5d8-4068-bc97-a4617d56469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.483337 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 779/1563] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.484694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33e784-0eab-4eda-b8a4-50687ad242cf None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.484990 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33e784-0eab-4eda-b8a4-50687ad242cf None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.485507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33e784-0eab-4eda-b8a4-50687ad242cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.504285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 785/1564] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:14.505485 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68fccb-7d89-4b5d-bf90-293584d79bcf admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.513174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6d33e784-0eab-4eda-b8a4-50687ad242cf None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.514443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6d33e784-0eab-4eda-b8a4-50687ad242cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.572599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68fccb-7d89-4b5d-bf90-293584d79bcf admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.577986 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6bb034-17d1-4ae6-aada-d47d308e7913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.578365 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bb034-17d1-4ae6-aada-d47d308e7913 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.578646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bb034-17d1-4ae6-aada-d47d308e7913 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.578923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6bb034-17d1-4ae6-aada-d47d308e7913 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.579655 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6bb034-17d1-4ae6-aada-d47d308e7913 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:14.580105 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6bb034-17d1-4ae6-aada-d47d308e7913 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.581685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6bb034-17d1-4ae6-aada-d47d308e7913 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.585273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 780/1565] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.589983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fda653-07e0-4c47-944a-3d8992d28ee9 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.589983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fda653-07e0-4c47-944a-3d8992d28ee9 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.589983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fda653-07e0-4c47-944a-3d8992d28ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.595376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 786/1566] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:46:14.596469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61eb5-4cbb-406f-acf5-0cc1868cb717 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.597095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61eb5-4cbb-406f-acf5-0cc1868cb717 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.597095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c61eb5-4cbb-406f-acf5-0cc1868cb717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.616874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-53fda653-07e0-4c47-944a-3d8992d28ee9 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.618169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-53fda653-07e0-4c47-944a-3d8992d28ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.631303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 781/1567] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.632190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fda653-07e0-4c47-944a-3d8992d28ee9 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.639452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f7c61eb5-4cbb-406f-acf5-0cc1868cb717 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.640726 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f7c61eb5-4cbb-406f-acf5-0cc1868cb717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.649331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 787/1568] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.650703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474f75-2964-4efb-ac73-26e9704e1e24 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.651040 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474f75-2964-4efb-ac73-26e9704e1e24 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.651387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de474f75-2964-4efb-ac73-26e9704e1e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.654026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fda653-07e0-4c47-944a-3d8992d28ee9 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.659414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6924-ba70-4d41-af3e-0f7efbe2d95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.660012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6924-ba70-4d41-af3e-0f7efbe2d95e admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.660358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6924-ba70-4d41-af3e-0f7efbe2d95e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.660722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6924-ba70-4d41-af3e-0f7efbe2d95e admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.661535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a6924-ba70-4d41-af3e-0f7efbe2d95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.663344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a6924-ba70-4d41-af3e-0f7efbe2d95e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.670276 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-de474f75-2964-4efb-ac73-26e9704e1e24 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:14.671750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-de474f75-2964-4efb-ac73-26e9704e1e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:14.676972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 782/1569] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:14.677947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6924-ba70-4d41-af3e-0f7efbe2d95e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.681321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 788/1570] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:14.682363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de474f75-2964-4efb-ac73-26e9704e1e24 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.692768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6924-ba70-4d41-af3e-0f7efbe2d95e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.693432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de474f75-2964-4efb-ac73-26e9704e1e24 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.697702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3283b-c94f-4ae2-964f-a4fc7dc721f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.698416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3283b-c94f-4ae2-964f-a4fc7dc721f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.698745 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3283b-c94f-4ae2-964f-a4fc7dc721f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.700014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3283b-c94f-4ae2-964f-a4fc7dc721f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.700204 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d655601-e439-4e88-bffd-5ef4fdcbb34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.700396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d655601-e439-4e88-bffd-5ef4fdcbb34f admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.700548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3283b-c94f-4ae2-964f-a4fc7dc721f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.700671 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d655601-e439-4e88-bffd-5ef4fdcbb34f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.700942 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d655601-e439-4e88-bffd-5ef4fdcbb34f admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.701596 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d655601-e439-4e88-bffd-5ef4fdcbb34f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:14.701896 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d655601-e439-4e88-bffd-5ef4fdcbb34f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.703083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3283b-c94f-4ae2-964f-a4fc7dc721f3 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.703556 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d655601-e439-4e88-bffd-5ef4fdcbb34f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.716632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 789/1571] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:46:14.717490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d655601-e439-4e88-bffd-5ef4fdcbb34f admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.730855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d655601-e439-4e88-bffd-5ef4fdcbb34f admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.735684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 783/1572] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/users => generated 293 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:14.735905 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb164245-aec9-4616-b5ae-57655a33e9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.736512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3283b-c94f-4ae2-964f-a4fc7dc721f3 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.736637 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164245-aec9-4616-b5ae-57655a33e9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.736815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164245-aec9-4616-b5ae-57655a33e9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.737096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164245-aec9-4616-b5ae-57655a33e9d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.737892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb164245-aec9-4616-b5ae-57655a33e9d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.740083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb164245-aec9-4616-b5ae-57655a33e9d3 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.749410 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3283b-c94f-4ae2-964f-a4fc7dc721f3 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.754332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cd6ed-2753-4021-bfc2-1717972f00f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.755091 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cd6ed-2753-4021-bfc2-1717972f00f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.755455 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cd6ed-2753-4021-bfc2-1717972f00f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.755826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cd6ed-2753-4021-bfc2-1717972f00f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.756611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cd6ed-2753-4021-bfc2-1717972f00f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:14.757012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cd6ed-2753-4021-bfc2-1717972f00f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.758808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cd6ed-2753-4021-bfc2-1717972f00f7 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.776641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 790/1573] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/projects => generated 355 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:14.776866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 784/1574] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:46:14.778068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb164245-aec9-4616-b5ae-57655a33e9d3 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.786533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cd6ed-2753-4021-bfc2-1717972f00f7 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.799144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cd6ed-2753-4021-bfc2-1717972f00f7 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.847965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb164245-aec9-4616-b5ae-57655a33e9d3 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.853081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac53a2-8c3f-4490-be2a-40962a92b83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.853936 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac53a2-8c3f-4490-be2a-40962a92b83d admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.854349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac53a2-8c3f-4490-be2a-40962a92b83d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.854758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac53a2-8c3f-4490-be2a-40962a92b83d admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.856228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac53a2-8c3f-4490-be2a-40962a92b83d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:14.857049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac53a2-8c3f-4490-be2a-40962a92b83d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.858433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac53a2-8c3f-4490-be2a-40962a92b83d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.873727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 791/1575] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:46:14.874878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac53a2-8c3f-4490-be2a-40962a92b83d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.884308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c3d01-23b3-45a0-9d04-ffa9165428ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.885484 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3d01-23b3-45a0-9d04-ffa9165428ea admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.885484 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3d01-23b3-45a0-9d04-ffa9165428ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.885694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c3d01-23b3-45a0-9d04-ffa9165428ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.886662 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c3d01-23b3-45a0-9d04-ffa9165428ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.888780 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c3d01-23b3-45a0-9d04-ffa9165428ea admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.889641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac53a2-8c3f-4490-be2a-40962a92b83d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.894589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7173-f01c-4df6-89e6-e922dbca678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.895258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7173-f01c-4df6-89e6-e922dbca678c admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.895809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7173-f01c-4df6-89e6-e922dbca678c admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.895809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb7173-f01c-4df6-89e6-e922dbca678c admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.896537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb7173-f01c-4df6-89e6-e922dbca678c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:14.896848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb7173-f01c-4df6-89e6-e922dbca678c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.898527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb7173-f01c-4df6-89e6-e922dbca678c admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.902035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 785/1576] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:14.903390 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c3d01-23b3-45a0-9d04-ffa9165428ea admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.915744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c3d01-23b3-45a0-9d04-ffa9165428ea admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.922965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 792/1577] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:46:14.924086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7173-f01c-4df6-89e6-e922dbca678c admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.927822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a24c4-48bb-4984-bedd-02724297f756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.928075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a24c4-48bb-4984-bedd-02724297f756 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.928405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a24c4-48bb-4984-bedd-02724297f756 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.928685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a24c4-48bb-4984-bedd-02724297f756 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.929505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a24c4-48bb-4984-bedd-02724297f756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.932198 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a24c4-48bb-4984-bedd-02724297f756 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.935445 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb7173-f01c-4df6-89e6-e922dbca678c admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.940751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81adbb-0106-4d8d-a901-f65e8806b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.940949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81adbb-0106-4d8d-a901-f65e8806b570 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.941193 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81adbb-0106-4d8d-a901-f65e8806b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.941477 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81adbb-0106-4d8d-a901-f65e8806b570 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.942212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81adbb-0106-4d8d-a901-f65e8806b570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.943879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81adbb-0106-4d8d-a901-f65e8806b570 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:14.954374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 793/1578] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:14.958610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81adbb-0106-4d8d-a901-f65e8806b570 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.969504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81adbb-0106-4d8d-a901-f65e8806b570 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:14.972926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 786/1579] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:14.973924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a24c4-48bb-4984-bedd-02724297f756 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:14.976529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9e889-5ebe-49b1-9955-e23fe7ecd03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:14.977391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9e889-5ebe-49b1-9955-e23fe7ecd03d admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:14.977740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9e889-5ebe-49b1-9955-e23fe7ecd03d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:14.978089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9e889-5ebe-49b1-9955-e23fe7ecd03d admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:14.979070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9e889-5ebe-49b1-9955-e23fe7ecd03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:14.979991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: WARNING py.warnings [None req-c0a9e889-5ebe-49b1-9955-e23fe7ecd03d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 15:46:14.979991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: warnings.warn(msg) May 14 15:46:14.979991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: May 14 15:46:14.982652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9e889-5ebe-49b1-9955-e23fe7ecd03d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.005214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 794/1580] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/users => generated 278 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:15.006281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9e889-5ebe-49b1-9955-e23fe7ecd03d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.016768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9e889-5ebe-49b1-9955-e23fe7ecd03d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.053632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a24c4-48bb-4984-bedd-02724297f756 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.058804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259d499-e275-4d5d-915a-0caae489865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.060257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259d499-e275-4d5d-915a-0caae489865b admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.060543 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259d499-e275-4d5d-915a-0caae489865b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.060844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259d499-e275-4d5d-915a-0caae489865b admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.061526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259d499-e275-4d5d-915a-0caae489865b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.063488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259d499-e275-4d5d-915a-0caae489865b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.086674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e5564-40a1-4f91-8955-b17760752054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.087642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e5564-40a1-4f91-8955-b17760752054 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.088216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e5564-40a1-4f91-8955-b17760752054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.088651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e5564-40a1-4f91-8955-b17760752054 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.089745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e5564-40a1-4f91-8955-b17760752054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.092620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 787/1581] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:14 2022] POST /identity/v3/projects => generated 405 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:15.092904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e5564-40a1-4f91-8955-b17760752054 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.093514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259d499-e275-4d5d-915a-0caae489865b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.123186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 795/1582] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:15 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:15.124028 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e5564-40a1-4f91-8955-b17760752054 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.168271 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259d499-e275-4d5d-915a-0caae489865b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.191041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e5564-40a1-4f91-8955-b17760752054 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.195812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b4524-7e28-4858-b683-d49447a3569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.196472 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b4524-7e28-4858-b683-d49447a3569b admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.196751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b4524-7e28-4858-b683-d49447a3569b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.197028 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b4524-7e28-4858-b683-d49447a3569b admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.197710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b4524-7e28-4858-b683-d49447a3569b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.200177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0b4524-7e28-4858-b683-d49447a3569b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.229697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d14ae-e343-4297-b8aa-4f0a8a5f5f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.230999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 796/1583] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:15 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:15.231185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d14ae-e343-4297-b8aa-4f0a8a5f5f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.231185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d14ae-e343-4297-b8aa-4f0a8a5f5f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.231409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d14ae-e343-4297-b8aa-4f0a8a5f5f7e admin admin] PATH_INFO: `/v3/projects/5d2517d5440a4d30949f3dd36a46d813/users/7b896317d96a40d6a137db0dcf5f98f2/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.232009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b4524-7e28-4858-b683-d49447a3569b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.247452 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d14ae-e343-4297-b8aa-4f0a8a5f5f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d2517d5440a4d30949f3dd36a46d813, user_id=7b896317d96a40d6a137db0dcf5f98f2, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.248563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: WARNING py.warnings [None req-982d14ae-e343-4297-b8aa-4f0a8a5f5f7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 15:46:15.248563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: warnings.warn(msg) May 14 15:46:15.248563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: May 14 15:46:15.250604 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d14ae-e343-4297-b8aa-4f0a8a5f5f7e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.265367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 788/1584] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:15 2022] PUT /identity/v3/projects/5d2517d5440a4d30949f3dd36a46d813/users/7b896317d96a40d6a137db0dcf5f98f2/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:15.266351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d14ae-e343-4297-b8aa-4f0a8a5f5f7e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.304894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b4524-7e28-4858-b683-d49447a3569b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.334121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d14ae-e343-4297-b8aa-4f0a8a5f5f7e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.342764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965122bc-1e29-49b2-b0c5-905f49f66e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.342764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965122bc-1e29-49b2-b0c5-905f49f66e83 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.343556 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965122bc-1e29-49b2-b0c5-905f49f66e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.343842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965122bc-1e29-49b2-b0c5-905f49f66e83 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.344558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965122bc-1e29-49b2-b0c5-905f49f66e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.346744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965122bc-1e29-49b2-b0c5-905f49f66e83 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.371707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 789/1585] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:15 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:15.372624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965122bc-1e29-49b2-b0c5-905f49f66e83 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.381506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b71f87-6a2f-4f0f-b4eb-3f00a3b4d78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.382429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71f87-6a2f-4f0f-b4eb-3f00a3b4d78a admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.382696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71f87-6a2f-4f0f-b4eb-3f00a3b4d78a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.382982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b71f87-6a2f-4f0f-b4eb-3f00a3b4d78a admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.383145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965122bc-1e29-49b2-b0c5-905f49f66e83 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.383804 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b71f87-6a2f-4f0f-b4eb-3f00a3b4d78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.385395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b71f87-6a2f-4f0f-b4eb-3f00a3b4d78a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.388654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c8f36-6cf9-4f1a-8b5f-27f547861648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.389319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8f36-6cf9-4f1a-8b5f-27f547861648 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.389602 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8f36-6cf9-4f1a-8b5f-27f547861648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.389879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c8f36-6cf9-4f1a-8b5f-27f547861648 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.390650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c8f36-6cf9-4f1a-8b5f-27f547861648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.392275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c8f36-6cf9-4f1a-8b5f-27f547861648 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.399852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 797/1586] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:15.399852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b71f87-6a2f-4f0f-b4eb-3f00a3b4d78a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.405490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 790/1587] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:15.406259 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c8f36-6cf9-4f1a-8b5f-27f547861648 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.411830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b71f87-6a2f-4f0f-b4eb-3f00a3b4d78a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.417457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c117a21-48d2-41fa-aa84-1d3970af8c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.417629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c8f36-6cf9-4f1a-8b5f-27f547861648 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.417907 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117a21-48d2-41fa-aa84-1d3970af8c49 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.418263 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117a21-48d2-41fa-aa84-1d3970af8c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.418620 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c117a21-48d2-41fa-aa84-1d3970af8c49 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.419693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c117a21-48d2-41fa-aa84-1d3970af8c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.421705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c117a21-48d2-41fa-aa84-1d3970af8c49 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.423162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2ecfb-0fd4-4ac7-9be7-a61f7e8e4721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.423829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2ecfb-0fd4-4ac7-9be7-a61f7e8e4721 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.424112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2ecfb-0fd4-4ac7-9be7-a61f7e8e4721 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.424386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2ecfb-0fd4-4ac7-9be7-a61f7e8e4721 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.425105 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2ecfb-0fd4-4ac7-9be7-a61f7e8e4721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.427540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2ecfb-0fd4-4ac7-9be7-a61f7e8e4721 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.458425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 798/1588] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:15 2022] POST /identity/v3/users => generated 303 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:15.458425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c117a21-48d2-41fa-aa84-1d3970af8c49 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.458749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 791/1589] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:15 2022] POST /identity/v3/users => generated 286 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:15.459185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf8bd1-6b85-4434-9432-ef01256762a0 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.459383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf8bd1-6b85-4434-9432-ef01256762a0 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.461401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf8bd1-6b85-4434-9432-ef01256762a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.473057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c117a21-48d2-41fa-aa84-1d3970af8c49 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.477899 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f0240-e80e-449a-a0ef-e8ee8f7611ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.478635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f0240-e80e-449a-a0ef-e8ee8f7611ba admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.478917 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f0240-e80e-449a-a0ef-e8ee8f7611ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.479189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f0240-e80e-449a-a0ef-e8ee8f7611ba admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.479925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f0240-e80e-449a-a0ef-e8ee8f7611ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.482124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f0240-e80e-449a-a0ef-e8ee8f7611ba admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.482588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-fbaf8bd1-6b85-4434-9432-ef01256762a0 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:15.484665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-fbaf8bd1-6b85-4434-9432-ef01256762a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:15.493902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 792/1590] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:15.495369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30733-5522-44cd-80e6-1de6f7736194 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.495662 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30733-5522-44cd-80e6-1de6f7736194 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.495941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30733-5522-44cd-80e6-1de6f7736194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.511756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 799/1591] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:15 2022] POST /identity/v3/users => generated 292 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:15.513148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f0240-e80e-449a-a0ef-e8ee8f7611ba admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.523759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f0240-e80e-449a-a0ef-e8ee8f7611ba admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.526014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-1ae30733-5522-44cd-80e6-1de6f7736194 None None] MFA Rules not processed for user `aad828d8ff314a2d82f07fb6d84f36a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:15.528493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1ae30733-5522-44cd-80e6-1de6f7736194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:15.529441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19f29-9fd9-47b6-954b-0972f7c2ec3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.530180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19f29-9fd9-47b6-954b-0972f7c2ec3f admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.530563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19f29-9fd9-47b6-954b-0972f7c2ec3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.530912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd19f29-9fd9-47b6-954b-0972f7c2ec3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.531712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd19f29-9fd9-47b6-954b-0972f7c2ec3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.533398 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd19f29-9fd9-47b6-954b-0972f7c2ec3f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.544912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 800/1592] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:15.545870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19f29-9fd9-47b6-954b-0972f7c2ec3f admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.555597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd19f29-9fd9-47b6-954b-0972f7c2ec3f admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.560517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b993-fccf-4cdd-8e17-ea66fff5d778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.561405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b993-fccf-4cdd-8e17-ea66fff5d778 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.561687 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b993-fccf-4cdd-8e17-ea66fff5d778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.561959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276b993-fccf-4cdd-8e17-ea66fff5d778 admin admin] PATH_INFO: `/v3/projects/7905689c95d44a5c9169249c70f7de57/users/dc43895177134e9c9c030a9d87f94aaa/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.577534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276b993-fccf-4cdd-8e17-ea66fff5d778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7905689c95d44a5c9169249c70f7de57, user_id=dc43895177134e9c9c030a9d87f94aaa, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.580223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276b993-fccf-4cdd-8e17-ea66fff5d778 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.593461 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 801/1593] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:15 2022] PUT /identity/v3/projects/7905689c95d44a5c9169249c70f7de57/users/dc43895177134e9c9c030a9d87f94aaa/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:15.594294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b993-fccf-4cdd-8e17-ea66fff5d778 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.598885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 793/1594] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:15.600098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae30733-5522-44cd-80e6-1de6f7736194 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.614070 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae30733-5522-44cd-80e6-1de6f7736194 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.655441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276b993-fccf-4cdd-8e17-ea66fff5d778 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.660055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426661c-5910-4a43-a594-c7341f81126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.660708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426661c-5910-4a43-a594-c7341f81126b admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.660996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426661c-5910-4a43-a594-c7341f81126b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.661276 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426661c-5910-4a43-a594-c7341f81126b admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.662033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426661c-5910-4a43-a594-c7341f81126b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.663680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426661c-5910-4a43-a594-c7341f81126b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.669438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66b70a-bc20-49d9-a9f7-5a7f71a118c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.670105 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66b70a-bc20-49d9-a9f7-5a7f71a118c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.670436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66b70a-bc20-49d9-a9f7-5a7f71a118c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.670731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66b70a-bc20-49d9-a9f7-5a7f71a118c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.671554 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66b70a-bc20-49d9-a9f7-5a7f71a118c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.673138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66b70a-bc20-49d9-a9f7-5a7f71a118c1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.674357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 802/1595] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:15.674887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426661c-5910-4a43-a594-c7341f81126b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.683313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 794/1596] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:15.684766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66b70a-bc20-49d9-a9f7-5a7f71a118c1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.686469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6f66b70a-bc20-49d9-a9f7-5a7f71a118c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:15.686911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426661c-5910-4a43-a594-c7341f81126b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.691417 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b20161-81cc-4601-8987-fdf3a55a98b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.692075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b20161-81cc-4601-8987-fdf3a55a98b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.692841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b20161-81cc-4601-8987-fdf3a55a98b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.692841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b20161-81cc-4601-8987-fdf3a55a98b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.693372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b20161-81cc-4601-8987-fdf3a55a98b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.695035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b20161-81cc-4601-8987-fdf3a55a98b5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.704993 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 803/1597] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:15.705635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b20161-81cc-4601-8987-fdf3a55a98b5 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.715259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b20161-81cc-4601-8987-fdf3a55a98b5 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.719957 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeaa30-1ab9-4ac5-a7e1-f6b1bf6e265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.720610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeaa30-1ab9-4ac5-a7e1-f6b1bf6e265e admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.720888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeaa30-1ab9-4ac5-a7e1-f6b1bf6e265e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.721166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eeaa30-1ab9-4ac5-a7e1-f6b1bf6e265e admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.721883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeaa30-1ab9-4ac5-a7e1-f6b1bf6e265e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.723519 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eeaa30-1ab9-4ac5-a7e1-f6b1bf6e265e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.734680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 804/1598] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:15.735882 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeaa30-1ab9-4ac5-a7e1-f6b1bf6e265e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.743427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66b70a-bc20-49d9-a9f7-5a7f71a118c1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.745480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eeaa30-1ab9-4ac5-a7e1-f6b1bf6e265e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.747839 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671566f-c412-4b03-a66e-51ea36519f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.748447 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671566f-c412-4b03-a66e-51ea36519f47 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.748734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671566f-c412-4b03-a66e-51ea36519f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.749017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671566f-c412-4b03-a66e-51ea36519f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.751444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525c382-1f8b-4edc-8e51-dfd54d2ed0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.752220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525c382-1f8b-4edc-8e51-dfd54d2ed0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.752582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525c382-1f8b-4edc-8e51-dfd54d2ed0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.752968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525c382-1f8b-4edc-8e51-dfd54d2ed0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.753685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525c382-1f8b-4edc-8e51-dfd54d2ed0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.755686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525c382-1f8b-4edc-8e51-dfd54d2ed0d3 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.758240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671566f-c412-4b03-a66e-51ea36519f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.759716 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671566f-c412-4b03-a66e-51ea36519f47 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.766886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 805/1599] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:15.767993 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252b63-fb42-456c-88a7-0c44f8e248cf None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.768368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252b63-fb42-456c-88a7-0c44f8e248cf None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.768678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252b63-fb42-456c-88a7-0c44f8e248cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.773042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 795/1600] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:15.774231 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a256a-e45b-4871-bc88-07c31fb58285 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.774547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a256a-e45b-4871-bc88-07c31fb58285 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.774826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a256a-e45b-4871-bc88-07c31fb58285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.787511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b2252b63-fb42-456c-88a7-0c44f8e248cf None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:15.788803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b2252b63-fb42-456c-88a7-0c44f8e248cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:15.792640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-450a256a-e45b-4871-bc88-07c31fb58285 None None] MFA Rules not processed for user `aad828d8ff314a2d82f07fb6d84f36a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:15.794613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-450a256a-e45b-4871-bc88-07c31fb58285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:15.801423 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 806/1601] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:15.804585 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2252b63-fb42-456c-88a7-0c44f8e248cf None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.817817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2252b63-fb42-456c-88a7-0c44f8e248cf None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.822782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f400825-7006-46c9-8858-0e5353297de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.823785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f400825-7006-46c9-8858-0e5353297de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.824161 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f400825-7006-46c9-8858-0e5353297de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.824660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f400825-7006-46c9-8858-0e5353297de0 admin admin] PATH_INFO: `/v3/projects/b0c91bdeb3f74cd1b8ebd7c3dea20cd6/users/9e1d8b4b41d0471c858c6beedff7881c/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.840544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f400825-7006-46c9-8858-0e5353297de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c91bdeb3f74cd1b8ebd7c3dea20cd6, user_id=9e1d8b4b41d0471c858c6beedff7881c, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.843409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f400825-7006-46c9-8858-0e5353297de0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.859981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 807/1602] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:15 2022] PUT /identity/v3/projects/b0c91bdeb3f74cd1b8ebd7c3dea20cd6/users/9e1d8b4b41d0471c858c6beedff7881c/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:15.861587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f400825-7006-46c9-8858-0e5353297de0 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.865058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 796/1603] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:15.866437 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a256a-e45b-4871-bc88-07c31fb58285 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.886174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a256a-e45b-4871-bc88-07c31fb58285 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.947986 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f400825-7006-46c9-8858-0e5353297de0 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.952016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bfc91-d696-4758-8f52-d8f7410eb0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.952760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bfc91-d696-4758-8f52-d8f7410eb0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.953045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bfc91-d696-4758-8f52-d8f7410eb0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.953318 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bfc91-d696-4758-8f52-d8f7410eb0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.954055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bfc91-d696-4758-8f52-d8f7410eb0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.955709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0a085-fa9c-4975-acf2-2dc88ca85ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.956361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bfc91-d696-4758-8f52-d8f7410eb0a1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.956590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0a085-fa9c-4975-acf2-2dc88ca85ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.957076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0a085-fa9c-4975-acf2-2dc88ca85ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.957523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0a085-fa9c-4975-acf2-2dc88ca85ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.958873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0a085-fa9c-4975-acf2-2dc88ca85ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:15.960753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0a085-fa9c-4975-acf2-2dc88ca85ff3 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:15.974268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 808/1604] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:15.978062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0a085-fa9c-4975-acf2-2dc88ca85ff3 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.980044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 797/1605] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:15.981365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bfc91-d696-4758-8f52-d8f7410eb0a1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:15.992075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0a085-fa9c-4975-acf2-2dc88ca85ff3 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.997169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4799f-024e-4fd2-8565-55c22fa33806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:15.997438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bfc91-d696-4758-8f52-d8f7410eb0a1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:15.997992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4799f-024e-4fd2-8565-55c22fa33806 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:15.998214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4799f-024e-4fd2-8565-55c22fa33806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:15.998700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4799f-024e-4fd2-8565-55c22fa33806 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:15.999532 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4799f-024e-4fd2-8565-55c22fa33806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:16.001082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4799f-024e-4fd2-8565-55c22fa33806 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:16.002620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c135b6f-9e44-4fc8-8b9d-07c7eee86857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:16.003512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c135b6f-9e44-4fc8-8b9d-07c7eee86857 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.003806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c135b6f-9e44-4fc8-8b9d-07c7eee86857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.004072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c135b6f-9e44-4fc8-8b9d-07c7eee86857 admin admin] PATH_INFO: `/v3/projects/0672be3fa3f7414da1c1a5b7300abbe7/users/58bfb7417bc94583963401ae0fe9d39a/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.012049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 809/1606] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:16.013070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4799f-024e-4fd2-8565-55c22fa33806 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:16.019817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c135b6f-9e44-4fc8-8b9d-07c7eee86857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0672be3fa3f7414da1c1a5b7300abbe7, user_id=58bfb7417bc94583963401ae0fe9d39a, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:16.022498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c135b6f-9e44-4fc8-8b9d-07c7eee86857 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:16.042528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 798/1607] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:15 2022] PUT /identity/v3/projects/0672be3fa3f7414da1c1a5b7300abbe7/users/58bfb7417bc94583963401ae0fe9d39a/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:16.042528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d236b47-3055-4a58-bf9a-46efb45c52c0 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.042528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d236b47-3055-4a58-bf9a-46efb45c52c0 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.042528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d236b47-3055-4a58-bf9a-46efb45c52c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.071799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7d236b47-3055-4a58-bf9a-46efb45c52c0 None None] MFA Rules not processed for user `9e1d8b4b41d0471c858c6beedff7881c`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:16.073472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7d236b47-3055-4a58-bf9a-46efb45c52c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:16.078558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4799f-024e-4fd2-8565-55c22fa33806 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:16.151140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d00b2-2160-4af8-8c70-9d55d2fcc8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:16.151827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d00b2-2160-4af8-8c70-9d55d2fcc8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.152261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d00b2-2160-4af8-8c70-9d55d2fcc8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.152374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d00b2-2160-4af8-8c70-9d55d2fcc8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.159332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 799/1608] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:16.161065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef15c06-d60e-49cb-ae82-0ebb1c7da594 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.161575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef15c06-d60e-49cb-ae82-0ebb1c7da594 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.162153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef15c06-d60e-49cb-ae82-0ebb1c7da594 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.169479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 800/1609] 10.222.0.61 () {54 vars in 961 bytes} [Sat May 14 15:46:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:46:16.170709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef15c06-d60e-49cb-ae82-0ebb1c7da594 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:16.240272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d00b2-2160-4af8-8c70-9d55d2fcc8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:16.242069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d00b2-2160-4af8-8c70-9d55d2fcc8b2 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:16.252978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 810/1610] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:16.253775 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d00b2-2160-4af8-8c70-9d55d2fcc8b2 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:16.257624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef15c06-d60e-49cb-ae82-0ebb1c7da594 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:16.262935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a96f-4329-4f2c-88c1-30f6f73ab7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:16.263497 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d00b2-2160-4af8-8c70-9d55d2fcc8b2 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:16.263829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a96f-4329-4f2c-88c1-30f6f73ab7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.264694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a96f-4329-4f2c-88c1-30f6f73ab7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.264694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a96f-4329-4f2c-88c1-30f6f73ab7a6 admin admin] PATH_INFO: `/v3/projects/21a8fa8fe7024dcd9256b27c88831fa4/users/971e9d487b7c4777b546c8753fec7e5d/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.268494 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1c946-73c7-4f9c-a39d-afe876e8bb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:16.269376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1c946-73c7-4f9c-a39d-afe876e8bb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.269970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1c946-73c7-4f9c-a39d-afe876e8bb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.269970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1c946-73c7-4f9c-a39d-afe876e8bb00 admin admin] PATH_INFO: `/v3/projects/8a926765ff1b48c09ae97181c680dc32/users/a2c83fd0cfa64b9bbdea991e485317ad/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.280619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a96f-4329-4f2c-88c1-30f6f73ab7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a8fa8fe7024dcd9256b27c88831fa4, user_id=971e9d487b7c4777b546c8753fec7e5d, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:16.283295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2a96f-4329-4f2c-88c1-30f6f73ab7a6 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:16.286886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1c946-73c7-4f9c-a39d-afe876e8bb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a926765ff1b48c09ae97181c680dc32, user_id=a2c83fd0cfa64b9bbdea991e485317ad, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:16.289949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1c946-73c7-4f9c-a39d-afe876e8bb00 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:16.297723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 801/1611] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:16 2022] PUT /identity/v3/projects/21a8fa8fe7024dcd9256b27c88831fa4/users/971e9d487b7c4777b546c8753fec7e5d/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:16.298845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a96f-4329-4f2c-88c1-30f6f73ab7a6 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:16.325395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 811/1612] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:16 2022] PUT /identity/v3/projects/8a926765ff1b48c09ae97181c680dc32/users/a2c83fd0cfa64b9bbdea991e485317ad/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:16.325395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bae78-8efc-43bf-9a0c-5860c0dc8fe8 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.325395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bae78-8efc-43bf-9a0c-5860c0dc8fe8 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.325395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bae78-8efc-43bf-9a0c-5860c0dc8fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.337318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b80bae78-8efc-43bf-9a0c-5860c0dc8fe8 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:16.338765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b80bae78-8efc-43bf-9a0c-5860c0dc8fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:16.376366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a96f-4329-4f2c-88c1-30f6f73ab7a6 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:16.403426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 812/1613] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:16.406583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bae78-8efc-43bf-9a0c-5860c0dc8fe8 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:16.414752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bae78-8efc-43bf-9a0c-5860c0dc8fe8 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:16.422147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7189f-4514-4b02-95ea-ada4483bef88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:16.422987 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7189f-4514-4b02-95ea-ada4483bef88 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.423356 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7189f-4514-4b02-95ea-ada4483bef88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.423706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7189f-4514-4b02-95ea-ada4483bef88 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.424660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7189f-4514-4b02-95ea-ada4483bef88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:16.426808 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7189f-4514-4b02-95ea-ada4483bef88 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:16.444737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453bbeb-b4da-464b-ae42-a1113c82d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:16.445689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bbeb-b4da-464b-ae42-a1113c82d2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.445969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bbeb-b4da-464b-ae42-a1113c82d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.446243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bbeb-b4da-464b-ae42-a1113c82d2ce admin admin] PATH_INFO: `/v3/projects/b97938b286404711bf362311d1daca56/users/92367a7cee05488e8227ef625e4e240c/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.461978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453bbeb-b4da-464b-ae42-a1113c82d2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97938b286404711bf362311d1daca56, user_id=92367a7cee05488e8227ef625e4e240c, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:16.464652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453bbeb-b4da-464b-ae42-a1113c82d2ce admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:16.468092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 813/1614] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:16 2022] POST /identity/v3/projects => generated 357 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:16.469938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355534d-15d7-4034-ae1d-1044e8f7e019 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.470232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355534d-15d7-4034-ae1d-1044e8f7e019 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.470536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355534d-15d7-4034-ae1d-1044e8f7e019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.492997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 802/1615] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:16 2022] PUT /identity/v3/projects/b97938b286404711bf362311d1daca56/users/92367a7cee05488e8227ef625e4e240c/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:16.492997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c727857-ddae-4950-9b5d-9473fcb27453 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.492997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c727857-ddae-4950-9b5d-9473fcb27453 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.492997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c727857-ddae-4950-9b5d-9473fcb27453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.495878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-0355534d-15d7-4034-ae1d-1044e8f7e019 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:16.498288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0355534d-15d7-4034-ae1d-1044e8f7e019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:16.513908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6c727857-ddae-4950-9b5d-9473fcb27453 None None] MFA Rules not processed for user `971e9d487b7c4777b546c8753fec7e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:16.516846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6c727857-ddae-4950-9b5d-9473fcb27453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:16.618556 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 814/1616] 10.222.0.61 () {58 vars in 1058 bytes} [Sat May 14 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:16.621489 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c88ce7-acf0-406d-adf2-5ba81d168bdd None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.621785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c88ce7-acf0-406d-adf2-5ba81d168bdd None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.622070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c88ce7-acf0-406d-adf2-5ba81d168bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.631951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 803/1617] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:16.638616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c727857-ddae-4950-9b5d-9473fcb27453 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:16.684650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b7c88ce7-acf0-406d-adf2-5ba81d168bdd None None] MFA Rules not processed for user `a2c83fd0cfa64b9bbdea991e485317ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:16.685904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b7c88ce7-acf0-406d-adf2-5ba81d168bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:16.700240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c727857-ddae-4950-9b5d-9473fcb27453 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:16.703982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df3ea6-55c9-4228-93c0-afa66d38cafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:16.704637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3ea6-55c9-4228-93c0-afa66d38cafe service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.704920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3ea6-55c9-4228-93c0-afa66d38cafe service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.705197 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df3ea6-55c9-4228-93c0-afa66d38cafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.810414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 815/1618] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:16.810414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c88ce7-acf0-406d-adf2-5ba81d168bdd None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:16.826045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df3ea6-55c9-4228-93c0-afa66d38cafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:16.827802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df3ea6-55c9-4228-93c0-afa66d38cafe service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:16.827958 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c88ce7-acf0-406d-adf2-5ba81d168bdd None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:16.843901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8e947-d626-4479-941a-68dcf932694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:16.844696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8e947-d626-4479-941a-68dcf932694e admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.844989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8e947-d626-4479-941a-68dcf932694e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.845273 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8e947-d626-4479-941a-68dcf932694e admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.846030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8e947-d626-4479-941a-68dcf932694e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:16.848496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8e947-d626-4479-941a-68dcf932694e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:16.861387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 804/1619] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:16.862983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b28f5-3bdd-4abd-9484-9f5d9cc0ee1e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.863371 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b28f5-3bdd-4abd-9484-9f5d9cc0ee1e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.864238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b28f5-3bdd-4abd-9484-9f5d9cc0ee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.883888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 816/1620] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:16 2022] POST /identity/v3/users => generated 285 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:16.885717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8e947-d626-4479-941a-68dcf932694e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:16.899588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8e947-d626-4479-941a-68dcf932694e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:16.910511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b791f-bd04-436f-88b8-e1f17a8be8f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:16.911370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b791f-bd04-436f-88b8-e1f17a8be8f6 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:16.911844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b791f-bd04-436f-88b8-e1f17a8be8f6 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:16.912121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b791f-bd04-436f-88b8-e1f17a8be8f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:16.919225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-064b28f5-3bdd-4abd-9484-9f5d9cc0ee1e None None] MFA Rules not processed for user `92367a7cee05488e8227ef625e4e240c`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:16.920569 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-064b28f5-3bdd-4abd-9484-9f5d9cc0ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:17.014009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b791f-bd04-436f-88b8-e1f17a8be8f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:17.016977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b791f-bd04-436f-88b8-e1f17a8be8f6 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:17.037768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 817/1621] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:17.040634 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b791f-bd04-436f-88b8-e1f17a8be8f6 service nova] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:17.043092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 805/1622] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:17.046628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30678d-cd67-462f-89c9-2b787ee3ae60 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.046922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30678d-cd67-462f-89c9-2b787ee3ae60 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.047201 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30678d-cd67-462f-89c9-2b787ee3ae60 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.052376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 806/1623] 10.222.0.61 () {54 vars in 961 bytes} [Sat May 14 15:46:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:46:17.054713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30678d-cd67-462f-89c9-2b787ee3ae60 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:17.062993 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b791f-bd04-436f-88b8-e1f17a8be8f6 service nova] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:17.075423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30678d-cd67-462f-89c9-2b787ee3ae60 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:17.076666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afef18-d0ce-4b09-ae61-ad3272c2a95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:17.077346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afef18-d0ce-4b09-ae61-ad3272c2a95d admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.077634 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afef18-d0ce-4b09-ae61-ad3272c2a95d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.077912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afef18-d0ce-4b09-ae61-ad3272c2a95d admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.078652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afef18-d0ce-4b09-ae61-ad3272c2a95d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:17.081109 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afef18-d0ce-4b09-ae61-ad3272c2a95d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:17.092709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160be5c-7d4a-4315-8b14-b8c734a324e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:17.093381 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160be5c-7d4a-4315-8b14-b8c734a324e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.093662 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160be5c-7d4a-4315-8b14-b8c734a324e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.093935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160be5c-7d4a-4315-8b14-b8c734a324e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.094698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160be5c-7d4a-4315-8b14-b8c734a324e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:17.096752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160be5c-7d4a-4315-8b14-b8c734a324e2 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:17.114413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 807/1624] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:17.116218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193b34c-2065-49e4-bbb5-ed748cf7f565 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.116510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193b34c-2065-49e4-bbb5-ed748cf7f565 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.116780 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193b34c-2065-49e4-bbb5-ed748cf7f565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.132740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 818/1625] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:17 2022] POST /identity/v3/projects => generated 405 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:17.133663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afef18-d0ce-4b09-ae61-ad3272c2a95d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:17.163472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-3193b34c-2065-49e4-bbb5-ed748cf7f565 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:17.164694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3193b34c-2065-49e4-bbb5-ed748cf7f565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:17.243263 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afef18-d0ce-4b09-ae61-ad3272c2a95d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:17.250105 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd93b-aad2-4f79-b415-814867550fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:17.251190 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd93b-aad2-4f79-b415-814867550fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.251510 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd93b-aad2-4f79-b415-814867550fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.252240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1dd93b-aad2-4f79-b415-814867550fb6 admin admin] PATH_INFO: `/v3/projects/9935a9d0641a4204a830d39c664a63a9/users/3317a2e40d774bf38463e6a35a4cb082/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.270860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dd93b-aad2-4f79-b415-814867550fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9935a9d0641a4204a830d39c664a63a9, user_id=3317a2e40d774bf38463e6a35a4cb082, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:17.273866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1dd93b-aad2-4f79-b415-814867550fb6 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:17.297599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 819/1626] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:17 2022] PUT /identity/v3/projects/9935a9d0641a4204a830d39c664a63a9/users/3317a2e40d774bf38463e6a35a4cb082/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:17.297599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd93b-aad2-4f79-b415-814867550fb6 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:17.317026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 808/1627] 10.222.0.61 () {58 vars in 1058 bytes} [Sat May 14 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:17.318138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193b34c-2065-49e4-bbb5-ed748cf7f565 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:17.345600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193b34c-2065-49e4-bbb5-ed748cf7f565 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:17.378104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1dd93b-aad2-4f79-b415-814867550fb6 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:17.384731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b14741-2028-4572-9e29-ab2101addd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:17.385954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b14741-2028-4572-9e29-ab2101addd98 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.386336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b14741-2028-4572-9e29-ab2101addd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.386700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b14741-2028-4572-9e29-ab2101addd98 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.388001 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b14741-2028-4572-9e29-ab2101addd98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:17.390131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b14741-2028-4572-9e29-ab2101addd98 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:17.424999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 820/1628] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:17 2022] POST /identity/v3/users => generated 309 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:17.431075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b14741-2028-4572-9e29-ab2101addd98 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:17.477477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c8a1a-1f74-49ba-9898-aab74299cdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:17.478167 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c8a1a-1f74-49ba-9898-aab74299cdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.478480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c8a1a-1f74-49ba-9898-aab74299cdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.478758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c8a1a-1f74-49ba-9898-aab74299cdf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.479500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c8a1a-1f74-49ba-9898-aab74299cdf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:17.481707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c8a1a-1f74-49ba-9898-aab74299cdf8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:17.511461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 809/1629] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:17.512394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c8a1a-1f74-49ba-9898-aab74299cdf8 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:17.539131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c8a1a-1f74-49ba-9898-aab74299cdf8 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:17.551991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e06f7c-5706-4a1c-859e-eccf9dff92cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:17.552601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e06f7c-5706-4a1c-859e-eccf9dff92cd admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.552884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e06f7c-5706-4a1c-859e-eccf9dff92cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.553160 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e06f7c-5706-4a1c-859e-eccf9dff92cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.557723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e06f7c-5706-4a1c-859e-eccf9dff92cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:17.560665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e06f7c-5706-4a1c-859e-eccf9dff92cd admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:17.586250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 810/1630] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:17.589252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e06f7c-5706-4a1c-859e-eccf9dff92cd admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:17.606346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b14741-2028-4572-9e29-ab2101addd98 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:17.611892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e06f7c-5706-4a1c-859e-eccf9dff92cd admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:17.618402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43826ad8-9cb9-49f2-8598-d19638a97966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:17.619098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddc2cf-3b97-439f-9ec2-965798006db3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:17.620055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43826ad8-9cb9-49f2-8598-d19638a97966 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.620610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43826ad8-9cb9-49f2-8598-d19638a97966 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.621822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43826ad8-9cb9-49f2-8598-d19638a97966 admin admin] PATH_INFO: `/v3/projects/9935a9d0641a4204a830d39c664a63a9/users/3317a2e40d774bf38463e6a35a4cb082/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.622036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc2cf-3b97-439f-9ec2-965798006db3 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.622270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc2cf-3b97-439f-9ec2-965798006db3 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.622600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddc2cf-3b97-439f-9ec2-965798006db3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.625353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43826ad8-9cb9-49f2-8598-d19638a97966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9935a9d0641a4204a830d39c664a63a9, user_id=3317a2e40d774bf38463e6a35a4cb082, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:17.629015 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43826ad8-9cb9-49f2-8598-d19638a97966 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:17.644497 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 811/1631] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:17 2022] PUT /identity/v3/projects/9935a9d0641a4204a830d39c664a63a9/users/3317a2e40d774bf38463e6a35a4cb082/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:17.645613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43826ad8-9cb9-49f2-8598-d19638a97966 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:17.753790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43826ad8-9cb9-49f2-8598-d19638a97966 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:17.759601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273bfba-9e53-4b04-8e69-e5c2492ba549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:17.761601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273bfba-9e53-4b04-8e69-e5c2492ba549 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.762080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273bfba-9e53-4b04-8e69-e5c2492ba549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.762419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273bfba-9e53-4b04-8e69-e5c2492ba549 admin admin] PATH_INFO: `/v3/projects/1bd6ed025a45462794005d8150c08f41/users/c0b69dd453eb4733894425a002041501/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.777039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddc2cf-3b97-439f-9ec2-965798006db3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:17.780421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ddc2cf-3b97-439f-9ec2-965798006db3 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:17.784224 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273bfba-9e53-4b04-8e69-e5c2492ba549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd6ed025a45462794005d8150c08f41, user_id=c0b69dd453eb4733894425a002041501, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:17.788176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273bfba-9e53-4b04-8e69-e5c2492ba549 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:17.806358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 821/1632] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:17.812428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35273a64-6aa1-4733-88f1-160ae811d2d6 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.812736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35273a64-6aa1-4733-88f1-160ae811d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.813029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35273a64-6aa1-4733-88f1-160ae811d2d6 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.818182 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 822/1633] 10.222.0.61 () {54 vars in 912 bytes} [Sat May 14 15:46:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:46:17.832145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 812/1634] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:17 2022] PUT /identity/v3/projects/1bd6ed025a45462794005d8150c08f41/users/c0b69dd453eb4733894425a002041501/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:17.832145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122260d-dc94-473d-a148-8a2fe720d413 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.833211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122260d-dc94-473d-a148-8a2fe720d413 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.834083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122260d-dc94-473d-a148-8a2fe720d413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.845166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348aadb-f57d-4c35-a9a6-da105922c2fd None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:17.845663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348aadb-f57d-4c35-a9a6-da105922c2fd None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:17.846601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348aadb-f57d-4c35-a9a6-da105922c2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:17.883583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-9122260d-dc94-473d-a148-8a2fe720d413 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:17.888530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9122260d-dc94-473d-a148-8a2fe720d413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:17.899036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-8348aadb-f57d-4c35-a9a6-da105922c2fd None None] MFA Rules not processed for user `3317a2e40d774bf38463e6a35a4cb082`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:17.900685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8348aadb-f57d-4c35-a9a6-da105922c2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:18.082636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 823/1635] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:18.082636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348aadb-f57d-4c35-a9a6-da105922c2fd None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:18.091060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 813/1636] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:46:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:18.107378 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122260d-dc94-473d-a148-8a2fe720d413 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:18.261334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348aadb-f57d-4c35-a9a6-da105922c2fd None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:18.278008 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122260d-dc94-473d-a148-8a2fe720d413 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:18.280887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0b6d-c506-473f-a488-22f9c3f541ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:18.281094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0b6d-c506-473f-a488-22f9c3f541ba admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:18.281294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0b6d-c506-473f-a488-22f9c3f541ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:18.281806 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0b6d-c506-473f-a488-22f9c3f541ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:18.282579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a0b6d-c506-473f-a488-22f9c3f541ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:18.286861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a0b6d-c506-473f-a488-22f9c3f541ba admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:18.294428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183b484-d4ce-421e-9dbb-12ce7d579710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:18.295928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183b484-d4ce-421e-9dbb-12ce7d579710 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:18.295928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183b484-d4ce-421e-9dbb-12ce7d579710 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:18.296372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183b484-d4ce-421e-9dbb-12ce7d579710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:18.313288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 824/1637] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:18.314201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0b6d-c506-473f-a488-22f9c3f541ba admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:18.320766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183b484-d4ce-421e-9dbb-12ce7d579710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:18.321304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0d8a0b6d-c506-473f-a488-22f9c3f541ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:18.323709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183b484-d4ce-421e-9dbb-12ce7d579710 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:18.351165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 814/1638] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:18 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:18.352454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183b484-d4ce-421e-9dbb-12ce7d579710 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:18.372975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183b484-d4ce-421e-9dbb-12ce7d579710 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:18.382192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c6bb-9450-4071-917f-24405c7843fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:18.383408 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c6bb-9450-4071-917f-24405c7843fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:18.383791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c6bb-9450-4071-917f-24405c7843fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:18.384148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c6bb-9450-4071-917f-24405c7843fc admin admin] PATH_INFO: `/v3/projects/1bd6ed025a45462794005d8150c08f41/users/c0b69dd453eb4733894425a002041501/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:18.388780 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463c6bb-9450-4071-917f-24405c7843fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd6ed025a45462794005d8150c08f41, user_id=c0b69dd453eb4733894425a002041501, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:18.391923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463c6bb-9450-4071-917f-24405c7843fc admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:18.429069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 815/1639] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:18 2022] PUT /identity/v3/projects/1bd6ed025a45462794005d8150c08f41/users/c0b69dd453eb4733894425a002041501/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:18.430962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c72ed-a0e8-4fb8-bf7a-e5007300ea97 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:18.431299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c72ed-a0e8-4fb8-bf7a-e5007300ea97 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:18.431588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c72ed-a0e8-4fb8-bf7a-e5007300ea97 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:18.453872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 816/1640] 10.222.0.61 () {54 vars in 912 bytes} [Sat May 14 15:46:18 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:46:18.455875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9edb4-1e20-47db-b67e-1f5c0e9ba208 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:18.456163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9edb4-1e20-47db-b67e-1f5c0e9ba208 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:18.456441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9edb4-1e20-47db-b67e-1f5c0e9ba208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:18.492685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-88d9edb4-1e20-47db-b67e-1f5c0e9ba208 None None] MFA Rules not processed for user `c0b69dd453eb4733894425a002041501`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:18.500473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-88d9edb4-1e20-47db-b67e-1f5c0e9ba208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:18.566890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0b6d-c506-473f-a488-22f9c3f541ba admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:18.629232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 817/1641] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:18.629232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124772-dbc7-4c83-a368-a383b5c278a3 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:18.629232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124772-dbc7-4c83-a368-a383b5c278a3 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:18.629232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124772-dbc7-4c83-a368-a383b5c278a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:18.667602 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-9e124772-dbc7-4c83-a368-a383b5c278a3 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:18.669973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9e124772-dbc7-4c83-a368-a383b5c278a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:18.674529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b6081-960f-49b5-841a-01fe827abcd3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd346be1ef7604f1f87371f5d322fd010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:18.675860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b6081-960f-49b5-841a-01fe827abcd3 service glance] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:18.676366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b6081-960f-49b5-841a-01fe827abcd3 service glance] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:18.676870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b6081-960f-49b5-841a-01fe827abcd3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:18.793665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 818/1642] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:46:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:18.800492 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e124772-dbc7-4c83-a368-a383b5c278a3 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:18.806866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b6081-960f-49b5-841a-01fe827abcd3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:18.809487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b6081-960f-49b5-841a-01fe827abcd3 service glance] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:18.861462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 825/1643] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:18.862748 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b6081-960f-49b5-841a-01fe827abcd3 service glance] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:18.949359 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e124772-dbc7-4c83-a368-a383b5c278a3 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:18.954570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b6081-960f-49b5-841a-01fe827abcd3 service glance] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:18.955501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a70072-cb21-4634-a101-0a97051f0593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:18.956325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70072-cb21-4634-a101-0a97051f0593 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:18.956599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70072-cb21-4634-a101-0a97051f0593 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:18.957146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a70072-cb21-4634-a101-0a97051f0593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:18.960509 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6561488-8fcb-46b1-acf7-3d6d86eb95e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:18.961415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6561488-8fcb-46b1-acf7-3d6d86eb95e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:18.962527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6561488-8fcb-46b1-acf7-3d6d86eb95e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:18.962990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6561488-8fcb-46b1-acf7-3d6d86eb95e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:18.988289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6561488-8fcb-46b1-acf7-3d6d86eb95e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:18.993176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6561488-8fcb-46b1-acf7-3d6d86eb95e4 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:19.032335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 826/1644] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:18 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:19.090763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70072-cb21-4634-a101-0a97051f0593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:19.101349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a70072-cb21-4634-a101-0a97051f0593 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:19.120979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6561488-8fcb-46b1-acf7-3d6d86eb95e4 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:19.126736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 819/1645] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:18 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:19.133440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6561488-8fcb-46b1-acf7-3d6d86eb95e4 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:19.138124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf8815-bcfc-417e-9d62-1d16a0e6f93f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:19.139068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8815-bcfc-417e-9d62-1d16a0e6f93f service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:19.139353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8815-bcfc-417e-9d62-1d16a0e6f93f service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:19.139628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8815-bcfc-417e-9d62-1d16a0e6f93f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:19.151391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf8815-bcfc-417e-9d62-1d16a0e6f93f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:19.153565 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf8815-bcfc-417e-9d62-1d16a0e6f93f service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:19.179817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 827/1646] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:19.519385 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787482a8-8bfe-437c-9120-8eb7fd33bb3f None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:19.519965 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787482a8-8bfe-437c-9120-8eb7fd33bb3f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:19.520056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787482a8-8bfe-437c-9120-8eb7fd33bb3f None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:19.521981 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 820/1647] 10.222.0.61 () {54 vars in 912 bytes} [Sat May 14 15:46:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:46:19.529424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addbdcb-0c20-4a41-82f4-686dbe08cfaf None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:19.529765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addbdcb-0c20-4a41-82f4-686dbe08cfaf None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:19.529977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addbdcb-0c20-4a41-82f4-686dbe08cfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:19.628194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4addbdcb-0c20-4a41-82f4-686dbe08cfaf None None] MFA Rules not processed for user `abfc1e35362a4495a05475878db260f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:19.629437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4addbdcb-0c20-4a41-82f4-686dbe08cfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:19.781349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 828/1648] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:46:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:19.856954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787482a8-8bfe-437c-9120-8eb7fd33bb3f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:19.876233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787482a8-8bfe-437c-9120-8eb7fd33bb3f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:19.880152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cdda7-0361-4362-8e1b-f40dd1aafd74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:19.880803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cdda7-0361-4362-8e1b-f40dd1aafd74 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:19.881086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cdda7-0361-4362-8e1b-f40dd1aafd74 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:19.881356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cdda7-0361-4362-8e1b-f40dd1aafd74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:19.908052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cdda7-0361-4362-8e1b-f40dd1aafd74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:19.909504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cdda7-0361-4362-8e1b-f40dd1aafd74 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:19.927496 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 821/1649] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:20.401616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addbdcb-0c20-4a41-82f4-686dbe08cfaf None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:20.537595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cdda7-0361-4362-8e1b-f40dd1aafd74 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:20.562536 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cdda7-0361-4362-8e1b-f40dd1aafd74 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:20.584103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07af6b-4e3f-45f7-b85e-e26a7b6e83be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:20.592597 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07af6b-4e3f-45f7-b85e-e26a7b6e83be service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:20.593182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07af6b-4e3f-45f7-b85e-e26a7b6e83be service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:20.594448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07af6b-4e3f-45f7-b85e-e26a7b6e83be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:20.683081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addbdcb-0c20-4a41-82f4-686dbe08cfaf None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:20.713254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24461a46-714b-4ef3-a600-d216b8457339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:20.714077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461a46-714b-4ef3-a600-d216b8457339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:20.714382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461a46-714b-4ef3-a600-d216b8457339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:20.714653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24461a46-714b-4ef3-a600-d216b8457339 admin admin] PATH_INFO: `/v3/users/971e9d487b7c4777b546c8753fec7e5d` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:20.723244 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24461a46-714b-4ef3-a600-d216b8457339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971e9d487b7c4777b546c8753fec7e5d)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:20.736147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24461a46-714b-4ef3-a600-d216b8457339 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:20.870211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07af6b-4e3f-45f7-b85e-e26a7b6e83be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:20.872355 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07af6b-4e3f-45f7-b85e-e26a7b6e83be service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:20.913666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-24461a46-714b-4ef3-a600-d216b8457339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971e9d487b7c4777b546c8753fec7e5d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:20.930973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 822/1650] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:20.932706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d444a-4706-46dc-b198-c2a2ead2baf5 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:20.932875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d444a-4706-46dc-b198-c2a2ead2baf5 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:20.933152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d444a-4706-46dc-b198-c2a2ead2baf5 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:20.934643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 823/1651] 10.222.0.61 () {54 vars in 960 bytes} [Sat May 14 15:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:46:20.941703 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa1c2-43dd-4d17-9ef5-3f5c1749db78 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:20.950704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa1c2-43dd-4d17-9ef5-3f5c1749db78 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:20.951127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffa1c2-43dd-4d17-9ef5-3f5c1749db78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:20.971582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-24461a46-714b-4ef3-a600-d216b8457339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971e9d487b7c4777b546c8753fec7e5d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:20.972467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-24461a46-714b-4ef3-a600-d216b8457339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971e9d487b7c4777b546c8753fec7e5d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:20.973137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-24461a46-714b-4ef3-a600-d216b8457339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971e9d487b7c4777b546c8753fec7e5d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:20.998328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-24461a46-714b-4ef3-a600-d216b8457339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971e9d487b7c4777b546c8753fec7e5d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:21.008859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-06ffa1c2-43dd-4d17-9ef5-3f5c1749db78 None None] MFA Rules not processed for user `8fac310b740a40718191e905723222ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:21.010255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-06ffa1c2-43dd-4d17-9ef5-3f5c1749db78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:21.028171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 829/1652] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:46:20 2022] DELETE /identity/v3/users/971e9d487b7c4777b546c8753fec7e5d => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:21.039059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa12db-9692-44e0-9971-a19307c575c3 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:21.039419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa12db-9692-44e0-9971-a19307c575c3 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:21.039651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa12db-9692-44e0-9971-a19307c575c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:21.100466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-e3aa12db-9692-44e0-9971-a19307c575c3 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:21.103952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e3aa12db-9692-44e0-9971-a19307c575c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:21.192801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 824/1653] 10.222.0.61 () {58 vars in 1057 bytes} [Sat May 14 15:46:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:21.201578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa1c2-43dd-4d17-9ef5-3f5c1749db78 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:21.239509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffa1c2-43dd-4d17-9ef5-3f5c1749db78 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:21.274714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 830/1654] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:21.298972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa12db-9692-44e0-9971-a19307c575c3 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:21.301321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e3aa12db-9692-44e0-9971-a19307c575c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:21.422856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dfaff-0b08-42f3-bb06-caac40219d74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fac310b740a40718191e905723222ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:21.424027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dfaff-0b08-42f3-bb06-caac40219d74 service placement] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:21.424306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dfaff-0b08-42f3-bb06-caac40219d74 service placement] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:21.427598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dfaff-0b08-42f3-bb06-caac40219d74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:21.431428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b53dfaff-0b08-42f3-bb06-caac40219d74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:21.444971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa12db-9692-44e0-9971-a19307c575c3 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:21.452211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963112d-4134-4762-b5c8-7f11a2f0f843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:21.452461 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963112d-4134-4762-b5c8-7f11a2f0f843 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:21.452609 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963112d-4134-4762-b5c8-7f11a2f0f843 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:21.452883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963112d-4134-4762-b5c8-7f11a2f0f843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:21.458289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53dfaff-0b08-42f3-bb06-caac40219d74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:21.460497 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53dfaff-0b08-42f3-bb06-caac40219d74 service placement] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:21.473941 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963112d-4134-4762-b5c8-7f11a2f0f843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:21.475427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963112d-4134-4762-b5c8-7f11a2f0f843 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:21.485713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 825/1655] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:21.492552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 831/1656] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:23.198715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dfaff-0b08-42f3-bb06-caac40219d74 service placement] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:23.208611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b53dfaff-0b08-42f3-bb06-caac40219d74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:23.230648 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dfaff-0b08-42f3-bb06-caac40219d74 service placement] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:23.238156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:23.239483 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:23.240019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:23.240470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] PATH_INFO: `/v3/projects/21a8fa8fe7024dcd9256b27c88831fa4` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:23.242014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a8fa8fe7024dcd9256b27c88831fa4)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:23.246575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:23.313317 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a8fa8fe7024dcd9256b27c88831fa4', 'request_id': 'req-7bbdc0c6-c982-4688-9806-fbda7297f016'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:23.357929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a8fa8fe7024dcd9256b27c88831fa4', 'request_id': 'req-7bbdc0c6-c982-4688-9806-fbda7297f016'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:23.367658 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a8fa8fe7024dcd9256b27c88831fa4', 'request_id': 'req-7bbdc0c6-c982-4688-9806-fbda7297f016'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:23.407632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] The token cache is being invalidate because project 21a8fa8fe7024dcd9256b27c88831fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:46:23.409068 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:23.412049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:23.421322 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963112d-4134-4762-b5c8-7f11a2f0f843 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:23.422024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 826/1657] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:46:23 2022] DELETE /identity/v3/projects/21a8fa8fe7024dcd9256b27c88831fa4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:23.443400 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963112d-4134-4762-b5c8-7f11a2f0f843 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:23.757186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ba10d-7ad1-4b76-b996-15485330812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:23.758652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ba10d-7ad1-4b76-b996-15485330812e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:23.759383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ba10d-7ad1-4b76-b996-15485330812e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:23.760045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ba10d-7ad1-4b76-b996-15485330812e admin admin] PATH_INFO: `/v3/users/c0b69dd453eb4733894425a002041501` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:23.762099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ba10d-7ad1-4b76-b996-15485330812e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b69dd453eb4733894425a002041501)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:23.764659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ba10d-7ad1-4b76-b996-15485330812e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:23.854680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-253ba10d-7ad1-4b76-b996-15485330812e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b69dd453eb4733894425a002041501'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:23.903889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-253ba10d-7ad1-4b76-b996-15485330812e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b69dd453eb4733894425a002041501'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:23.905212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-253ba10d-7ad1-4b76-b996-15485330812e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b69dd453eb4733894425a002041501'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:23.907493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-253ba10d-7ad1-4b76-b996-15485330812e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b69dd453eb4733894425a002041501'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:23.927972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-253ba10d-7ad1-4b76-b996-15485330812e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b69dd453eb4733894425a002041501'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:23.954706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 832/1658] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:46:23 2022] DELETE /identity/v3/users/c0b69dd453eb4733894425a002041501 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:25.741525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:25.744548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:25.778951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdc0c6-c982-4688-9806-fbda7297f016 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:26.017680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:26.018475 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:26.018836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:26.019025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] PATH_INFO: `/v3/projects/1bd6ed025a45462794005d8150c08f41` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:26.024581 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bd6ed025a45462794005d8150c08f41)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:26.028122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:26.143257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bd6ed025a45462794005d8150c08f41', 'request_id': 'req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:26.163740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bd6ed025a45462794005d8150c08f41', 'request_id': 'req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:26.178159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bd6ed025a45462794005d8150c08f41', 'request_id': 'req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:26.200595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] The token cache is being invalidate because project 1bd6ed025a45462794005d8150c08f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:46:26.201078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:26.203635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1cf29a24-d58c-49d0-a3e1-e7f436b89dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:26.211085 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 827/1659] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:46:25 2022] DELETE /identity/v3/projects/1bd6ed025a45462794005d8150c08f41 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:26.213319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835d08-07b6-4e42-b01a-ea1bf887dc6e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:26.214375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835d08-07b6-4e42-b01a-ea1bf887dc6e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:26.215663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33835d08-07b6-4e42-b01a-ea1bf887dc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:26.260090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e15fe-88f6-4473-b837-d7b957389cc7 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:26.260293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e15fe-88f6-4473-b837-d7b957389cc7 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:26.260568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e15fe-88f6-4473-b837-d7b957389cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:26.266007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-33835d08-07b6-4e42-b01a-ea1bf887dc6e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:26.267535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-33835d08-07b6-4e42-b01a-ea1bf887dc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:26.311876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a75e15fe-88f6-4473-b837-d7b957389cc7 None None] MFA Rules not processed for user `dc43895177134e9c9c030a9d87f94aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:26.314494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a75e15fe-88f6-4473-b837-d7b957389cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:26.349868 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 833/1660] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:26.352181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79835861-8474-410d-a2bb-06c7a635713a None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:26.352579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79835861-8474-410d-a2bb-06c7a635713a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:26.353550 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79835861-8474-410d-a2bb-06c7a635713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:26.373495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-79835861-8474-410d-a2bb-06c7a635713a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:26.374859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-79835861-8474-410d-a2bb-06c7a635713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:26.391513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 834/1661] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:26.393767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79835861-8474-410d-a2bb-06c7a635713a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:26.405097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79835861-8474-410d-a2bb-06c7a635713a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:26.409752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485a00-7057-47c9-ae4b-088eee6403a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:26.410801 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485a00-7057-47c9-ae4b-088eee6403a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:26.410923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485a00-7057-47c9-ae4b-088eee6403a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:26.411281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485a00-7057-47c9-ae4b-088eee6403a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:26.412101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d485a00-7057-47c9-ae4b-088eee6403a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:26.412446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d485a00-7057-47c9-ae4b-088eee6403a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:26.414127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d485a00-7057-47c9-ae4b-088eee6403a0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:26.430207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 835/1662] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:46:26.431252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485a00-7057-47c9-ae4b-088eee6403a0 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:26.442152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485a00-7057-47c9-ae4b-088eee6403a0 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:26.447403 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea056e-c513-4731-93db-4eff9e2d3231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:26.448242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea056e-c513-4731-93db-4eff9e2d3231 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:26.449594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea056e-c513-4731-93db-4eff9e2d3231 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:26.449594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea056e-c513-4731-93db-4eff9e2d3231 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:26.449806 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea056e-c513-4731-93db-4eff9e2d3231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:26.451806 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea056e-c513-4731-93db-4eff9e2d3231 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:26.477188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 828/1663] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:26.484778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 836/1664] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:26 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:46:26.487473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e15fe-88f6-4473-b837-d7b957389cc7 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:26.494134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea056e-c513-4731-93db-4eff9e2d3231 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:26.496800 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1dea056e-c513-4731-93db-4eff9e2d3231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:26.512985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e15fe-88f6-4473-b837-d7b957389cc7 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:26.600811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea056e-c513-4731-93db-4eff9e2d3231 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:26.609638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0b453-d31f-4c4e-b69c-30011e71e763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:26.611418 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b453-d31f-4c4e-b69c-30011e71e763 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:26.611995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b453-d31f-4c4e-b69c-30011e71e763 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:26.612737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b453-d31f-4c4e-b69c-30011e71e763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:26.619825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea483aaf-f8f8-4a6a-8777-f7e0fdf66663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:26.620644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea483aaf-f8f8-4a6a-8777-f7e0fdf66663 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:26.621886 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea483aaf-f8f8-4a6a-8777-f7e0fdf66663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:26.622575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea483aaf-f8f8-4a6a-8777-f7e0fdf66663 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:26.623378 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea483aaf-f8f8-4a6a-8777-f7e0fdf66663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:26.625954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea483aaf-f8f8-4a6a-8777-f7e0fdf66663 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:26.670567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 829/1665] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:26 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:26.675295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea483aaf-f8f8-4a6a-8777-f7e0fdf66663 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:26.702970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea483aaf-f8f8-4a6a-8777-f7e0fdf66663 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:26.717367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb2075-0537-47fe-81de-0071c58782a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:26.718114 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb2075-0537-47fe-81de-0071c58782a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:26.718529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb2075-0537-47fe-81de-0071c58782a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:26.718810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb2075-0537-47fe-81de-0071c58782a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:26.719556 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb2075-0537-47fe-81de-0071c58782a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:26.725106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb2075-0537-47fe-81de-0071c58782a2 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:26.751705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0b453-d31f-4c4e-b69c-30011e71e763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:26.753284 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 830/1666] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:26.754780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0b453-d31f-4c4e-b69c-30011e71e763 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:26.756967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb2075-0537-47fe-81de-0071c58782a2 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:26.774965 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb2075-0537-47fe-81de-0071c58782a2 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:26.781826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 837/1667] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:26.822328 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b6732-1d16-4ae4-9f4a-d947e518b84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:26.823024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b6732-1d16-4ae4-9f4a-d947e518b84b admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:26.823461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b6732-1d16-4ae4-9f4a-d947e518b84b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:26.823864 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b6732-1d16-4ae4-9f4a-d947e518b84b admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:26.825392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b6732-1d16-4ae4-9f4a-d947e518b84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:26.828223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b6732-1d16-4ae4-9f4a-d947e518b84b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:26.873759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0b453-d31f-4c4e-b69c-30011e71e763 service nova] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:26.887271 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 831/1668] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:26.891311 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0b453-d31f-4c4e-b69c-30011e71e763 service nova] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:26.908610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62070b6f-6f5b-4c8f-8855-4aecb00c219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:26.913050 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62070b6f-6f5b-4c8f-8855-4aecb00c219a admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:26.913580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62070b6f-6f5b-4c8f-8855-4aecb00c219a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:26.914022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62070b6f-6f5b-4c8f-8855-4aecb00c219a admin admin] PATH_INFO: `/v3/projects/30a66041704940c797c76366b41ee359/users/41884761fbf44a239b9adcc1e58a46e5/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:26.963844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62070b6f-6f5b-4c8f-8855-4aecb00c219a admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a66041704940c797c76366b41ee359, user_id=41884761fbf44a239b9adcc1e58a46e5, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:26.992661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62070b6f-6f5b-4c8f-8855-4aecb00c219a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:27.049926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 838/1669] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:26 2022] PUT /identity/v3/projects/30a66041704940c797c76366b41ee359/users/41884761fbf44a239b9adcc1e58a46e5/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:27.052215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d910-f58b-49a1-a5d5-9a94d456894c None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:27.052511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d910-f58b-49a1-a5d5-9a94d456894c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:27.052857 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d910-f58b-49a1-a5d5-9a94d456894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:27.117144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-3125d910-f58b-49a1-a5d5-9a94d456894c None None] MFA Rules not processed for user `41884761fbf44a239b9adcc1e58a46e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:27.119669 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3125d910-f58b-49a1-a5d5-9a94d456894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:27.350402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 832/1670] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:27.358072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62070b6f-6f5b-4c8f-8855-4aecb00c219a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:27.468231 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b07b0c-a187-4dcb-bac3-f4ea762c3d49 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:27.468538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b07b0c-a187-4dcb-bac3-f4ea762c3d49 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:27.468820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b07b0c-a187-4dcb-bac3-f4ea762c3d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:27.528205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62070b6f-6f5b-4c8f-8855-4aecb00c219a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:27.548188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571a613-64d3-4df1-a442-b7fdeab71ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:27.549158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a613-64d3-4df1-a442-b7fdeab71ebe admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:27.549665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a613-64d3-4df1-a442-b7fdeab71ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:27.550783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a613-64d3-4df1-a442-b7fdeab71ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:27.551910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571a613-64d3-4df1-a442-b7fdeab71ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:27.553236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-86b07b0c-a187-4dcb-bac3-f4ea762c3d49 None None] MFA Rules not processed for user `7b896317d96a40d6a137db0dcf5f98f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:27.555483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571a613-64d3-4df1-a442-b7fdeab71ebe admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:27.557540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-86b07b0c-a187-4dcb-bac3-f4ea762c3d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:27.617345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 839/1671] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:27 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:27.623769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571a613-64d3-4df1-a442-b7fdeab71ebe admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:27.739702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 833/1672] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:27.755520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1def70-40e6-4f6b-9ccd-4ff9658b939b None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:27.757272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1def70-40e6-4f6b-9ccd-4ff9658b939b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:27.758530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1def70-40e6-4f6b-9ccd-4ff9658b939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:27.767064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571a613-64d3-4df1-a442-b7fdeab71ebe admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:27.784600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532346ce-1fd0-4d14-8188-3a0ad6cf720d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:27.785579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532346ce-1fd0-4d14-8188-3a0ad6cf720d admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:27.786031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532346ce-1fd0-4d14-8188-3a0ad6cf720d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:27.787337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532346ce-1fd0-4d14-8188-3a0ad6cf720d admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:27.788833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532346ce-1fd0-4d14-8188-3a0ad6cf720d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:27.790851 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-0f1def70-40e6-4f6b-9ccd-4ff9658b939b None None] MFA Rules not processed for user `7b896317d96a40d6a137db0dcf5f98f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:27.791547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532346ce-1fd0-4d14-8188-3a0ad6cf720d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:27.794084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-0f1def70-40e6-4f6b-9ccd-4ff9658b939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:27.831799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 840/1673] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:27 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:27.835589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532346ce-1fd0-4d14-8188-3a0ad6cf720d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:27.856160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532346ce-1fd0-4d14-8188-3a0ad6cf720d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:27.866338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edc986-cf4e-4a22-93cb-3d151597c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:27.867226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edc986-cf4e-4a22-93cb-3d151597c3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:27.867655 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edc986-cf4e-4a22-93cb-3d151597c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:27.868262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edc986-cf4e-4a22-93cb-3d151597c3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:27.872400 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edc986-cf4e-4a22-93cb-3d151597c3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:27.876101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edc986-cf4e-4a22-93cb-3d151597c3a9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:27.905727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 841/1674] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:46:27.909959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edc986-cf4e-4a22-93cb-3d151597c3a9 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:27.947824 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edc986-cf4e-4a22-93cb-3d151597c3a9 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:27.951356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 834/1675] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:27.964113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1def70-40e6-4f6b-9ccd-4ff9658b939b None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:27.975080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8961a-b43f-4f2f-9213-9869700b5154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:27.975998 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8961a-b43f-4f2f-9213-9869700b5154 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:27.976287 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8961a-b43f-4f2f-9213-9869700b5154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:27.976571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8961a-b43f-4f2f-9213-9869700b5154 admin admin] PATH_INFO: `/v3/projects/8ec54ba6b21244b4b80990eb98f87b3b/users/7e00cb19b4c7416b9d28fd2e9060653f/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:28.024392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8961a-b43f-4f2f-9213-9869700b5154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec54ba6b21244b4b80990eb98f87b3b, user_id=7e00cb19b4c7416b9d28fd2e9060653f, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:28.029551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b8961a-b43f-4f2f-9213-9869700b5154 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:28.059239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 842/1676] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:27 2022] PUT /identity/v3/projects/8ec54ba6b21244b4b80990eb98f87b3b/users/7e00cb19b4c7416b9d28fd2e9060653f/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:28.063013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8961a-b43f-4f2f-9213-9869700b5154 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:28.116304 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1def70-40e6-4f6b-9ccd-4ff9658b939b None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:28.207801 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8961a-b43f-4f2f-9213-9869700b5154 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:28.224753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661e7b3-21e2-4a42-90ad-485bfa8a71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:28.225572 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661e7b3-21e2-4a42-90ad-485bfa8a71b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:28.226569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661e7b3-21e2-4a42-90ad-485bfa8a71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:28.226919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661e7b3-21e2-4a42-90ad-485bfa8a71b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:28.227697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661e7b3-21e2-4a42-90ad-485bfa8a71b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:28.232147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661e7b3-21e2-4a42-90ad-485bfa8a71b8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:28.256682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 843/1677] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:28.259663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661e7b3-21e2-4a42-90ad-485bfa8a71b8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:28.280193 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661e7b3-21e2-4a42-90ad-485bfa8a71b8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:28.285295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5bd35-24ea-4210-a809-7ebd1b881614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:28.286027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5bd35-24ea-4210-a809-7ebd1b881614 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:28.286344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5bd35-24ea-4210-a809-7ebd1b881614 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:28.286973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5bd35-24ea-4210-a809-7ebd1b881614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:28.295295 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb76299-2632-4e11-9aa4-100ccf44d755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:28.298780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb76299-2632-4e11-9aa4-100ccf44d755 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:28.299071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb76299-2632-4e11-9aa4-100ccf44d755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:28.299352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb76299-2632-4e11-9aa4-100ccf44d755 admin admin] PATH_INFO: `/v3/projects/8ec54ba6b21244b4b80990eb98f87b3b/users/7e00cb19b4c7416b9d28fd2e9060653f/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:28.303994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb76299-2632-4e11-9aa4-100ccf44d755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec54ba6b21244b4b80990eb98f87b3b, user_id=7e00cb19b4c7416b9d28fd2e9060653f, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:28.309119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb76299-2632-4e11-9aa4-100ccf44d755 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:28.334682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 844/1678] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:28 2022] PUT /identity/v3/projects/8ec54ba6b21244b4b80990eb98f87b3b/users/7e00cb19b4c7416b9d28fd2e9060653f/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:28.345980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec972a7-c14c-4e18-aee5-90699be70877 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:28.346267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec972a7-c14c-4e18-aee5-90699be70877 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:28.346587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec972a7-c14c-4e18-aee5-90699be70877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:28.402990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9ec972a7-c14c-4e18-aee5-90699be70877 None None] MFA Rules not processed for user `7e00cb19b4c7416b9d28fd2e9060653f`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:28.408570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9ec972a7-c14c-4e18-aee5-90699be70877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:28.418392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5bd35-24ea-4210-a809-7ebd1b881614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:28.420362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5bd35-24ea-4210-a809-7ebd1b881614 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:28.463072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 835/1679] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:28.616869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 845/1680] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:28.629724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5bd35-24ea-4210-a809-7ebd1b881614 service nova] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:28.632559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-78e5bd35-24ea-4210-a809-7ebd1b881614 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:28.763899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5bd35-24ea-4210-a809-7ebd1b881614 service nova] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:28.867145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7679c-4452-4b17-b0ac-dfd16d273872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:28.869739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7679c-4452-4b17-b0ac-dfd16d273872 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:28.870394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7679c-4452-4b17-b0ac-dfd16d273872 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:28.871498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7679c-4452-4b17-b0ac-dfd16d273872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:28.905821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7679c-4452-4b17-b0ac-dfd16d273872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:28.909676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7679c-4452-4b17-b0ac-dfd16d273872 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:28.949238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 836/1681] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:29.742672 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafe21b-1535-4021-ac53-c635de235e9e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:29.743122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafe21b-1535-4021-ac53-c635de235e9e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:29.743337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafe21b-1535-4021-ac53-c635de235e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:29.793996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4bafe21b-1535-4021-ac53-c635de235e9e None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:29.795576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4bafe21b-1535-4021-ac53-c635de235e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:29.950711 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7679c-4452-4b17-b0ac-dfd16d273872 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:30.006517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 846/1682] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:46:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:30.179568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7679c-4452-4b17-b0ac-dfd16d273872 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:30.190698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:30.192035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:30.192672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:30.193340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] PATH_INFO: `/v3/users/41884761fbf44a239b9adcc1e58a46e5` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:30.195611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41884761fbf44a239b9adcc1e58a46e5)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:30.214400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: WARNING py.warnings [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 15:46:30.214400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: warnings.warn(msg) May 14 15:46:30.214400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: May 14 15:46:30.224049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:30.346058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafe21b-1535-4021-ac53-c635de235e9e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:30.357521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4bafe21b-1535-4021-ac53-c635de235e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:30.460330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41884761fbf44a239b9adcc1e58a46e5'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:30.506185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41884761fbf44a239b9adcc1e58a46e5'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:30.507332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41884761fbf44a239b9adcc1e58a46e5'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:30.508755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41884761fbf44a239b9adcc1e58a46e5'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:30.514023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafe21b-1535-4021-ac53-c635de235e9e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:30.529933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2862a-40f1-4d5d-82c9-97d15e4bc672 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:30.533182 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2862a-40f1-4d5d-82c9-97d15e4bc672 service swift] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:30.533490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2862a-40f1-4d5d-82c9-97d15e4bc672 service swift] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:30.533582 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-daed38fe-3cb0-44a6-a1dd-e1a29033a4a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41884761fbf44a239b9adcc1e58a46e5'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:30.535092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2862a-40f1-4d5d-82c9-97d15e4bc672 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:30.540280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b1d2862a-40f1-4d5d-82c9-97d15e4bc672 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:30.571303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 837/1683] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:46:29 2022] DELETE /identity/v3/users/41884761fbf44a239b9adcc1e58a46e5 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:30.573769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c9b45-d27a-459a-8c86-d2cc93ca0d70 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:30.573769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c9b45-d27a-459a-8c86-d2cc93ca0d70 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:30.574059 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c9b45-d27a-459a-8c86-d2cc93ca0d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:30.575363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2862a-40f1-4d5d-82c9-97d15e4bc672 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:30.577986 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2862a-40f1-4d5d-82c9-97d15e4bc672 service swift] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:30.618762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 847/1684] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:46:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 15:46:30.643430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e75c9b45-d27a-459a-8c86-d2cc93ca0d70 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:30.645044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e75c9b45-d27a-459a-8c86-d2cc93ca0d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:30.940768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 838/1685] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:31.133295 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2862a-40f1-4d5d-82c9-97d15e4bc672 service swift] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:31.135243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b1d2862a-40f1-4d5d-82c9-97d15e4bc672 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:31.186207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6583062-a7d9-4224-b42b-a30a068cbb24 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:31.186731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6583062-a7d9-4224-b42b-a30a068cbb24 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:31.186800 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6583062-a7d9-4224-b42b-a30a068cbb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:31.241379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a6583062-a7d9-4224-b42b-a30a068cbb24 None None] MFA Rules not processed for user `7b896317d96a40d6a137db0dcf5f98f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:31.252680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a6583062-a7d9-4224-b42b-a30a068cbb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:31.362711 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2862a-40f1-4d5d-82c9-97d15e4bc672 service swift] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:31.426998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 839/1686] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:46:31.429486 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6583062-a7d9-4224-b42b-a30a068cbb24 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:31.435203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a6583062-a7d9-4224-b42b-a30a068cbb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:31.516831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6583062-a7d9-4224-b42b-a30a068cbb24 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:31.523132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:31.524765 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:31.548401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:31.549097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] PATH_INFO: `/v3/users/a2c83fd0cfa64b9bbdea991e485317ad` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:31.552842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c83fd0cfa64b9bbdea991e485317ad)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:31.586097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:31.670283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77be34-0f1f-4ac5-b192-0e6c67a14d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:31.673347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77be34-0f1f-4ac5-b192-0e6c67a14d22 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:31.673932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77be34-0f1f-4ac5-b192-0e6c67a14d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:31.677747 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77be34-0f1f-4ac5-b192-0e6c67a14d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:31.788074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77be34-0f1f-4ac5-b192-0e6c67a14d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:31.798751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77be34-0f1f-4ac5-b192-0e6c67a14d22 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:31.832541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 848/1687] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:31.849503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c83fd0cfa64b9bbdea991e485317ad'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:31.881917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c83fd0cfa64b9bbdea991e485317ad'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:31.883359 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c83fd0cfa64b9bbdea991e485317ad'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:31.887319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c83fd0cfa64b9bbdea991e485317ad'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:31.919677 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c83fd0cfa64b9bbdea991e485317ad'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:31.989835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 840/1688] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:46:31 2022] DELETE /identity/v3/users/a2c83fd0cfa64b9bbdea991e485317ad => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:31.991717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90917-0acc-4849-a45e-488520b68619 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:31.992281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90917-0acc-4849-a45e-488520b68619 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:31.992901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd90917-0acc-4849-a45e-488520b68619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:32.037858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-bcd90917-0acc-4849-a45e-488520b68619 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:32.045967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-bcd90917-0acc-4849-a45e-488520b68619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:32.303416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 849/1689] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:32.900299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:32.903649 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:33.204818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfed81d-1665-4e9c-b46d-d40f445af275 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:33.229464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faa76a-6a41-40f8-8afd-9483bd60731e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:33.230206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faa76a-6a41-40f8-8afd-9483bd60731e service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:33.230513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faa76a-6a41-40f8-8afd-9483bd60731e service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:33.237818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faa76a-6a41-40f8-8afd-9483bd60731e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:33.280914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faa76a-6a41-40f8-8afd-9483bd60731e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:33.282415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faa76a-6a41-40f8-8afd-9483bd60731e service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:33.341170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 841/1690] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:33.962708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755373-70a9-4e93-9bb2-f83ed0b7bce4 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:33.963712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755373-70a9-4e93-9bb2-f83ed0b7bce4 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:33.964986 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755373-70a9-4e93-9bb2-f83ed0b7bce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:33.991730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-68755373-70a9-4e93-9bb2-f83ed0b7bce4 None None] MFA Rules not processed for user `dc43895177134e9c9c030a9d87f94aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:33.993216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-68755373-70a9-4e93-9bb2-f83ed0b7bce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:34.093600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f922f-994b-49f1-95c7-c213535f33ca None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:34.094185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f922f-994b-49f1-95c7-c213535f33ca None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:34.094532 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f922f-994b-49f1-95c7-c213535f33ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:34.139245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-ef4f922f-994b-49f1-95c7-c213535f33ca None None] MFA Rules not processed for user `abfc1e35362a4495a05475878db260f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:34.140497 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ef4f922f-994b-49f1-95c7-c213535f33ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:34.161625 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 850/1691] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:34.166760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 842/1692] 10.222.0.36 () {58 vars in 1015 bytes} [Sat May 14 15:46:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:46:34.297252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68755373-70a9-4e93-9bb2-f83ed0b7bce4 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:34.299186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-68755373-70a9-4e93-9bb2-f83ed0b7bce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:34.331744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68755373-70a9-4e93-9bb2-f83ed0b7bce4 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:34.343853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b50e26-18e9-46b2-84e9-2e81104ccaed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:34.344701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b50e26-18e9-46b2-84e9-2e81104ccaed service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:34.345158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b50e26-18e9-46b2-84e9-2e81104ccaed service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:34.345676 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b50e26-18e9-46b2-84e9-2e81104ccaed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:34.364313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b50e26-18e9-46b2-84e9-2e81104ccaed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:34.367781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b50e26-18e9-46b2-84e9-2e81104ccaed service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:34.381646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 851/1693] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:34.643936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f922f-994b-49f1-95c7-c213535f33ca None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:34.650702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ef4f922f-994b-49f1-95c7-c213535f33ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:34.702142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f922f-994b-49f1-95c7-c213535f33ca None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:34.726341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:34.729196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:34.730916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:34.733792 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] PATH_INFO: `/v3/projects/8a926765ff1b48c09ae97181c680dc32` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:34.736647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a926765ff1b48c09ae97181c680dc32)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:34.745118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:34.982517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b50e26-18e9-46b2-84e9-2e81104ccaed service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:34.985389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-38b50e26-18e9-46b2-84e9-2e81104ccaed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:35.014972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a926765ff1b48c09ae97181c680dc32', 'request_id': 'req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:35.029241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a926765ff1b48c09ae97181c680dc32', 'request_id': 'req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:35.055300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b50e26-18e9-46b2-84e9-2e81104ccaed service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:35.061486 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a926765ff1b48c09ae97181c680dc32', 'request_id': 'req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:35.103515 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] The token cache is being invalidate because project 8a926765ff1b48c09ae97181c680dc32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:46:35.104193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:35.111020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fad96561-86ce-4fc8-a9ab-7187d7c9c55b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:35.113399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 843/1694] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:46:34 2022] DELETE /identity/v3/projects/8a926765ff1b48c09ae97181c680dc32 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:35.124175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94ebf-4d9d-4a61-9147-123b8ebfca8e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:35.124793 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94ebf-4d9d-4a61-9147-123b8ebfca8e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:35.125414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b94ebf-4d9d-4a61-9147-123b8ebfca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:35.216533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-60b94ebf-4d9d-4a61-9147-123b8ebfca8e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:35.218214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-60b94ebf-4d9d-4a61-9147-123b8ebfca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:35.261955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:35.262926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:35.264691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:35.264691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] PATH_INFO: `/v3/projects/30a66041704940c797c76366b41ee359` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:35.282873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a66041704940c797c76366b41ee359)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:35.284157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: WARNING py.warnings [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 14 15:46:35.284157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: warnings.warn(msg) May 14 15:46:35.284157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: May 14 15:46:35.289258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:35.495460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 844/1695] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:46:35.497098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f833e4-bb93-4814-bce3-9b16c0900e8d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:35.497559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f833e4-bb93-4814-bce3-9b16c0900e8d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:35.497986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f833e4-bb93-4814-bce3-9b16c0900e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:35.576658 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-74f833e4-bb93-4814-bce3-9b16c0900e8d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:35.607589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-74f833e4-bb93-4814-bce3-9b16c0900e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:35.678119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a66041704940c797c76366b41ee359', 'request_id': 'req-03eed591-ff8c-4d72-96ee-2a1cc215cf78'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:35.715566 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a66041704940c797c76366b41ee359', 'request_id': 'req-03eed591-ff8c-4d72-96ee-2a1cc215cf78'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:35.774127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a66041704940c797c76366b41ee359', 'request_id': 'req-03eed591-ff8c-4d72-96ee-2a1cc215cf78'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:35.831521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] The token cache is being invalidate because project 30a66041704940c797c76366b41ee359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:46:35.831848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:35.838853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:35.844068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 852/1696] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:46:34 2022] DELETE /identity/v3/projects/30a66041704940c797c76366b41ee359 => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:46:35.848247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:35.867474 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:36.086750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 845/1697] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 591 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:36.099186 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f833e4-bb93-4814-bce3-9b16c0900e8d None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:36.105690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-74f833e4-bb93-4814-bce3-9b16c0900e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:36.148522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f833e4-bb93-4814-bce3-9b16c0900e8d None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:36.179612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c683a0-4449-4b7d-95dc-d3680cd9382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:36.180794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c683a0-4449-4b7d-95dc-d3680cd9382d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:36.181268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c683a0-4449-4b7d-95dc-d3680cd9382d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:36.181901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c683a0-4449-4b7d-95dc-d3680cd9382d admin admin] PATH_INFO: `/v3/users/92367a7cee05488e8227ef625e4e240c` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:36.188400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c683a0-4449-4b7d-95dc-d3680cd9382d admin admin] RBAC: Authorizing `identity:delete_user(user_id=92367a7cee05488e8227ef625e4e240c)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:36.192428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c683a0-4449-4b7d-95dc-d3680cd9382d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:36.200149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eed591-ff8c-4d72-96ee-2a1cc215cf78 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:36.217162 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:36.218447 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:36.218887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:36.219305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] PATH_INFO: `/v3/users/7e00cb19b4c7416b9d28fd2e9060653f` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:36.222882 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e00cb19b4c7416b9d28fd2e9060653f)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:36.227427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:36.388546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c8c683a0-4449-4b7d-95dc-d3680cd9382d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92367a7cee05488e8227ef625e4e240c'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:36.392242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e00cb19b4c7416b9d28fd2e9060653f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:36.425052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c8c683a0-4449-4b7d-95dc-d3680cd9382d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92367a7cee05488e8227ef625e4e240c'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:36.428319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c8c683a0-4449-4b7d-95dc-d3680cd9382d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92367a7cee05488e8227ef625e4e240c'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:36.429349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c8c683a0-4449-4b7d-95dc-d3680cd9382d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92367a7cee05488e8227ef625e4e240c'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:36.430773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e00cb19b4c7416b9d28fd2e9060653f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:36.431670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e00cb19b4c7416b9d28fd2e9060653f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:36.432458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e00cb19b4c7416b9d28fd2e9060653f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:36.449257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e00cb19b4c7416b9d28fd2e9060653f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:36.455062 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c8c683a0-4449-4b7d-95dc-d3680cd9382d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92367a7cee05488e8227ef625e4e240c'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:36.472695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 853/1698] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:46:35 2022] DELETE /identity/v3/users/7e00cb19b4c7416b9d28fd2e9060653f => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:36.473927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:36.477527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:36.503836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 846/1699] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:46:36 2022] DELETE /identity/v3/users/92367a7cee05488e8227ef625e4e240c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:36.507025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe28a3-c30e-44b7-ad15-4882f6d53997 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:36.517208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe28a3-c30e-44b7-ad15-4882f6d53997 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:36.517329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe28a3-c30e-44b7-ad15-4882f6d53997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:36.587703 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-38fe28a3-c30e-44b7-ad15-4882f6d53997 None None] MFA Rules not processed for user `58bfb7417bc94583963401ae0fe9d39a`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:36.589210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-38fe28a3-c30e-44b7-ad15-4882f6d53997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:36.772678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb48bf3-819f-44a6-a21c-3ae46f513b00 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:36.835768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 847/1700] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:36.837306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38ba45-0f94-47b4-866a-8d23cdd0e9d6 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:36.837770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38ba45-0f94-47b4-866a-8d23cdd0e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:36.842527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38ba45-0f94-47b4-866a-8d23cdd0e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:36.914255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7f38ba45-0f94-47b4-866a-8d23cdd0e9d6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:36.935932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7f38ba45-0f94-47b4-866a-8d23cdd0e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:37.038988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb8f1c-8ac3-47ee-a6cc-aca884c3e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:37.039689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8f1c-8ac3-47ee-a6cc-aca884c3e837 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:37.039972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8f1c-8ac3-47ee-a6cc-aca884c3e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:37.040252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8f1c-8ac3-47ee-a6cc-aca884c3e837 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:37.041011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb8f1c-8ac3-47ee-a6cc-aca884c3e837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:37.041319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb8f1c-8ac3-47ee-a6cc-aca884c3e837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:37.048068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb8f1c-8ac3-47ee-a6cc-aca884c3e837 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:37.095956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 854/1701] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 622 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:46:37.110183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb8f1c-8ac3-47ee-a6cc-aca884c3e837 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:37.134610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb8f1c-8ac3-47ee-a6cc-aca884c3e837 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:37.169689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2373b3-daee-41d4-91db-fe17464b743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:37.170294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2373b3-daee-41d4-91db-fe17464b743f admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:37.170605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2373b3-daee-41d4-91db-fe17464b743f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:37.170879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2373b3-daee-41d4-91db-fe17464b743f admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:37.186977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2373b3-daee-41d4-91db-fe17464b743f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:37.188932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2373b3-daee-41d4-91db-fe17464b743f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:37.211152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 848/1702] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:37.250255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38ba45-0f94-47b4-866a-8d23cdd0e9d6 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:37.252052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7f38ba45-0f94-47b4-866a-8d23cdd0e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:37.286472 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 855/1703] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:37 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:46:37.292003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2373b3-daee-41d4-91db-fe17464b743f admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:37.361651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38ba45-0f94-47b4-866a-8d23cdd0e9d6 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:37.465167 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7cfac-8350-43f6-82bb-61db565a5350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:37.466388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7cfac-8350-43f6-82bb-61db565a5350 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:37.467876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7cfac-8350-43f6-82bb-61db565a5350 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:37.467876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7cfac-8350-43f6-82bb-61db565a5350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:37.472859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2373b3-daee-41d4-91db-fe17464b743f admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:37.486379 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95231248-74b2-4719-90e4-66fbbbcc0268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:37.487004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95231248-74b2-4719-90e4-66fbbbcc0268 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:37.487865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95231248-74b2-4719-90e4-66fbbbcc0268 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:37.487865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95231248-74b2-4719-90e4-66fbbbcc0268 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:37.488279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95231248-74b2-4719-90e4-66fbbbcc0268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:37.490380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95231248-74b2-4719-90e4-66fbbbcc0268 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:37.495333 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7cfac-8350-43f6-82bb-61db565a5350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:37.498300 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7cfac-8350-43f6-82bb-61db565a5350 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:37.531551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 849/1704] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:37.535683 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 856/1705] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:37 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:37.535857 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7cfac-8350-43f6-82bb-61db565a5350 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:37.536785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95231248-74b2-4719-90e4-66fbbbcc0268 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:37.539481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-78e7cfac-8350-43f6-82bb-61db565a5350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:37.561681 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95231248-74b2-4719-90e4-66fbbbcc0268 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:37.576013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344530c5-1e35-4d56-8123-e3a67268ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:37.576708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344530c5-1e35-4d56-8123-e3a67268ff44 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:37.576979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344530c5-1e35-4d56-8123-e3a67268ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:37.577268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344530c5-1e35-4d56-8123-e3a67268ff44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:37.579306 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344530c5-1e35-4d56-8123-e3a67268ff44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:37.579696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344530c5-1e35-4d56-8123-e3a67268ff44 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:37.599038 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 857/1706] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:37.600066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344530c5-1e35-4d56-8123-e3a67268ff44 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:37.640699 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344530c5-1e35-4d56-8123-e3a67268ff44 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:37.660569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e8d4c-7120-4caa-8868-84d9475885f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:37.661273 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8d4c-7120-4caa-8868-84d9475885f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:37.661554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8d4c-7120-4caa-8868-84d9475885f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:37.662005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e8d4c-7120-4caa-8868-84d9475885f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:37.662976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e8d4c-7120-4caa-8868-84d9475885f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:37.665110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e8d4c-7120-4caa-8868-84d9475885f9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:37.710762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 858/1707] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:37.711878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e8d4c-7120-4caa-8868-84d9475885f9 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:37.745247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e8d4c-7120-4caa-8868-84d9475885f9 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:37.768565 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86052175-6142-4db5-8049-2b47b4f20637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:37.769755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86052175-6142-4db5-8049-2b47b4f20637 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:37.770039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86052175-6142-4db5-8049-2b47b4f20637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:37.770354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86052175-6142-4db5-8049-2b47b4f20637 admin admin] PATH_INFO: `/v3/projects/7a6f47da46b743f4bfdf8c0ea70e05b2/users/f4c25f712b4e46a5bba6fb8960420b16/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:37.843548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7cfac-8350-43f6-82bb-61db565a5350 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:37.846857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86052175-6142-4db5-8049-2b47b4f20637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6f47da46b743f4bfdf8c0ea70e05b2, user_id=f4c25f712b4e46a5bba6fb8960420b16, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:37.849765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86052175-6142-4db5-8049-2b47b4f20637 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:37.878066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 859/1708] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:37 2022] PUT /identity/v3/projects/7a6f47da46b743f4bfdf8c0ea70e05b2/users/f4c25f712b4e46a5bba6fb8960420b16/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:37.888302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7a3e6-5d7d-4c08-8475-dee2b4e65451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:37.888302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7a3e6-5d7d-4c08-8475-dee2b4e65451 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:37.888302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7a3e6-5d7d-4c08-8475-dee2b4e65451 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:37.888302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7a3e6-5d7d-4c08-8475-dee2b4e65451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:37.891067 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85973c-a682-46bd-9958-47cd0313ca5d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:37.891753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85973c-a682-46bd-9958-47cd0313ca5d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:37.892166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85973c-a682-46bd-9958-47cd0313ca5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:37.939126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9c85973c-a682-46bd-9958-47cd0313ca5d None None] MFA Rules not processed for user `f4c25f712b4e46a5bba6fb8960420b16`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:37.941982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9c85973c-a682-46bd-9958-47cd0313ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:38.047651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 860/1709] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:38.049781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85973c-a682-46bd-9958-47cd0313ca5d None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:38.157802 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85973c-a682-46bd-9958-47cd0313ca5d None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:38.165161 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7a3e6-5d7d-4c08-8475-dee2b4e65451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:38.175083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7a3e6-5d7d-4c08-8475-dee2b4e65451 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:38.187855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2666ab5-bb2b-404a-86eb-3169396137bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:38.188915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2666ab5-bb2b-404a-86eb-3169396137bf admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:38.189277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2666ab5-bb2b-404a-86eb-3169396137bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:38.189558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2666ab5-bb2b-404a-86eb-3169396137bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:38.190283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2666ab5-bb2b-404a-86eb-3169396137bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:38.192632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2666ab5-bb2b-404a-86eb-3169396137bf admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:38.208204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 850/1710] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:38.302060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7a3e6-5d7d-4c08-8475-dee2b4e65451 service nova] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:38.302767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 861/1711] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:38 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:38.324973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7a3e6-5d7d-4c08-8475-dee2b4e65451 service nova] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:38.548903 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd13786-7b3b-4ed7-b1b8-3316e3c1a0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:38.550133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13786-7b3b-4ed7-b1b8-3316e3c1a0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:38.550659 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13786-7b3b-4ed7-b1b8-3316e3c1a0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:38.550956 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13786-7b3b-4ed7-b1b8-3316e3c1a0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:38.551668 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd13786-7b3b-4ed7-b1b8-3316e3c1a0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:38.554153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd13786-7b3b-4ed7-b1b8-3316e3c1a0f9 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:38.612059 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 851/1712] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:38 2022] POST /identity/v3/users => generated 295 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:38.612187 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2666ab5-bb2b-404a-86eb-3169396137bf admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:38.630868 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2666ab5-bb2b-404a-86eb-3169396137bf admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:38.644433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657272-6fd8-48a7-9824-e4bce693f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:38.645597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657272-6fd8-48a7-9824-e4bce693f5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:38.646162 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657272-6fd8-48a7-9824-e4bce693f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:38.646678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657272-6fd8-48a7-9824-e4bce693f5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:38.647815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7657272-6fd8-48a7-9824-e4bce693f5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:38.652760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7657272-6fd8-48a7-9824-e4bce693f5d4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:38.691977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 862/1713] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:38.693045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd13786-7b3b-4ed7-b1b8-3316e3c1a0f9 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:38.754998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd13786-7b3b-4ed7-b1b8-3316e3c1a0f9 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:38.787910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a790fc-64cb-444a-a559-f82d92cf0499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:38.789797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a790fc-64cb-444a-a559-f82d92cf0499 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:38.791409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a790fc-64cb-444a-a559-f82d92cf0499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:38.806408 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a790fc-64cb-444a-a559-f82d92cf0499 admin admin] PATH_INFO: `/v3/projects/c4176c990dc24685b2f0e8fe2308517f/users/ca138461d1e24d6c9981b260b62243ea/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:38.901316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a790fc-64cb-444a-a559-f82d92cf0499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4176c990dc24685b2f0e8fe2308517f, user_id=ca138461d1e24d6c9981b260b62243ea, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:38.919460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a790fc-64cb-444a-a559-f82d92cf0499 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:38.960474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 852/1714] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:38 2022] PUT /identity/v3/projects/c4176c990dc24685b2f0e8fe2308517f/users/ca138461d1e24d6c9981b260b62243ea/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:38.964576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657272-6fd8-48a7-9824-e4bce693f5d4 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:38.995107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657272-6fd8-48a7-9824-e4bce693f5d4 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:39.303484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bf430-c03f-4b4c-954b-6d071895e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:39.304325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bf430-c03f-4b4c-954b-6d071895e842 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:39.304609 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bf430-c03f-4b4c-954b-6d071895e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:39.304882 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bf430-c03f-4b4c-954b-6d071895e842 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:39.305840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bf430-c03f-4b4c-954b-6d071895e842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:39.313889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bf430-c03f-4b4c-954b-6d071895e842 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:39.355392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 863/1715] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:39.356051 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a790fc-64cb-444a-a559-f82d92cf0499 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:39.373382 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a790fc-64cb-444a-a559-f82d92cf0499 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:39.407553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308f57-60d8-4d98-86da-934807921fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:39.408470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308f57-60d8-4d98-86da-934807921fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:39.408755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308f57-60d8-4d98-86da-934807921fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:39.409680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308f57-60d8-4d98-86da-934807921fa9 admin admin] PATH_INFO: `/v3/projects/c4176c990dc24685b2f0e8fe2308517f/users/ca138461d1e24d6c9981b260b62243ea/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:39.420266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89308f57-60d8-4d98-86da-934807921fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4176c990dc24685b2f0e8fe2308517f, user_id=ca138461d1e24d6c9981b260b62243ea, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:39.442374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89308f57-60d8-4d98-86da-934807921fa9 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:39.486345 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 853/1716] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:39 2022] PUT /identity/v3/projects/c4176c990dc24685b2f0e8fe2308517f/users/ca138461d1e24d6c9981b260b62243ea/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:39.487385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2581f1-14ca-4ac8-92f7-645217ec1b09 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:39.487790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2581f1-14ca-4ac8-92f7-645217ec1b09 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:39.488183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2581f1-14ca-4ac8-92f7-645217ec1b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:39.599406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-ad2581f1-14ca-4ac8-92f7-645217ec1b09 None None] MFA Rules not processed for user `ca138461d1e24d6c9981b260b62243ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:39.601043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ad2581f1-14ca-4ac8-92f7-645217ec1b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:39.880624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 864/1717] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:39.890293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308f57-60d8-4d98-86da-934807921fa9 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:39.892912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-89308f57-60d8-4d98-86da-934807921fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:40.095543 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308f57-60d8-4d98-86da-934807921fa9 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:40.101101 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb354d28-1db1-4300-8918-1ba5018d0c32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:40.101926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354d28-1db1-4300-8918-1ba5018d0c32 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:40.102217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354d28-1db1-4300-8918-1ba5018d0c32 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:40.102627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354d28-1db1-4300-8918-1ba5018d0c32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:40.301264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb354d28-1db1-4300-8918-1ba5018d0c32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:40.304270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb354d28-1db1-4300-8918-1ba5018d0c32 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:40.335269 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 854/1718] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:40.637628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2581f1-14ca-4ac8-92f7-645217ec1b09 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:40.639771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ad2581f1-14ca-4ac8-92f7-645217ec1b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:40.879197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2581f1-14ca-4ac8-92f7-645217ec1b09 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:40.884833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:40.886706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:40.887426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:40.887968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] PATH_INFO: `/v3/projects/b97938b286404711bf362311d1daca56` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:40.889632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97938b286404711bf362311d1daca56)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:40.892350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:40.993218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb354d28-1db1-4300-8918-1ba5018d0c32 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:40.995240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-bb354d28-1db1-4300-8918-1ba5018d0c32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:40.995397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97938b286404711bf362311d1daca56', 'request_id': 'req-468c4356-e77f-41d0-bfc9-233e57c823e5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:41.004539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97938b286404711bf362311d1daca56', 'request_id': 'req-468c4356-e77f-41d0-bfc9-233e57c823e5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:41.015738 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97938b286404711bf362311d1daca56', 'request_id': 'req-468c4356-e77f-41d0-bfc9-233e57c823e5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:41.026439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb354d28-1db1-4300-8918-1ba5018d0c32 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:41.048855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] The token cache is being invalidate because project b97938b286404711bf362311d1daca56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:46:41.049251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:41.050361 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-468c4356-e77f-41d0-bfc9-233e57c823e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:41.058370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 865/1719] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:46:40 2022] DELETE /identity/v3/projects/b97938b286404711bf362311d1daca56 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:41.060624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c832-8e59-47c1-a086-3dd7e88def89 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:41.060913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c832-8e59-47c1-a086-3dd7e88def89 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:41.061190 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8c832-8e59-47c1-a086-3dd7e88def89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:41.135574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-05d8c832-8e59-47c1-a086-3dd7e88def89 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:41.141969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-05d8c832-8e59-47c1-a086-3dd7e88def89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:41.175625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:41.176648 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:41.178878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:41.180106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] PATH_INFO: `/v3/projects/8ec54ba6b21244b4b80990eb98f87b3b` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:41.184358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec54ba6b21244b4b80990eb98f87b3b)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:41.200077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:41.321695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 866/1720] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:41.333587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394c763-820d-4dae-8d3a-331d05262541 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:41.335651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394c763-820d-4dae-8d3a-331d05262541 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:41.337205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394c763-820d-4dae-8d3a-331d05262541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:41.345036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec54ba6b21244b4b80990eb98f87b3b', 'request_id': 'req-7e79c133-0e78-411e-b191-a881ce8c3df9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:41.367606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec54ba6b21244b4b80990eb98f87b3b', 'request_id': 'req-7e79c133-0e78-411e-b191-a881ce8c3df9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:41.375638 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec54ba6b21244b4b80990eb98f87b3b', 'request_id': 'req-7e79c133-0e78-411e-b191-a881ce8c3df9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:41.383427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b394c763-820d-4dae-8d3a-331d05262541 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:41.390633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b394c763-820d-4dae-8d3a-331d05262541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:41.402917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] The token cache is being invalidate because project 8ec54ba6b21244b4b80990eb98f87b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:46:41.403300 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:41.404187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7e79c133-0e78-411e-b191-a881ce8c3df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:41.407622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 855/1721] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:46:40 2022] DELETE /identity/v3/projects/8ec54ba6b21244b4b80990eb98f87b3b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:41.409912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed75b8-3e0d-4133-982b-c3d55ed3b1a1 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:41.409912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed75b8-3e0d-4133-982b-c3d55ed3b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:41.410230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed75b8-3e0d-4133-982b-c3d55ed3b1a1 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:41.412479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 856/1722] 10.222.0.61 () {54 vars in 921 bytes} [Sat May 14 15:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:46:41.414209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd2da-3a31-4a38-a9f1-bea14c6c8669 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:41.414209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd2da-3a31-4a38-a9f1-bea14c6c8669 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:41.414672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd2da-3a31-4a38-a9f1-bea14c6c8669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:41.440876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-2b6dd2da-3a31-4a38-a9f1-bea14c6c8669 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:41.443255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2b6dd2da-3a31-4a38-a9f1-bea14c6c8669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:41.597657 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 857/1723] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:41.609690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadadfe-c1a4-4dc9-ad58-7019a7416d64 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:41.610010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadadfe-c1a4-4dc9-ad58-7019a7416d64 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:41.610898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadadfe-c1a4-4dc9-ad58-7019a7416d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:41.640339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 867/1724] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:41.644232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-faadadfe-c1a4-4dc9-ad58-7019a7416d64 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:41.644232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-faadadfe-c1a4-4dc9-ad58-7019a7416d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:41.644646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394c763-820d-4dae-8d3a-331d05262541 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:41.666186 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394c763-820d-4dae-8d3a-331d05262541 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:41.673107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 858/1725] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:41.674035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfa0b3-df3e-4fcb-a2b9-a129de0d44a2 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:41.685484 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfa0b3-df3e-4fcb-a2b9-a129de0d44a2 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:41.685945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfa0b3-df3e-4fcb-a2b9-a129de0d44a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:41.691450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf22d8-62d8-4099-82b8-9b63080cda91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:41.692139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf22d8-62d8-4099-82b8-9b63080cda91 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:41.692448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf22d8-62d8-4099-82b8-9b63080cda91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:41.692724 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf22d8-62d8-4099-82b8-9b63080cda91 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:41.694604 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf22d8-62d8-4099-82b8-9b63080cda91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:41.694929 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf22d8-62d8-4099-82b8-9b63080cda91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:41.697852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf22d8-62d8-4099-82b8-9b63080cda91 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:41.752841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-d4dfa0b3-df3e-4fcb-a2b9-a129de0d44a2 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:41.752841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d4dfa0b3-df3e-4fcb-a2b9-a129de0d44a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:41.753953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 868/1726] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:46:41.754338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf22d8-62d8-4099-82b8-9b63080cda91 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:41.780923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf22d8-62d8-4099-82b8-9b63080cda91 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:41.791107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4589ae-504e-4184-9089-b5d5b53985c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:41.795064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4589ae-504e-4184-9089-b5d5b53985c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:41.795486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4589ae-504e-4184-9089-b5d5b53985c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:41.795892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4589ae-504e-4184-9089-b5d5b53985c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:41.797394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4589ae-504e-4184-9089-b5d5b53985c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:41.798717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4589ae-504e-4184-9089-b5d5b53985c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:41.804380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4589ae-504e-4184-9089-b5d5b53985c0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:41.836191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 869/1727] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:46:41.841355 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4589ae-504e-4184-9089-b5d5b53985c0 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:41.873242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4589ae-504e-4184-9089-b5d5b53985c0 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:41.900094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7fbd6-b8d1-4673-b889-fc00819806ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:41.901252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fbd6-b8d1-4673-b889-fc00819806ac admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:41.902917 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fbd6-b8d1-4673-b889-fc00819806ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:41.903296 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7fbd6-b8d1-4673-b889-fc00819806ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:41.904770 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7fbd6-b8d1-4673-b889-fc00819806ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:41.913465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7fbd6-b8d1-4673-b889-fc00819806ac admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:41.954200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 859/1728] 10.222.0.61 () {58 vars in 1018 bytes} [Sat May 14 15:46:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:41.955151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfa0b3-df3e-4fcb-a2b9-a129de0d44a2 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:41.971095 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfa0b3-df3e-4fcb-a2b9-a129de0d44a2 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:41.977174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9162dc-551a-490c-998b-a13ba68ec5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:41.978252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9162dc-551a-490c-998b-a13ba68ec5aa admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:41.978752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9162dc-551a-490c-998b-a13ba68ec5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:41.979128 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9162dc-551a-490c-998b-a13ba68ec5aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:41.980929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9162dc-551a-490c-998b-a13ba68ec5aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:41.983336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9162dc-551a-490c-998b-a13ba68ec5aa admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:41.992254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 870/1729] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:41 2022] POST /identity/v3/projects => generated 363 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:41.997538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7fbd6-b8d1-4673-b889-fc00819806ac admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:42.056752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 860/1730] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:41 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:42.061637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9162dc-551a-490c-998b-a13ba68ec5aa admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:42.216012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9162dc-551a-490c-998b-a13ba68ec5aa admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:42.225635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e10aeb-2c0b-4db3-b1bd-ded46950773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:42.226571 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e10aeb-2c0b-4db3-b1bd-ded46950773e admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:42.227110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e10aeb-2c0b-4db3-b1bd-ded46950773e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:42.227397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e10aeb-2c0b-4db3-b1bd-ded46950773e admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:42.228604 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e10aeb-2c0b-4db3-b1bd-ded46950773e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:42.230992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e10aeb-2c0b-4db3-b1bd-ded46950773e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:42.243117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7fbd6-b8d1-4673-b889-fc00819806ac admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:42.255028 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c0e0-5fe8-498c-bb39-3ae072151a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:42.255825 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c0e0-5fe8-498c-bb39-3ae072151a0b admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:42.256216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c0e0-5fe8-498c-bb39-3ae072151a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:42.256558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c0e0-5fe8-498c-bb39-3ae072151a0b admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:42.258359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407c0e0-5fe8-498c-bb39-3ae072151a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:42.272848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407c0e0-5fe8-498c-bb39-3ae072151a0b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:42.286126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 861/1731] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:42 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:42.291821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e10aeb-2c0b-4db3-b1bd-ded46950773e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:42.303533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 871/1732] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:41 2022] POST /identity/v3/users => generated 282 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:42.307591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c0e0-5fe8-498c-bb39-3ae072151a0b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:42.329673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e10aeb-2c0b-4db3-b1bd-ded46950773e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:42.330342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c0e0-5fe8-498c-bb39-3ae072151a0b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:42.340893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19de1c-d102-4263-b6af-ecb728ffc40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:42.341843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19de1c-d102-4263-b6af-ecb728ffc40a admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:42.343382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19de1c-d102-4263-b6af-ecb728ffc40a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:42.345963 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19de1c-d102-4263-b6af-ecb728ffc40a admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:42.347779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19de1c-d102-4263-b6af-ecb728ffc40a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:42.347982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693feeb-63f3-4eeb-8ba8-4af92d8fe20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:42.348894 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693feeb-63f3-4eeb-8ba8-4af92d8fe20d admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:42.349402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693feeb-63f3-4eeb-8ba8-4af92d8fe20d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:42.349761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693feeb-63f3-4eeb-8ba8-4af92d8fe20d admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:42.350738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693feeb-63f3-4eeb-8ba8-4af92d8fe20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:42.351391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19de1c-d102-4263-b6af-ecb728ffc40a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:42.354229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693feeb-63f3-4eeb-8ba8-4af92d8fe20d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:42.377790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 872/1733] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:42.381633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19de1c-d102-4263-b6af-ecb728ffc40a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:42.387135 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 862/1734] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:42.394213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693feeb-63f3-4eeb-8ba8-4af92d8fe20d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:42.398913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19de1c-d102-4263-b6af-ecb728ffc40a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:42.414284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673336f7-40f8-47b4-bc16-9a14ce33ab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:42.415071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673336f7-40f8-47b4-bc16-9a14ce33ab87 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:42.415433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673336f7-40f8-47b4-bc16-9a14ce33ab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:42.415769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673336f7-40f8-47b4-bc16-9a14ce33ab87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:42.416573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673336f7-40f8-47b4-bc16-9a14ce33ab87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:42.421149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673336f7-40f8-47b4-bc16-9a14ce33ab87 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:42.423970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693feeb-63f3-4eeb-8ba8-4af92d8fe20d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:42.439519 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178ef03-d898-4d1a-9912-149d7bbd305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:42.440690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178ef03-d898-4d1a-9912-149d7bbd305c admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:42.440984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178ef03-d898-4d1a-9912-149d7bbd305c admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:42.441285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178ef03-d898-4d1a-9912-149d7bbd305c admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:42.444862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 873/1735] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:46:42.448224 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673336f7-40f8-47b4-bc16-9a14ce33ab87 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:42.449172 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178ef03-d898-4d1a-9912-149d7bbd305c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:42.464909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178ef03-d898-4d1a-9912-149d7bbd305c admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:42.469585 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673336f7-40f8-47b4-bc16-9a14ce33ab87 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:42.516003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a8a00b-8a17-405b-8df0-720d1a195202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:42.516928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8a00b-8a17-405b-8df0-720d1a195202 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:42.517215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8a00b-8a17-405b-8df0-720d1a195202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:42.517493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a8a00b-8a17-405b-8df0-720d1a195202 admin admin] PATH_INFO: `/v3/projects/08b0c6c9c15541e39ca6dc4634d998eb/users/c9fb2e7db01d4a739e1db821de69ebde/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:42.519063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 863/1736] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:46:42.520056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178ef03-d898-4d1a-9912-149d7bbd305c admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:42.537838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178ef03-d898-4d1a-9912-149d7bbd305c admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:42.548275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ce28d-e74a-4bdb-84bd-9843d5a9474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:42.549234 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ce28d-e74a-4bdb-84bd-9843d5a9474b admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:42.549584 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ce28d-e74a-4bdb-84bd-9843d5a9474b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:42.549876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ce28d-e74a-4bdb-84bd-9843d5a9474b admin admin] PATH_INFO: `/v3/projects/ed6df23d01a0486facc3612d4b1ae15d/users/9a2c656a03d24fc4bb86fe958ac6c53e/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:42.572183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ce28d-e74a-4bdb-84bd-9843d5a9474b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6df23d01a0486facc3612d4b1ae15d, user_id=9a2c656a03d24fc4bb86fe958ac6c53e, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:42.576286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ce28d-e74a-4bdb-84bd-9843d5a9474b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:42.591796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8a00b-8a17-405b-8df0-720d1a195202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b0c6c9c15541e39ca6dc4634d998eb, user_id=c9fb2e7db01d4a739e1db821de69ebde, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:42.597567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a8a00b-8a17-405b-8df0-720d1a195202 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:42.641957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 864/1737] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:42 2022] PUT /identity/v3/projects/ed6df23d01a0486facc3612d4b1ae15d/users/9a2c656a03d24fc4bb86fe958ac6c53e/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:42.642654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 874/1738] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:42 2022] PUT /identity/v3/projects/08b0c6c9c15541e39ca6dc4634d998eb/users/c9fb2e7db01d4a739e1db821de69ebde/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:42.647773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae1c5-2af0-43e4-ab60-78895fea8d92 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:42.648374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae1c5-2af0-43e4-ab60-78895fea8d92 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:42.648374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae1c5-2af0-43e4-ab60-78895fea8d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:42.658605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ce28d-e74a-4bdb-84bd-9843d5a9474b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:42.662388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-954ce28d-e74a-4bdb-84bd-9843d5a9474b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:42.751388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-036ae1c5-2af0-43e4-ab60-78895fea8d92 None None] MFA Rules not processed for user `9a2c656a03d24fc4bb86fe958ac6c53e`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:42.752640 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-036ae1c5-2af0-43e4-ab60-78895fea8d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:42.922048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ce28d-e74a-4bdb-84bd-9843d5a9474b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:42.987034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 875/1739] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:42.988652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0f9d-33b6-4df8-b1e0-88a4c7220ede None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:42.988949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0f9d-33b6-4df8-b1e0-88a4c7220ede None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:42.989231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0f9d-33b6-4df8-b1e0-88a4c7220ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:43.061448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-275b0f9d-33b6-4df8-b1e0-88a4c7220ede None None] MFA Rules not processed for user `c9fb2e7db01d4a739e1db821de69ebde`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:43.065679 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-275b0f9d-33b6-4df8-b1e0-88a4c7220ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:43.111505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79d2a0-a61d-44fa-a04c-e9e9feffdc4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:43.112229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79d2a0-a61d-44fa-a04c-e9e9feffdc4a service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:43.113199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79d2a0-a61d-44fa-a04c-e9e9feffdc4a service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:43.113532 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79d2a0-a61d-44fa-a04c-e9e9feffdc4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:43.143802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79d2a0-a61d-44fa-a04c-e9e9feffdc4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:43.145439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79d2a0-a61d-44fa-a04c-e9e9feffdc4a service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:43.188466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 865/1740] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:43.189469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79d2a0-a61d-44fa-a04c-e9e9feffdc4a service nova] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:43.293130 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 876/1741] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:43.296333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b0f9d-33b6-4df8-b1e0-88a4c7220ede None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:43.452921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79d2a0-a61d-44fa-a04c-e9e9feffdc4a service nova] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:43.476604 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2aa7-9588-4b7d-809c-822c1d263203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:43.481540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2aa7-9588-4b7d-809c-822c1d263203 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:43.481851 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2aa7-9588-4b7d-809c-822c1d263203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:43.482126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2aa7-9588-4b7d-809c-822c1d263203 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:43.488096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b2aa7-9588-4b7d-809c-822c1d263203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:43.500389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b2aa7-9588-4b7d-809c-822c1d263203 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:43.512660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b0f9d-33b6-4df8-b1e0-88a4c7220ede None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:43.525127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c59bc-267a-4274-a38f-038ab9cf9c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:43.526545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c59bc-267a-4274-a38f-038ab9cf9c8e admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:43.526934 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c59bc-267a-4274-a38f-038ab9cf9c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:43.527213 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c59bc-267a-4274-a38f-038ab9cf9c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:43.528090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c59bc-267a-4274-a38f-038ab9cf9c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:43.531353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c59bc-267a-4274-a38f-038ab9cf9c8e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:43.594919 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 866/1742] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:43 2022] POST /identity/v3/projects => generated 383 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:43.600915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2aa7-9588-4b7d-809c-822c1d263203 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:43.634005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 877/1743] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:43 2022] POST /identity/v3/projects => generated 365 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:43.638838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c59bc-267a-4274-a38f-038ab9cf9c8e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:43.764518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c59bc-267a-4274-a38f-038ab9cf9c8e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:43.770693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38040932-02f7-4af2-9dc8-c371d5c6c7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:43.771671 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38040932-02f7-4af2-9dc8-c371d5c6c7aa admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:43.772160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38040932-02f7-4af2-9dc8-c371d5c6c7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:43.772795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38040932-02f7-4af2-9dc8-c371d5c6c7aa admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:43.773581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38040932-02f7-4af2-9dc8-c371d5c6c7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:43.775610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38040932-02f7-4af2-9dc8-c371d5c6c7aa admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:43.803835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2aa7-9588-4b7d-809c-822c1d263203 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:43.805510 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 878/1744] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:43 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:46:43.809949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38040932-02f7-4af2-9dc8-c371d5c6c7aa admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:43.815001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdc1e2-689d-40d9-a912-fa225f66d320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:43.816000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdc1e2-689d-40d9-a912-fa225f66d320 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:43.816461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdc1e2-689d-40d9-a912-fa225f66d320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:43.817208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdc1e2-689d-40d9-a912-fa225f66d320 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:43.818157 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdc1e2-689d-40d9-a912-fa225f66d320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:43.820309 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdc1e2-689d-40d9-a912-fa225f66d320 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:43.836291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38040932-02f7-4af2-9dc8-c371d5c6c7aa admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:43.846812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a3aa1-130b-4482-965f-644602b171b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:43.848578 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a3aa1-130b-4482-965f-644602b171b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:43.849183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a3aa1-130b-4482-965f-644602b171b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:43.849845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a3aa1-130b-4482-965f-644602b171b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:43.850995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a3aa1-130b-4482-965f-644602b171b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:43.855627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a3aa1-130b-4482-965f-644602b171b0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:43.871140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 867/1745] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:43 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:43.874823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 879/1746] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:43.874992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdc1e2-689d-40d9-a912-fa225f66d320 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:43.878670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a3aa1-130b-4482-965f-644602b171b0 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:43.895168 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdc1e2-689d-40d9-a912-fa225f66d320 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:43.905643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a3aa1-130b-4482-965f-644602b171b0 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:43.914901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96131-cb14-4c98-a640-9df2c38aaff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:43.919030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96131-cb14-4c98-a640-9df2c38aaff5 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:43.919932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96131-cb14-4c98-a640-9df2c38aaff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:43.920269 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc96131-cb14-4c98-a640-9df2c38aaff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:43.921795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca670b1-f803-41a4-a863-f01e2b97cd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:43.922605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc96131-cb14-4c98-a640-9df2c38aaff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:43.924057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca670b1-f803-41a4-a863-f01e2b97cd9d admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:43.924341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca670b1-f803-41a4-a863-f01e2b97cd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:43.925757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca670b1-f803-41a4-a863-f01e2b97cd9d admin admin] PATH_INFO: `/v3/projects/c471fc48658147e4b46c2ec52874c43f/users/0d037a95fc0243a8870f5711784cce45/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:43.926505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc96131-cb14-4c98-a640-9df2c38aaff5 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:43.982722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 868/1747] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:43.989578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96131-cb14-4c98-a640-9df2c38aaff5 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:44.020680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc96131-cb14-4c98-a640-9df2c38aaff5 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:44.037235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c651de-12f5-403f-b70a-c3875c56cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:44.038335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c651de-12f5-403f-b70a-c3875c56cc52 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:44.038830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c651de-12f5-403f-b70a-c3875c56cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:44.039270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c651de-12f5-403f-b70a-c3875c56cc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:44.040099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c651de-12f5-403f-b70a-c3875c56cc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:44.045306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c651de-12f5-403f-b70a-c3875c56cc52 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:44.104223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 869/1748] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:44.106693 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c651de-12f5-403f-b70a-c3875c56cc52 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:44.128550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c651de-12f5-403f-b70a-c3875c56cc52 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:44.141579 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c068b2b-0e4d-4ce9-b04b-62281a56d3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:44.142431 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c068b2b-0e4d-4ce9-b04b-62281a56d3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:44.142716 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c068b2b-0e4d-4ce9-b04b-62281a56d3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:44.143037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c068b2b-0e4d-4ce9-b04b-62281a56d3cd admin admin] PATH_INFO: `/v3/projects/1a2173e16b7040b1a80fdcda77dea2f0/users/33382051bb7f4647bbd4de727d06c022/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:44.177767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c068b2b-0e4d-4ce9-b04b-62281a56d3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2173e16b7040b1a80fdcda77dea2f0, user_id=33382051bb7f4647bbd4de727d06c022, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:44.183964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c068b2b-0e4d-4ce9-b04b-62281a56d3cd admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:44.212487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 870/1749] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:44 2022] PUT /identity/v3/projects/1a2173e16b7040b1a80fdcda77dea2f0/users/33382051bb7f4647bbd4de727d06c022/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:44.224222 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34d2bb-a8df-41ff-a732-91798d371e78 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:44.225392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34d2bb-a8df-41ff-a732-91798d371e78 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:44.225392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34d2bb-a8df-41ff-a732-91798d371e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:44.275970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-eb34d2bb-a8df-41ff-a732-91798d371e78 None None] MFA Rules not processed for user `33382051bb7f4647bbd4de727d06c022`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:44.278059 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-eb34d2bb-a8df-41ff-a732-91798d371e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:44.381616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca670b1-f803-41a4-a863-f01e2b97cd9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c471fc48658147e4b46c2ec52874c43f, user_id=0d037a95fc0243a8870f5711784cce45, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:44.385528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca670b1-f803-41a4-a863-f01e2b97cd9d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:44.406757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 880/1750] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:43 2022] PUT /identity/v3/projects/c471fc48658147e4b46c2ec52874c43f/users/0d037a95fc0243a8870f5711784cce45/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:44.411144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca670b1-f803-41a4-a863-f01e2b97cd9d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:44.462227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 871/1751] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:46:44.467742 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34d2bb-a8df-41ff-a732-91798d371e78 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:44.521801 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca670b1-f803-41a4-a863-f01e2b97cd9d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:44.528273 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab609d2-4cca-4873-8911-04250936529a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:44.528911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab609d2-4cca-4873-8911-04250936529a admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:44.529319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab609d2-4cca-4873-8911-04250936529a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:44.529486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab609d2-4cca-4873-8911-04250936529a admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:44.530214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab609d2-4cca-4873-8911-04250936529a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:44.532035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab609d2-4cca-4873-8911-04250936529a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:44.565685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 881/1752] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:46:44.570173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab609d2-4cca-4873-8911-04250936529a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:44.583904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab609d2-4cca-4873-8911-04250936529a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:44.595946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89a99a-8c97-433f-8380-3db94c93648b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:44.600430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34d2bb-a8df-41ff-a732-91798d371e78 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:44.608873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89a99a-8c97-433f-8380-3db94c93648b admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:44.609226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89a99a-8c97-433f-8380-3db94c93648b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:44.609607 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89a99a-8c97-433f-8380-3db94c93648b admin admin] PATH_INFO: `/v3/projects/c471fc48658147e4b46c2ec52874c43f/users/0d037a95fc0243a8870f5711784cce45/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:44.615108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2800079-ebbe-487e-89fd-e4d5f29d3017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:44.615816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2800079-ebbe-487e-89fd-e4d5f29d3017 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:44.615997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89a99a-8c97-433f-8380-3db94c93648b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c471fc48658147e4b46c2ec52874c43f, user_id=0d037a95fc0243a8870f5711784cce45, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:44.616075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2800079-ebbe-487e-89fd-e4d5f29d3017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:44.616349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2800079-ebbe-487e-89fd-e4d5f29d3017 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:44.617055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2800079-ebbe-487e-89fd-e4d5f29d3017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:44.619046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2800079-ebbe-487e-89fd-e4d5f29d3017 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:44.622797 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89a99a-8c97-433f-8380-3db94c93648b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:44.656029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 882/1753] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:44 2022] PUT /identity/v3/projects/c471fc48658147e4b46c2ec52874c43f/users/0d037a95fc0243a8870f5711784cce45/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:44.666270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df2ffd-5518-4d2f-9ce2-ffc81447204a None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:44.666595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df2ffd-5518-4d2f-9ce2-ffc81447204a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:44.666899 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df2ffd-5518-4d2f-9ce2-ffc81447204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:44.679202 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 872/1754] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:44 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:44.680080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2800079-ebbe-487e-89fd-e4d5f29d3017 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:44.723453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-e6df2ffd-5518-4d2f-9ce2-ffc81447204a None None] MFA Rules not processed for user `0d037a95fc0243a8870f5711784cce45`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:44.728317 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e6df2ffd-5518-4d2f-9ce2-ffc81447204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:44.807778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2800079-ebbe-487e-89fd-e4d5f29d3017 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:44.824751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344443bb-db07-457d-9a03-b133303f4ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:44.825453 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344443bb-db07-457d-9a03-b133303f4ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:44.825740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344443bb-db07-457d-9a03-b133303f4ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:44.826019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344443bb-db07-457d-9a03-b133303f4ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:44.826761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344443bb-db07-457d-9a03-b133303f4ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:44.828721 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344443bb-db07-457d-9a03-b133303f4ab1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:44.881923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 873/1755] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:44 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:44.885934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344443bb-db07-457d-9a03-b133303f4ab1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:44.909260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344443bb-db07-457d-9a03-b133303f4ab1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:44.929224 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecc509-ad41-4c12-aa24-251199ea9ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:44.929922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc509-ad41-4c12-aa24-251199ea9ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:44.930204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc509-ad41-4c12-aa24-251199ea9ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:44.930523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecc509-ad41-4c12-aa24-251199ea9ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:44.931272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecc509-ad41-4c12-aa24-251199ea9ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:44.933276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ecc509-ad41-4c12-aa24-251199ea9ad8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:44.947223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 883/1756] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:46:44.961302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df2ffd-5518-4d2f-9ce2-ffc81447204a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:44.963000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e6df2ffd-5518-4d2f-9ce2-ffc81447204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:44.982947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 874/1757] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:46:44.984130 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecc509-ad41-4c12-aa24-251199ea9ad8 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:44.997865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecc509-ad41-4c12-aa24-251199ea9ad8 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:45.013063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c6918-47c4-4ed5-8348-7ca20fd6f126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:45.014265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c6918-47c4-4ed5-8348-7ca20fd6f126 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:45.014738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c6918-47c4-4ed5-8348-7ca20fd6f126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:45.015169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c6918-47c4-4ed5-8348-7ca20fd6f126 admin admin] PATH_INFO: `/v3/projects/e4dea3cdf67d434991e9b57d4f53c6ff/users/09dd9d4317c14a54b9982accb2ee0f8d/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:45.048350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c6918-47c4-4ed5-8348-7ca20fd6f126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4dea3cdf67d434991e9b57d4f53c6ff, user_id=09dd9d4317c14a54b9982accb2ee0f8d, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:45.054995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c6918-47c4-4ed5-8348-7ca20fd6f126 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:45.084324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 875/1758] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:44 2022] PUT /identity/v3/projects/e4dea3cdf67d434991e9b57d4f53c6ff/users/09dd9d4317c14a54b9982accb2ee0f8d/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:45.086950 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfde51-3ea8-42ab-98dc-a85bb57807c3 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:45.087459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfde51-3ea8-42ab-98dc-a85bb57807c3 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:45.088018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfde51-3ea8-42ab-98dc-a85bb57807c3 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:45.094520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 876/1759] 10.222.0.61 () {54 vars in 921 bytes} [Sat May 14 15:46:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:46:45.096244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfde51-3ea8-42ab-98dc-a85bb57807c3 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:45.163747 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df2ffd-5518-4d2f-9ce2-ffc81447204a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:45.254733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfde51-3ea8-42ab-98dc-a85bb57807c3 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:45.274054 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4b7c7-af19-48f6-8986-3c3d8e468ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:45.274888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4b7c7-af19-48f6-8986-3c3d8e468ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:45.275158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4b7c7-af19-48f6-8986-3c3d8e468ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:45.275755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4b7c7-af19-48f6-8986-3c3d8e468ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:45.276525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4b7c7-af19-48f6-8986-3c3d8e468ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:45.279164 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4b7c7-af19-48f6-8986-3c3d8e468ec0 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:45.284664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54a288-a90a-4521-84e4-760d8f32abe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:45.285663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54a288-a90a-4521-84e4-760d8f32abe6 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:45.289502 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54a288-a90a-4521-84e4-760d8f32abe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:45.290064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54a288-a90a-4521-84e4-760d8f32abe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:45.309107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 877/1760] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:45.311332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a985e6-40c1-45b7-87d3-3543f42a5703 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:45.311627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a985e6-40c1-45b7-87d3-3543f42a5703 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:45.311952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a985e6-40c1-45b7-87d3-3543f42a5703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:45.399553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-11a985e6-40c1-45b7-87d3-3543f42a5703 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:45.400814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-11a985e6-40c1-45b7-87d3-3543f42a5703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:45.492497 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54a288-a90a-4521-84e4-760d8f32abe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:45.494259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54a288-a90a-4521-84e4-760d8f32abe6 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:45.509689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 884/1761] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:46:45.510715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54a288-a90a-4521-84e4-760d8f32abe6 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:45.523217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54a288-a90a-4521-84e4-760d8f32abe6 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:45.538591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1707b66-3c53-42bb-acc5-ef47f9d95752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:45.540601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1707b66-3c53-42bb-acc5-ef47f9d95752 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:45.540961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1707b66-3c53-42bb-acc5-ef47f9d95752 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:45.541312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1707b66-3c53-42bb-acc5-ef47f9d95752 admin admin] PATH_INFO: `/v3/projects/e4dea3cdf67d434991e9b57d4f53c6ff/users/09dd9d4317c14a54b9982accb2ee0f8d/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:45.546600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1707b66-3c53-42bb-acc5-ef47f9d95752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4dea3cdf67d434991e9b57d4f53c6ff, user_id=09dd9d4317c14a54b9982accb2ee0f8d, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:45.554103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1707b66-3c53-42bb-acc5-ef47f9d95752 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:45.582693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 885/1762] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:45 2022] PUT /identity/v3/projects/e4dea3cdf67d434991e9b57d4f53c6ff/users/09dd9d4317c14a54b9982accb2ee0f8d/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:45.592785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5283-01ad-4378-a4a7-3e297975bd66 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:45.593148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5283-01ad-4378-a4a7-3e297975bd66 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:45.593496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f5283-01ad-4378-a4a7-3e297975bd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:45.624791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 878/1763] 10.222.0.61 () {58 vars in 1018 bytes} [Sat May 14 15:46:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:45.643468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a985e6-40c1-45b7-87d3-3543f42a5703 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:45.677563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a985e6-40c1-45b7-87d3-3543f42a5703 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:45.688059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-882f5283-01ad-4378-a4a7-3e297975bd66 None None] MFA Rules not processed for user `09dd9d4317c14a54b9982accb2ee0f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:45.689303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-882f5283-01ad-4378-a4a7-3e297975bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:45.848352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06918b4-afe4-43e2-b92a-4105af69c3d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:45.849192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06918b4-afe4-43e2-b92a-4105af69c3d4 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:45.849580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06918b4-afe4-43e2-b92a-4105af69c3d4 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:45.849954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06918b4-afe4-43e2-b92a-4105af69c3d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:45.869399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 886/1764] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:45.872463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f5283-01ad-4378-a4a7-3e297975bd66 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:45.876570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-882f5283-01ad-4378-a4a7-3e297975bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:45.888406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06918b4-afe4-43e2-b92a-4105af69c3d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:45.893210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06918b4-afe4-43e2-b92a-4105af69c3d4 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:45.928144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 879/1765] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:46:46.032712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f5283-01ad-4378-a4a7-3e297975bd66 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:46.041838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea77c35-1471-4a44-beef-5a5034d9eb3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:46.043037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea77c35-1471-4a44-beef-5a5034d9eb3f service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:46.044077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea77c35-1471-4a44-beef-5a5034d9eb3f service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:46.044677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea77c35-1471-4a44-beef-5a5034d9eb3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:46.067616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea77c35-1471-4a44-beef-5a5034d9eb3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:46.069432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea77c35-1471-4a44-beef-5a5034d9eb3f service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:46.104314 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 887/1766] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:46.226218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54149890-c677-43e2-ae43-29c6928552f3 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:46.229679 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54149890-c677-43e2-ae43-29c6928552f3 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:46.230610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54149890-c677-43e2-ae43-29c6928552f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:46.259306 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea77c35-1471-4a44-beef-5a5034d9eb3f service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:46.266723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-54149890-c677-43e2-ae43-29c6928552f3 None None] MFA Rules not processed for user `58bfb7417bc94583963401ae0fe9d39a`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:46.267945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-54149890-c677-43e2-ae43-29c6928552f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:46.371001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 880/1767] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:46.372474 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea77c35-1471-4a44-beef-5a5034d9eb3f service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:46.380452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:46.381323 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:46.381601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:46.381872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] PATH_INFO: `/v3/users/c9fb2e7db01d4a739e1db821de69ebde` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:46.383192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fb2e7db01d4a739e1db821de69ebde)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:46.385089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:46.466983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fb2e7db01d4a739e1db821de69ebde'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:46.490813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fb2e7db01d4a739e1db821de69ebde'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:46.491575 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fb2e7db01d4a739e1db821de69ebde'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:46.492336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fb2e7db01d4a739e1db821de69ebde'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:46.502878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fb2e7db01d4a739e1db821de69ebde'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:46.522897 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 888/1768] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:46:46 2022] DELETE /identity/v3/users/c9fb2e7db01d4a739e1db821de69ebde => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:46.530197 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefa219-e8b2-45d5-9f4d-d20f2d9a9a51 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:46.530998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefa219-e8b2-45d5-9f4d-d20f2d9a9a51 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:46.532796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefa219-e8b2-45d5-9f4d-d20f2d9a9a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:46.577319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-8aefa219-e8b2-45d5-9f4d-d20f2d9a9a51 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:46.578639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8aefa219-e8b2-45d5-9f4d-d20f2d9a9a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:46.690242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 881/1769] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:46.702503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:46.704179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:46.799458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c153550-45dc-49f7-8753-d44d0052b5a2 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:46.808887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15b2c4-bbd1-4503-82ae-66bfe109cd86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:46.809617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b2c4-bbd1-4503-82ae-66bfe109cd86 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:46.809971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b2c4-bbd1-4503-82ae-66bfe109cd86 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:46.810357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15b2c4-bbd1-4503-82ae-66bfe109cd86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:46.835652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15b2c4-bbd1-4503-82ae-66bfe109cd86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:46.835652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15b2c4-bbd1-4503-82ae-66bfe109cd86 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:46.871637 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 889/1770] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:46.929208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefa219-e8b2-45d5-9f4d-d20f2d9a9a51 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:46.930711 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8aefa219-e8b2-45d5-9f4d-d20f2d9a9a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:47.011953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66498140-2e8e-48b0-99bd-40d71363b8e9 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:47.012306 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66498140-2e8e-48b0-99bd-40d71363b8e9 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:47.012581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66498140-2e8e-48b0-99bd-40d71363b8e9 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:47.014959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 890/1771] 10.222.0.61 () {54 vars in 912 bytes} [Sat May 14 15:46:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:46:47.031582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1166386-58db-4640-b9fa-188c130c0c2d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:47.031960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1166386-58db-4640-b9fa-188c130c0c2d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:47.032308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1166386-58db-4640-b9fa-188c130c0c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:47.056892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefa219-e8b2-45d5-9f4d-d20f2d9a9a51 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:47.063153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c788633-f041-4bb3-94f9-0c7ec10e1c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:47.063788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788633-f041-4bb3-94f9-0c7ec10e1c19 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:47.064426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788633-f041-4bb3-94f9-0c7ec10e1c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:47.064701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788633-f041-4bb3-94f9-0c7ec10e1c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:47.066796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6c788633-f041-4bb3-94f9-0c7ec10e1c19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:47.077511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d1166386-58db-4640-b9fa-188c130c0c2d None None] MFA Rules not processed for user `abfc1e35362a4495a05475878db260f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:47.081251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d1166386-58db-4640-b9fa-188c130c0c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:47.121743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 891/1772] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:46:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:46:47.153218 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1166386-58db-4640-b9fa-188c130c0c2d None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:47.155839 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d1166386-58db-4640-b9fa-188c130c0c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:47.173670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1166386-58db-4640-b9fa-188c130c0c2d None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:47.185417 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776208aa-5136-4a2f-9d5a-eb3948a84068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:47.185874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776208aa-5136-4a2f-9d5a-eb3948a84068 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:47.186166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776208aa-5136-4a2f-9d5a-eb3948a84068 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:47.186473 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776208aa-5136-4a2f-9d5a-eb3948a84068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:47.201057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776208aa-5136-4a2f-9d5a-eb3948a84068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:47.208688 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776208aa-5136-4a2f-9d5a-eb3948a84068 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:47.230889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 892/1773] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:46:47.239172 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c788633-f041-4bb3-94f9-0c7ec10e1c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:47.240655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c788633-f041-4bb3-94f9-0c7ec10e1c19 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:47.258974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 882/1774] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:47.315121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776208aa-5136-4a2f-9d5a-eb3948a84068 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:47.316560 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-776208aa-5136-4a2f-9d5a-eb3948a84068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:47.345504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776208aa-5136-4a2f-9d5a-eb3948a84068 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:47.353583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:47.355200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:47.355631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:47.356170 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] PATH_INFO: `/v3/projects/08b0c6c9c15541e39ca6dc4634d998eb` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:47.357610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b0c6c9c15541e39ca6dc4634d998eb)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:47.366068 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:47.442188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b0c6c9c15541e39ca6dc4634d998eb', 'request_id': 'req-6471473c-0d00-479e-8ed3-7ea50ca9fab0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:47.450696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b0c6c9c15541e39ca6dc4634d998eb', 'request_id': 'req-6471473c-0d00-479e-8ed3-7ea50ca9fab0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:47.468833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b0c6c9c15541e39ca6dc4634d998eb', 'request_id': 'req-6471473c-0d00-479e-8ed3-7ea50ca9fab0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:47.481595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] The token cache is being invalidate because project 08b0c6c9c15541e39ca6dc4634d998eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:46:47.481892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:47.482672 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:47.484255 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 893/1775] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:46:47 2022] DELETE /identity/v3/projects/08b0c6c9c15541e39ca6dc4634d998eb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:47.488715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c788633-f041-4bb3-94f9-0c7ec10e1c19 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:47.504868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c788633-f041-4bb3-94f9-0c7ec10e1c19 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:47.612108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:47.613545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:47.613900 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:47.614245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] PATH_INFO: `/v3/users/0d037a95fc0243a8870f5711784cce45` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:47.615749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d037a95fc0243a8870f5711784cce45)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:47.617850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:47.697451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d037a95fc0243a8870f5711784cce45'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:47.716874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d037a95fc0243a8870f5711784cce45'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:47.717867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d037a95fc0243a8870f5711784cce45'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:47.718798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d037a95fc0243a8870f5711784cce45'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:47.728627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d037a95fc0243a8870f5711784cce45'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:47.748145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 883/1776] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:46:47 2022] DELETE /identity/v3/users/0d037a95fc0243a8870f5711784cce45 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:48.215736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:48.217872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:48.239673 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471473c-0d00-479e-8ed3-7ea50ca9fab0 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:48.311052 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:48.311935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:48.312221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:48.312550 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] PATH_INFO: `/v3/projects/c471fc48658147e4b46c2ec52874c43f` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:48.313765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c471fc48658147e4b46c2ec52874c43f)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:48.315803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:48.355869 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:48.363588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:48.376533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c471fc48658147e4b46c2ec52874c43f', 'request_id': 'req-f52ec750-9fdb-4dc4-998d-1910c8e52b03'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:48.383907 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c471fc48658147e4b46c2ec52874c43f', 'request_id': 'req-f52ec750-9fdb-4dc4-998d-1910c8e52b03'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:48.396890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c471fc48658147e4b46c2ec52874c43f', 'request_id': 'req-f52ec750-9fdb-4dc4-998d-1910c8e52b03'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:48.428246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] The token cache is being invalidate because project c471fc48658147e4b46c2ec52874c43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:46:48.428609 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:48.429443 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f52ec750-9fdb-4dc4-998d-1910c8e52b03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:48.435810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 894/1777] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:46:48 2022] DELETE /identity/v3/projects/c471fc48658147e4b46c2ec52874c43f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:48.437536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4850ac1-c055-47d4-a9c3-917004164ec8 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:48.437908 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4850ac1-c055-47d4-a9c3-917004164ec8 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:48.438372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4850ac1-c055-47d4-a9c3-917004164ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:48.482552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f777e-607d-4a69-8e5e-47a4858fab02 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:48.492114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c4850ac1-c055-47d4-a9c3-917004164ec8 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:48.496597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c4850ac1-c055-47d4-a9c3-917004164ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:48.568230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181b60-ace9-410e-a2b7-e594b5e92a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:48.568845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181b60-ace9-410e-a2b7-e594b5e92a04 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:48.568845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181b60-ace9-410e-a2b7-e594b5e92a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:48.568845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae181b60-ace9-410e-a2b7-e594b5e92a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:48.575608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ae181b60-ace9-410e-a2b7-e594b5e92a04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:48.631557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 895/1778] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:48.652662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873364b-5fab-4932-a6ef-cb472a5e3e53 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:48.652662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873364b-5fab-4932-a6ef-cb472a5e3e53 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:48.653108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873364b-5fab-4932-a6ef-cb472a5e3e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:48.684932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae181b60-ace9-410e-a2b7-e594b5e92a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:48.688326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae181b60-ace9-410e-a2b7-e594b5e92a04 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:48.697961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-5873364b-5fab-4932-a6ef-cb472a5e3e53 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:48.706448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-5873364b-5fab-4932-a6ef-cb472a5e3e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:48.706689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 884/1779] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:48.728354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 896/1780] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:48.733241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181b60-ace9-410e-a2b7-e594b5e92a04 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:48.753415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae181b60-ace9-410e-a2b7-e594b5e92a04 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:48.769827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8dd26-0884-47f3-95f5-1fe5269fe340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:48.770706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8dd26-0884-47f3-95f5-1fe5269fe340 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:48.771073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8dd26-0884-47f3-95f5-1fe5269fe340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:48.771409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8dd26-0884-47f3-95f5-1fe5269fe340 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:48.772399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8dd26-0884-47f3-95f5-1fe5269fe340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:48.772779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8dd26-0884-47f3-95f5-1fe5269fe340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:48.774550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8dd26-0884-47f3-95f5-1fe5269fe340 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:48.792882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 885/1781] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:46:48.797517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873364b-5fab-4932-a6ef-cb472a5e3e53 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:48.813433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873364b-5fab-4932-a6ef-cb472a5e3e53 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:48.826706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ffc93-41a4-44bc-87f7-7408f25417a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:48.828610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ffc93-41a4-44bc-87f7-7408f25417a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:48.829056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ffc93-41a4-44bc-87f7-7408f25417a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:48.841987 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ffc93-41a4-44bc-87f7-7408f25417a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:48.843567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ffc93-41a4-44bc-87f7-7408f25417a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:48.849367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ffc93-41a4-44bc-87f7-7408f25417a1 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:48.895320 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 897/1782] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:48 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:48.899049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8dd26-0884-47f3-95f5-1fe5269fe340 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:48.911425 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8dd26-0884-47f3-95f5-1fe5269fe340 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:49.056262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc40a72-c433-414b-adab-96de035dd009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:49.059978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc40a72-c433-414b-adab-96de035dd009 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:49.059978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc40a72-c433-414b-adab-96de035dd009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:49.059978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc40a72-c433-414b-adab-96de035dd009 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:49.059978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc40a72-c433-414b-adab-96de035dd009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:49.062631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc40a72-c433-414b-adab-96de035dd009 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:49.100826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 886/1783] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:48 2022] POST /identity/v3/users => generated 283 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:49.108388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ffc93-41a4-44bc-87f7-7408f25417a1 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:49.123008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ffc93-41a4-44bc-87f7-7408f25417a1 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:49.132934 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6d158-9cc2-4088-a6fc-62654c0d7e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:49.133888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6d158-9cc2-4088-a6fc-62654c0d7e47 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:49.134370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6d158-9cc2-4088-a6fc-62654c0d7e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:49.134667 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6d158-9cc2-4088-a6fc-62654c0d7e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:49.135574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6d158-9cc2-4088-a6fc-62654c0d7e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:49.137773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6d158-9cc2-4088-a6fc-62654c0d7e47 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:49.153291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 898/1784] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:46:49.157280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc40a72-c433-414b-adab-96de035dd009 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:49.180191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc40a72-c433-414b-adab-96de035dd009 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:49.193502 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb45d9-e346-46cd-900d-d42227eaecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:49.194419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb45d9-e346-46cd-900d-d42227eaecd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:49.194708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb45d9-e346-46cd-900d-d42227eaecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:49.194987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb45d9-e346-46cd-900d-d42227eaecd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:49.196023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb45d9-e346-46cd-900d-d42227eaecd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:49.197834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb45d9-e346-46cd-900d-d42227eaecd1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:49.216027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 887/1785] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:46:49.219523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6d158-9cc2-4088-a6fc-62654c0d7e47 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:49.258808 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6d158-9cc2-4088-a6fc-62654c0d7e47 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:49.268048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314698d-224d-40da-b42a-cd653ef5973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:49.270055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314698d-224d-40da-b42a-cd653ef5973d admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:49.270649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314698d-224d-40da-b42a-cd653ef5973d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:49.271219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314698d-224d-40da-b42a-cd653ef5973d admin admin] PATH_INFO: `/v3/projects/cb0c02e18bf64577aaae9b4b851d025d/users/23b65c81b0944eed84ee61743da57ac7/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:49.307464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314698d-224d-40da-b42a-cd653ef5973d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0c02e18bf64577aaae9b4b851d025d, user_id=23b65c81b0944eed84ee61743da57ac7, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:49.312313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314698d-224d-40da-b42a-cd653ef5973d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:49.342530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 899/1786] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:49 2022] PUT /identity/v3/projects/cb0c02e18bf64577aaae9b4b851d025d/users/23b65c81b0944eed84ee61743da57ac7/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:46:49.356488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585443a-053c-4f66-a36d-56c15167d3c6 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:49.356861 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585443a-053c-4f66-a36d-56c15167d3c6 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:49.357399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585443a-053c-4f66-a36d-56c15167d3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:49.412351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-1585443a-053c-4f66-a36d-56c15167d3c6 None None] MFA Rules not processed for user `23b65c81b0944eed84ee61743da57ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:49.414773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1585443a-053c-4f66-a36d-56c15167d3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:49.538032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 888/1787] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:49.542873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314698d-224d-40da-b42a-cd653ef5973d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:49.636426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314698d-224d-40da-b42a-cd653ef5973d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:49.641940 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845d6f7-9a7e-4cba-872b-753eb8e75806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:49.642944 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845d6f7-9a7e-4cba-872b-753eb8e75806 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:49.643447 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845d6f7-9a7e-4cba-872b-753eb8e75806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:49.643921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5845d6f7-9a7e-4cba-872b-753eb8e75806 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:49.644869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845d6f7-9a7e-4cba-872b-753eb8e75806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:49.647104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5845d6f7-9a7e-4cba-872b-753eb8e75806 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:49.694755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 900/1788] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:49 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:49.695636 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585443a-053c-4f66-a36d-56c15167d3c6 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:49.711179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585443a-053c-4f66-a36d-56c15167d3c6 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:49.784511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b65582-e984-46c9-a3e8-6f599ea9bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:49.785193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b65582-e984-46c9-a3e8-6f599ea9bb0a admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:49.785498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b65582-e984-46c9-a3e8-6f599ea9bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:49.785772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b65582-e984-46c9-a3e8-6f599ea9bb0a admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:49.786508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b65582-e984-46c9-a3e8-6f599ea9bb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:49.788480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b65582-e984-46c9-a3e8-6f599ea9bb0a admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:49.812733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 889/1789] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:49 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:46:49.817136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845d6f7-9a7e-4cba-872b-753eb8e75806 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:49.828266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5845d6f7-9a7e-4cba-872b-753eb8e75806 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:49.838098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e90e7-2e23-43a3-8074-6b78fc698309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:49.846362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e90e7-2e23-43a3-8074-6b78fc698309 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:49.846362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e90e7-2e23-43a3-8074-6b78fc698309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:49.846362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e90e7-2e23-43a3-8074-6b78fc698309 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:49.846362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e90e7-2e23-43a3-8074-6b78fc698309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:49.846362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e90e7-2e23-43a3-8074-6b78fc698309 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:49.864996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 901/1790] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:49.869084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b65582-e984-46c9-a3e8-6f599ea9bb0a admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:49.880912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b65582-e984-46c9-a3e8-6f599ea9bb0a admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:49.885604 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cef9c0-7276-4bb8-85eb-b05480bc9b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:49.886915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef9c0-7276-4bb8-85eb-b05480bc9b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:49.887208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef9c0-7276-4bb8-85eb-b05480bc9b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:49.887479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cef9c0-7276-4bb8-85eb-b05480bc9b3f admin admin] PATH_INFO: `/v3/projects/639483e0e39744bb99492b1c00cefdeb/users/d1e423a4d0fe4d19a0f8311b8a6ba8b2/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:49.908996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cef9c0-7276-4bb8-85eb-b05480bc9b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=639483e0e39744bb99492b1c00cefdeb, user_id=d1e423a4d0fe4d19a0f8311b8a6ba8b2, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:49.911671 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cef9c0-7276-4bb8-85eb-b05480bc9b3f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:49.930689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 890/1791] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:49 2022] PUT /identity/v3/projects/639483e0e39744bb99492b1c00cefdeb/users/d1e423a4d0fe4d19a0f8311b8a6ba8b2/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:49.931897 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e90e7-2e23-43a3-8074-6b78fc698309 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:49.942569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e90e7-2e23-43a3-8074-6b78fc698309 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:50.018589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3848b-0868-430b-b4b2-5328a644c9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:50.019308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3848b-0868-430b-b4b2-5328a644c9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:50.019502 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3848b-0868-430b-b4b2-5328a644c9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:50.019772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3848b-0868-430b-b4b2-5328a644c9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:50.020500 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3848b-0868-430b-b4b2-5328a644c9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:50.022081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3848b-0868-430b-b4b2-5328a644c9a9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:50.033779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 902/1792] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:50.038569 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cef9c0-7276-4bb8-85eb-b05480bc9b3f admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:50.049407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cef9c0-7276-4bb8-85eb-b05480bc9b3f admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:50.055069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0d63f-b53c-4447-b781-d1e411814ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:50.056078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d63f-b53c-4447-b781-d1e411814ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:50.056364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d63f-b53c-4447-b781-d1e411814ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:50.056652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0d63f-b53c-4447-b781-d1e411814ea3 admin admin] PATH_INFO: `/v3/projects/639483e0e39744bb99492b1c00cefdeb/users/d1e423a4d0fe4d19a0f8311b8a6ba8b2/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:50.059734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0d63f-b53c-4447-b781-d1e411814ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=639483e0e39744bb99492b1c00cefdeb, user_id=d1e423a4d0fe4d19a0f8311b8a6ba8b2, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:50.063347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0d63f-b53c-4447-b781-d1e411814ea3 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:50.080753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 891/1793] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:50 2022] PUT /identity/v3/projects/639483e0e39744bb99492b1c00cefdeb/users/d1e423a4d0fe4d19a0f8311b8a6ba8b2/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:50.091132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72f46e-621d-4359-9ea8-64b5c9ca7622 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:50.091453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72f46e-621d-4359-9ea8-64b5c9ca7622 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:50.091735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72f46e-621d-4359-9ea8-64b5c9ca7622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:50.118476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4d72f46e-621d-4359-9ea8-64b5c9ca7622 None None] MFA Rules not processed for user `d1e423a4d0fe4d19a0f8311b8a6ba8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:50.119683 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4d72f46e-621d-4359-9ea8-64b5c9ca7622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:50.186791 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 903/1794] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:50.197573 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0d63f-b53c-4447-b781-d1e411814ea3 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:50.200179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-27b0d63f-b53c-4447-b781-d1e411814ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:50.228519 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72f46e-621d-4359-9ea8-64b5c9ca7622 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:50.230758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4d72f46e-621d-4359-9ea8-64b5c9ca7622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:50.261092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0d63f-b53c-4447-b781-d1e411814ea3 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:50.270136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7a612-16c4-4394-8d5c-cc105b7707b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:50.271325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7a612-16c4-4394-8d5c-cc105b7707b7 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:50.271796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7a612-16c4-4394-8d5c-cc105b7707b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:50.273033 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7a612-16c4-4394-8d5c-cc105b7707b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:50.285822 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7a612-16c4-4394-8d5c-cc105b7707b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:50.287725 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7a612-16c4-4394-8d5c-cc105b7707b7 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:50.301698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 892/1795] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:50 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:50.312354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72f46e-621d-4359-9ea8-64b5c9ca7622 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:50.317539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89fed8-b293-401a-91c1-935e2e41a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:50.318455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89fed8-b293-401a-91c1-935e2e41a779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:50.318744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89fed8-b293-401a-91c1-935e2e41a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:50.319153 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89fed8-b293-401a-91c1-935e2e41a779 admin admin] PATH_INFO: `/v3/users/9e1d8b4b41d0471c858c6beedff7881c` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:50.320370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89fed8-b293-401a-91c1-935e2e41a779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e1d8b4b41d0471c858c6beedff7881c)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:50.322331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89fed8-b293-401a-91c1-935e2e41a779 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:50.383249 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-bb89fed8-b293-401a-91c1-935e2e41a779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e1d8b4b41d0471c858c6beedff7881c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:50.396064 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7a612-16c4-4394-8d5c-cc105b7707b7 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:50.402357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-bb89fed8-b293-401a-91c1-935e2e41a779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e1d8b4b41d0471c858c6beedff7881c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:50.403159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-bb89fed8-b293-401a-91c1-935e2e41a779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e1d8b4b41d0471c858c6beedff7881c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:50.403928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-bb89fed8-b293-401a-91c1-935e2e41a779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e1d8b4b41d0471c858c6beedff7881c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:50.404994 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7a612-16c4-4394-8d5c-cc105b7707b7 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:50.408848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb758ee5-78c3-4e45-9f99-068da443f72a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:50.409489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb758ee5-78c3-4e45-9f99-068da443f72a service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:50.409771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb758ee5-78c3-4e45-9f99-068da443f72a service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:50.410056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb758ee5-78c3-4e45-9f99-068da443f72a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:50.411007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-bb89fed8-b293-401a-91c1-935e2e41a779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e1d8b4b41d0471c858c6beedff7881c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:50.411917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-bb758ee5-78c3-4e45-9f99-068da443f72a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:50.428535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 904/1796] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:46:50 2022] DELETE /identity/v3/users/9e1d8b4b41d0471c858c6beedff7881c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:46:50.434706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c7522-1e98-40b7-b718-1d2ff258a4cd None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:50.435029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c7522-1e98-40b7-b718-1d2ff258a4cd None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:50.435399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c7522-1e98-40b7-b718-1d2ff258a4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:50.454715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-893c7522-1e98-40b7-b718-1d2ff258a4cd None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:50.455910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-893c7522-1e98-40b7-b718-1d2ff258a4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:50.483641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb758ee5-78c3-4e45-9f99-068da443f72a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:50.485198 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb758ee5-78c3-4e45-9f99-068da443f72a service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:50.497802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 893/1797] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:46:50.548153 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 905/1798] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:50.555403 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb758ee5-78c3-4e45-9f99-068da443f72a service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:50.557589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-bb758ee5-78c3-4e45-9f99-068da443f72a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:50.686884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb758ee5-78c3-4e45-9f99-068da443f72a service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:50.743123 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba803c-0ef9-486e-814d-888417a13b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:50.743788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba803c-0ef9-486e-814d-888417a13b0e service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:50.744037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba803c-0ef9-486e-814d-888417a13b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:50.744315 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba803c-0ef9-486e-814d-888417a13b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:50.753489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba803c-0ef9-486e-814d-888417a13b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:50.754966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba803c-0ef9-486e-814d-888417a13b0e service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:50.764279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 894/1799] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:46:51.033073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c7522-1e98-40b7-b718-1d2ff258a4cd None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:51.034522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-893c7522-1e98-40b7-b718-1d2ff258a4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:51.046163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c7522-1e98-40b7-b718-1d2ff258a4cd None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:51.050732 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:51.051586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:51.051865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:51.052135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] PATH_INFO: `/v3/projects/b0c91bdeb3f74cd1b8ebd7c3dea20cd6` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:51.053314 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c91bdeb3f74cd1b8ebd7c3dea20cd6)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:51.055286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:51.102500 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c91bdeb3f74cd1b8ebd7c3dea20cd6', 'request_id': 'req-28998a46-f546-4b74-9af9-58f7b3ace761'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.109687 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c91bdeb3f74cd1b8ebd7c3dea20cd6', 'request_id': 'req-28998a46-f546-4b74-9af9-58f7b3ace761'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.117513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c91bdeb3f74cd1b8ebd7c3dea20cd6', 'request_id': 'req-28998a46-f546-4b74-9af9-58f7b3ace761'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.129122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] The token cache is being invalidate because project b0c91bdeb3f74cd1b8ebd7c3dea20cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:46:51.129383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.130045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.131642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 906/1800] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:46:51 2022] DELETE /identity/v3/projects/b0c91bdeb3f74cd1b8ebd7c3dea20cd6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:51.135677 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba803c-0ef9-486e-814d-888417a13b0e service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:51.145663 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba803c-0ef9-486e-814d-888417a13b0e service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:51.201271 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f19c3f-a5b5-488b-97ec-618ed1a4c85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:51.202146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f19c3f-a5b5-488b-97ec-618ed1a4c85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:51.202531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f19c3f-a5b5-488b-97ec-618ed1a4c85b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:51.202809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f19c3f-a5b5-488b-97ec-618ed1a4c85b admin admin] PATH_INFO: `/v3/users/3317a2e40d774bf38463e6a35a4cb082` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:51.204022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f19c3f-a5b5-488b-97ec-618ed1a4c85b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3317a2e40d774bf38463e6a35a4cb082)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:51.205937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f19c3f-a5b5-488b-97ec-618ed1a4c85b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:51.253059 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d7f19c3f-a5b5-488b-97ec-618ed1a4c85b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3317a2e40d774bf38463e6a35a4cb082'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.264581 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d7f19c3f-a5b5-488b-97ec-618ed1a4c85b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3317a2e40d774bf38463e6a35a4cb082'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.265250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d7f19c3f-a5b5-488b-97ec-618ed1a4c85b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3317a2e40d774bf38463e6a35a4cb082'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.265845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d7f19c3f-a5b5-488b-97ec-618ed1a4c85b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3317a2e40d774bf38463e6a35a4cb082'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.272425 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d7f19c3f-a5b5-488b-97ec-618ed1a4c85b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3317a2e40d774bf38463e6a35a4cb082'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.285171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 895/1801] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:46:51 2022] DELETE /identity/v3/users/3317a2e40d774bf38463e6a35a4cb082 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:51.548428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:51.550050 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:51.563538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28998a46-f546-4b74-9af9-58f7b3ace761 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:51.621881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:51.622782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:51.623066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:51.623342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] PATH_INFO: `/v3/projects/9935a9d0641a4204a830d39c664a63a9` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:51.624536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9935a9d0641a4204a830d39c664a63a9)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:51.626468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:51.672478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9935a9d0641a4204a830d39c664a63a9', 'request_id': 'req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.678379 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9935a9d0641a4204a830d39c664a63a9', 'request_id': 'req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.685891 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9935a9d0641a4204a830d39c664a63a9', 'request_id': 'req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.696371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] The token cache is being invalidate because project 9935a9d0641a4204a830d39c664a63a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:46:51.696802 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.697449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c11909f6-a3f6-4da3-b97b-1f7abad8bd42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:46:51.699034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 907/1802] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:46:51 2022] DELETE /identity/v3/projects/9935a9d0641a4204a830d39c664a63a9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:51.703871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608566b9-8bb2-4161-90c8-b5805ef3ac11 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:51.704169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608566b9-8bb2-4161-90c8-b5805ef3ac11 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:51.704449 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608566b9-8bb2-4161-90c8-b5805ef3ac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:51.722759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-608566b9-8bb2-4161-90c8-b5805ef3ac11 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:51.723806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-608566b9-8bb2-4161-90c8-b5805ef3ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:51.782817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 896/1803] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:51.790528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003ee46-d90a-4b95-8036-0a39bca8cf21 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:51.791010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003ee46-d90a-4b95-8036-0a39bca8cf21 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:51.791291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003ee46-d90a-4b95-8036-0a39bca8cf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:51.810829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c003ee46-d90a-4b95-8036-0a39bca8cf21 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:51.812032 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c003ee46-d90a-4b95-8036-0a39bca8cf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:51.820098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 908/1804] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:51.824409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608566b9-8bb2-4161-90c8-b5805ef3ac11 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:51.834715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608566b9-8bb2-4161-90c8-b5805ef3ac11 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:51.844071 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00dbb-ed9a-4641-99a8-009a1029cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:51.844756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00dbb-ed9a-4641-99a8-009a1029cc1e admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:51.845098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00dbb-ed9a-4641-99a8-009a1029cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:51.845383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00dbb-ed9a-4641-99a8-009a1029cc1e admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:51.846125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00dbb-ed9a-4641-99a8-009a1029cc1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:46:51.846465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00dbb-ed9a-4641-99a8-009a1029cc1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:51.848076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00dbb-ed9a-4641-99a8-009a1029cc1e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:51.864060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 897/1805] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:46:51.865448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003ee46-d90a-4b95-8036-0a39bca8cf21 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:51.875841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003ee46-d90a-4b95-8036-0a39bca8cf21 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:51.880603 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45562d92-3806-4074-a781-841455c38448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:51.881268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562d92-3806-4074-a781-841455c38448 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:51.881552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562d92-3806-4074-a781-841455c38448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:51.881831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562d92-3806-4074-a781-841455c38448 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:51.882557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45562d92-3806-4074-a781-841455c38448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:51.884481 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45562d92-3806-4074-a781-841455c38448 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:51.909779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 909/1806] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:51 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:51.913956 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00dbb-ed9a-4641-99a8-009a1029cc1e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:51.924851 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00dbb-ed9a-4641-99a8-009a1029cc1e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:51.980979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cb69a-cfca-4f69-9a8e-95b4be53e51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:51.981645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cb69a-cfca-4f69-9a8e-95b4be53e51f admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:51.981931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cb69a-cfca-4f69-9a8e-95b4be53e51f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:51.982212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cb69a-cfca-4f69-9a8e-95b4be53e51f admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:51.982944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cb69a-cfca-4f69-9a8e-95b4be53e51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:51.984871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cb69a-cfca-4f69-9a8e-95b4be53e51f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:52.004023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 898/1807] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:51 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:52.008278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45562d92-3806-4074-a781-841455c38448 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:52.018819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45562d92-3806-4074-a781-841455c38448 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:52.023426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b82cd-2442-4055-bf93-d541a00538f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:52.024092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b82cd-2442-4055-bf93-d541a00538f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:52.024404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b82cd-2442-4055-bf93-d541a00538f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:52.024681 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b82cd-2442-4055-bf93-d541a00538f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:52.025568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b82cd-2442-4055-bf93-d541a00538f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:52.027708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b82cd-2442-4055-bf93-d541a00538f5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:52.042988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 910/1808] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:46:52.044419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cb69a-cfca-4f69-9a8e-95b4be53e51f admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:52.054290 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cb69a-cfca-4f69-9a8e-95b4be53e51f admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:52.059877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8b4a6-db25-40cd-8896-44de54d47b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:52.060776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b4a6-db25-40cd-8896-44de54d47b9e admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:52.060994 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b4a6-db25-40cd-8896-44de54d47b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:52.061288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8b4a6-db25-40cd-8896-44de54d47b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:52.062023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b4a6-db25-40cd-8896-44de54d47b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:52.064033 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8b4a6-db25-40cd-8896-44de54d47b9e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:52.074270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 899/1809] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:46:52.078566 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b82cd-2442-4055-bf93-d541a00538f5 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:52.088205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b82cd-2442-4055-bf93-d541a00538f5 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:52.093714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d975fc-199d-47d5-b7bf-a075e3969e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:52.094628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d975fc-199d-47d5-b7bf-a075e3969e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:52.094906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d975fc-199d-47d5-b7bf-a075e3969e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:52.095175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d975fc-199d-47d5-b7bf-a075e3969e40 admin admin] PATH_INFO: `/v3/projects/47742f80985b4ffa9c0c074a1822e3a2/users/5bb8b51cb61b40338f89fec03752bb61/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:52.112362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d975fc-199d-47d5-b7bf-a075e3969e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47742f80985b4ffa9c0c074a1822e3a2, user_id=5bb8b51cb61b40338f89fec03752bb61, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:52.115084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d975fc-199d-47d5-b7bf-a075e3969e40 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:52.128475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 911/1810] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:52 2022] PUT /identity/v3/projects/47742f80985b4ffa9c0c074a1822e3a2/users/5bb8b51cb61b40338f89fec03752bb61/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:46:52.139115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9148ae6-dfcf-4a1e-8760-65e5feb40a61 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:52.139472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9148ae6-dfcf-4a1e-8760-65e5feb40a61 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:52.139815 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9148ae6-dfcf-4a1e-8760-65e5feb40a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:52.166448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e9148ae6-dfcf-4a1e-8760-65e5feb40a61 None None] MFA Rules not processed for user `5bb8b51cb61b40338f89fec03752bb61`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:52.167708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e9148ae6-dfcf-4a1e-8760-65e5feb40a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:52.228459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 900/1811] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:52.233248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d975fc-199d-47d5-b7bf-a075e3969e40 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:52.293458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d975fc-199d-47d5-b7bf-a075e3969e40 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:52.297923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681627e-6381-4c46-be8e-19f3babc9cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:52.298789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681627e-6381-4c46-be8e-19f3babc9cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:52.299078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681627e-6381-4c46-be8e-19f3babc9cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:52.299349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681627e-6381-4c46-be8e-19f3babc9cc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:52.300038 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681627e-6381-4c46-be8e-19f3babc9cc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:52.301923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681627e-6381-4c46-be8e-19f3babc9cc3 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:52.328965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 912/1812] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:46:52 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:52.333210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9148ae6-dfcf-4a1e-8760-65e5feb40a61 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:52.343859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9148ae6-dfcf-4a1e-8760-65e5feb40a61 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:52.400296 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40694db9-a015-4d0f-b1d7-6c2d57f237ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:52.401029 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40694db9-a015-4d0f-b1d7-6c2d57f237ef admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:52.401316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40694db9-a015-4d0f-b1d7-6c2d57f237ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:52.401794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40694db9-a015-4d0f-b1d7-6c2d57f237ef admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:52.402627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40694db9-a015-4d0f-b1d7-6c2d57f237ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:52.404556 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40694db9-a015-4d0f-b1d7-6c2d57f237ef admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:52.424016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 901/1813] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:46:52 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:46:52.428359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681627e-6381-4c46-be8e-19f3babc9cc3 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:52.439462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681627e-6381-4c46-be8e-19f3babc9cc3 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:52.444083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a764b1e-713f-4cba-941c-41b5e1ab640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:52.444786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764b1e-713f-4cba-941c-41b5e1ab640c admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:52.445022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764b1e-713f-4cba-941c-41b5e1ab640c admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:52.445299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a764b1e-713f-4cba-941c-41b5e1ab640c admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:52.446027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a764b1e-713f-4cba-941c-41b5e1ab640c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:52.447648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a764b1e-713f-4cba-941c-41b5e1ab640c admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:52.458722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 913/1814] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:46:52.463073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40694db9-a015-4d0f-b1d7-6c2d57f237ef admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:52.473136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40694db9-a015-4d0f-b1d7-6c2d57f237ef admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:52.477875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0634c-eb75-4c16-8429-e1ae417c7081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:52.479083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0634c-eb75-4c16-8429-e1ae417c7081 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:52.479359 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0634c-eb75-4c16-8429-e1ae417c7081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:52.480181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0634c-eb75-4c16-8429-e1ae417c7081 admin admin] PATH_INFO: `/v3/projects/4884499f2da2476fa5ac6564b6d8a059/users/0b8e604b0b854f67b3851be68149c074/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:52.496053 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0634c-eb75-4c16-8429-e1ae417c7081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4884499f2da2476fa5ac6564b6d8a059, user_id=0b8e604b0b854f67b3851be68149c074, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:52.498975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0634c-eb75-4c16-8429-e1ae417c7081 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:52.513244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 902/1815] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:52 2022] PUT /identity/v3/projects/4884499f2da2476fa5ac6564b6d8a059/users/0b8e604b0b854f67b3851be68149c074/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:52.517322 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a764b1e-713f-4cba-941c-41b5e1ab640c admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:52.527289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a764b1e-713f-4cba-941c-41b5e1ab640c admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:52.590448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e20bc-759e-4822-8718-670c2d97cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:52.591117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e20bc-759e-4822-8718-670c2d97cec8 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:52.591404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e20bc-759e-4822-8718-670c2d97cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:52.591780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e20bc-759e-4822-8718-670c2d97cec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:52.592608 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e20bc-759e-4822-8718-670c2d97cec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:52.594603 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e20bc-759e-4822-8718-670c2d97cec8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:52.604765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 914/1816] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:46:52.609356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0634c-eb75-4c16-8429-e1ae417c7081 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:52.620278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0634c-eb75-4c16-8429-e1ae417c7081 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:52.625984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773368a-fe4b-403d-9509-92abee0a88a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:52.626902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773368a-fe4b-403d-9509-92abee0a88a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:52.627183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773368a-fe4b-403d-9509-92abee0a88a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:52.627509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773368a-fe4b-403d-9509-92abee0a88a8 admin admin] PATH_INFO: `/v3/projects/4884499f2da2476fa5ac6564b6d8a059/users/0b8e604b0b854f67b3851be68149c074/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:52.629513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773368a-fe4b-403d-9509-92abee0a88a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4884499f2da2476fa5ac6564b6d8a059, user_id=0b8e604b0b854f67b3851be68149c074, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:52.632207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773368a-fe4b-403d-9509-92abee0a88a8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:52.642858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 903/1817] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:46:52 2022] PUT /identity/v3/projects/4884499f2da2476fa5ac6564b6d8a059/users/0b8e604b0b854f67b3851be68149c074/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:46:52.654180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4312a51-aa04-49dc-9dd0-4474447c5e5a None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:52.654524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4312a51-aa04-49dc-9dd0-4474447c5e5a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:52.654799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4312a51-aa04-49dc-9dd0-4474447c5e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:52.680893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f4312a51-aa04-49dc-9dd0-4474447c5e5a None None] MFA Rules not processed for user `0b8e604b0b854f67b3851be68149c074`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:46:52.682083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f4312a51-aa04-49dc-9dd0-4474447c5e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:52.750788 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 915/1818] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:46:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:46:56.155009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773368a-fe4b-403d-9509-92abee0a88a8 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:46:56.156692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1773368a-fe4b-403d-9509-92abee0a88a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:56.214845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773368a-fe4b-403d-9509-92abee0a88a8 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:46:56.218656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06725742-86fe-4a83-be53-3f59a1ed95bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:46:56.219306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06725742-86fe-4a83-be53-3f59a1ed95bf service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:46:56.219625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06725742-86fe-4a83-be53-3f59a1ed95bf service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:46:56.219901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06725742-86fe-4a83-be53-3f59a1ed95bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:46:56.221715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-06725742-86fe-4a83-be53-3f59a1ed95bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:46:56.290555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06725742-86fe-4a83-be53-3f59a1ed95bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:46:56.293506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06725742-86fe-4a83-be53-3f59a1ed95bf service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:46:56.305713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 904/1819] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:46:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:07.974281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4312a51-aa04-49dc-9dd0-4474447c5e5a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:07.975810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f4312a51-aa04-49dc-9dd0-4474447c5e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:07.989017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4312a51-aa04-49dc-9dd0-4474447c5e5a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:07.992734 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f629acc-8335-416d-a0f9-569bd3dae287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:07.993382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629acc-8335-416d-a0f9-569bd3dae287 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:07.993661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629acc-8335-416d-a0f9-569bd3dae287 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:07.993936 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629acc-8335-416d-a0f9-569bd3dae287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:08.004237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f629acc-8335-416d-a0f9-569bd3dae287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:08.005597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f629acc-8335-416d-a0f9-569bd3dae287 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:08.015749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 916/1820] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:08.031282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06725742-86fe-4a83-be53-3f59a1ed95bf service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:08.032771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-06725742-86fe-4a83-be53-3f59a1ed95bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:08.111708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06725742-86fe-4a83-be53-3f59a1ed95bf service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:08.116915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:08.117896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:08.118288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:08.118801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] PATH_INFO: `/v3/users/9a2c656a03d24fc4bb86fe958ac6c53e` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:08.120285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2c656a03d24fc4bb86fe958ac6c53e)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:08.122278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:08.187122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2c656a03d24fc4bb86fe958ac6c53e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.199348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2c656a03d24fc4bb86fe958ac6c53e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.200063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2c656a03d24fc4bb86fe958ac6c53e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.200671 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2c656a03d24fc4bb86fe958ac6c53e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.207568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2c656a03d24fc4bb86fe958ac6c53e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.223027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 905/1821] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:08 2022] DELETE /identity/v3/users/9a2c656a03d24fc4bb86fe958ac6c53e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:08.228323 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb16e-0cf3-4b55-92e4-e1495af5f98e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:08.229120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb16e-0cf3-4b55-92e4-e1495af5f98e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:08.232166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcb16e-0cf3-4b55-92e4-e1495af5f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:08.259192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-cddcb16e-0cf3-4b55-92e4-e1495af5f98e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:08.260964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-cddcb16e-0cf3-4b55-92e4-e1495af5f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:08.340146 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 917/1822] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:08.351228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:08.352832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:08.412868 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcb16e-0cf3-4b55-92e4-e1495af5f98e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:08.414342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-cddcb16e-0cf3-4b55-92e4-e1495af5f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:08.422164 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e3ffb-9825-46f6-9040-e0a317ae1935 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:08.426113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83684332-7ced-4273-81b5-8873ae39bf54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:08.426799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684332-7ced-4273-81b5-8873ae39bf54 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:08.427078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684332-7ced-4273-81b5-8873ae39bf54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:08.427352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83684332-7ced-4273-81b5-8873ae39bf54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:08.438669 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83684332-7ced-4273-81b5-8873ae39bf54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:08.440205 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83684332-7ced-4273-81b5-8873ae39bf54 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:08.452356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 906/1823] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:47:08.485580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddcb16e-0cf3-4b55-92e4-e1495af5f98e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:08.491518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd623-dc72-4acc-a5a8-de5ad134a66a tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8e604b0b854f67b3851be68149c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4884499f2da2476fa5ac6564b6d8a059', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:08.492642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd623-dc72-4acc-a5a8-de5ad134a66a tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:08.492935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd623-dc72-4acc-a5a8-de5ad134a66a tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:08.493206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebd623-dc72-4acc-a5a8-de5ad134a66a tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:08.493951 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebd623-dc72-4acc-a5a8-de5ad134a66a tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:08.494258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebd623-dc72-4acc-a5a8-de5ad134a66a tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:08.496923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebd623-dc72-4acc-a5a8-de5ad134a66a tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:08.517532 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 918/1824] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:47:08.519110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83684332-7ced-4273-81b5-8873ae39bf54 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:08.534232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83684332-7ced-4273-81b5-8873ae39bf54 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:08.539326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9284c-a440-414b-9d64-86b8bac5a358 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8e604b0b854f67b3851be68149c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4884499f2da2476fa5ac6564b6d8a059', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:08.540564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9284c-a440-414b-9d64-86b8bac5a358 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:08.540564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9284c-a440-414b-9d64-86b8bac5a358 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:08.540735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9284c-a440-414b-9d64-86b8bac5a358 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:08.541624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9284c-a440-414b-9d64-86b8bac5a358 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:08.543722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9284c-a440-414b-9d64-86b8bac5a358 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:08.576283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 907/1825] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:08 2022] POST /identity/v3/projects => generated 354 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:08.580224 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd623-dc72-4acc-a5a8-de5ad134a66a tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:08.592999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebd623-dc72-4acc-a5a8-de5ad134a66a tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:08.654937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc352-f6a7-478e-9d79-7da01da48be0 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8e604b0b854f67b3851be68149c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4884499f2da2476fa5ac6564b6d8a059', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:08.655720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc352-f6a7-478e-9d79-7da01da48be0 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:08.656008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc352-f6a7-478e-9d79-7da01da48be0 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:08.656288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccc352-f6a7-478e-9d79-7da01da48be0 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:08.657021 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccc352-f6a7-478e-9d79-7da01da48be0 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:08.657335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccc352-f6a7-478e-9d79-7da01da48be0 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:08.658962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccc352-f6a7-478e-9d79-7da01da48be0 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:08.671373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 919/1826] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:47:08.717034 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9284c-a440-414b-9d64-86b8bac5a358 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:08.733461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9284c-a440-414b-9d64-86b8bac5a358 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:08.739221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b8e604b0b854f67b3851be68149c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4884499f2da2476fa5ac6564b6d8a059', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:08.740210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:08.740646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:08.740926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] PATH_INFO: `/v3/projects/b3b0e38d342f46d986ad0f129e79dc39` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:08.742155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b3b0e38d342f46d986ad0f129e79dc39)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:08.746488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:08.748328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc352-f6a7-478e-9d79-7da01da48be0 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:08.750063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-59ccc352-f6a7-478e-9d79-7da01da48be0 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:08.794888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b0e38d342f46d986ad0f129e79dc39', 'request_id': 'req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.805369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b0e38d342f46d986ad0f129e79dc39', 'request_id': 'req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.812375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b0e38d342f46d986ad0f129e79dc39', 'request_id': 'req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.824868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] The token cache is being invalidate because project b3b0e38d342f46d986ad0f129e79dc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:08.825113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.825727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5106c6f7-c838-4cac-a7e4-fb10c3a5ba94 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.827620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 908/1827] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:08 2022] DELETE /identity/v3/projects/b3b0e38d342f46d986ad0f129e79dc39 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:08.833792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccc352-f6a7-478e-9d79-7da01da48be0 tempest-VolumeQuotaClassesTest-939748553 tempest-VolumeQuotaClassesTest-939748553-project-admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:08.898117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:08.899028 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:08.899319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:08.899609 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] PATH_INFO: `/v3/projects/ed6df23d01a0486facc3612d4b1ae15d` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:08.901038 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6df23d01a0486facc3612d4b1ae15d)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:08.903348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:08.951632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad300d68-0f53-40d0-9f8a-ce4c966de6b2 None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:08.951857 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad300d68-0f53-40d0-9f8a-ce4c966de6b2 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:08.952105 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad300d68-0f53-40d0-9f8a-ce4c966de6b2 None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:08.954064 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 909/1828] 10.222.0.61 () {54 vars in 921 bytes} [Sat May 14 15:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:47:08.958122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6df23d01a0486facc3612d4b1ae15d', 'request_id': 'req-76d77051-15f0-415b-b8ae-12ead72cdf26'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.963153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50d774-e311-4e88-ac61-ce18f70fa851 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:08.965550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50d774-e311-4e88-ac61-ce18f70fa851 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:08.967268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6df23d01a0486facc3612d4b1ae15d', 'request_id': 'req-76d77051-15f0-415b-b8ae-12ead72cdf26'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:08.967590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50d774-e311-4e88-ac61-ce18f70fa851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:08.983653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6df23d01a0486facc3612d4b1ae15d', 'request_id': 'req-76d77051-15f0-415b-b8ae-12ead72cdf26'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.009715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] The token cache is being invalidate because project ed6df23d01a0486facc3612d4b1ae15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:09.010006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.013007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.016489 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 920/1829] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:08 2022] DELETE /identity/v3/projects/ed6df23d01a0486facc3612d4b1ae15d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:09.020418 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:09.022303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:09.025430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-df50d774-e311-4e88-ac61-ce18f70fa851 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:09.027714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-df50d774-e311-4e88-ac61-ce18f70fa851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:09.143892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d77051-15f0-415b-b8ae-12ead72cdf26 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:09.150047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 910/1830] 10.222.0.61 () {58 vars in 1018 bytes} [Sat May 14 15:47:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:09.152317 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50d774-e311-4e88-ac61-ce18f70fa851 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:09.153971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-df50d774-e311-4e88-ac61-ce18f70fa851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:09.157515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:09.158453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:09.158745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:09.159027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] PATH_INFO: `/v3/users/33382051bb7f4647bbd4de727d06c022` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:09.160268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33382051bb7f4647bbd4de727d06c022)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:09.162375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:09.170592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50d774-e311-4e88-ac61-ce18f70fa851 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:09.176120 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7e290-41b3-4b32-a606-2270360f9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:09.177610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e290-41b3-4b32-a606-2270360f9a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:09.178077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e290-41b3-4b32-a606-2270360f9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:09.178721 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e290-41b3-4b32-a606-2270360f9a54 admin admin] PATH_INFO: `/v3/users/5bb8b51cb61b40338f89fec03752bb61` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:09.180217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7e290-41b3-4b32-a606-2270360f9a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bb8b51cb61b40338f89fec03752bb61)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:09.183045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7e290-41b3-4b32-a606-2270360f9a54 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:09.233174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33382051bb7f4647bbd4de727d06c022'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.250601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33382051bb7f4647bbd4de727d06c022'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.251881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33382051bb7f4647bbd4de727d06c022'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.252078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33382051bb7f4647bbd4de727d06c022'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.267794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33382051bb7f4647bbd4de727d06c022'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.267875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-35f7e290-41b3-4b32-a606-2270360f9a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bb8b51cb61b40338f89fec03752bb61'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.279159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 921/1831] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:09 2022] DELETE /identity/v3/users/33382051bb7f4647bbd4de727d06c022 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:09.280394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:09.282007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:09.306470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-35f7e290-41b3-4b32-a606-2270360f9a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bb8b51cb61b40338f89fec03752bb61'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.309209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-35f7e290-41b3-4b32-a606-2270360f9a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bb8b51cb61b40338f89fec03752bb61'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.309738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-35f7e290-41b3-4b32-a606-2270360f9a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bb8b51cb61b40338f89fec03752bb61'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.321324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-35f7e290-41b3-4b32-a606-2270360f9a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bb8b51cb61b40338f89fec03752bb61'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:09.343421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 911/1832] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:09 2022] DELETE /identity/v3/users/5bb8b51cb61b40338f89fec03752bb61 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:09.346738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd3e3-2326-4eca-92b2-8291ef3efb62 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:09.347313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd3e3-2326-4eca-92b2-8291ef3efb62 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:09.347765 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd3e3-2326-4eca-92b2-8291ef3efb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:09.372752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-df5dd3e3-2326-4eca-92b2-8291ef3efb62 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:09.375973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-df5dd3e3-2326-4eca-92b2-8291ef3efb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:09.380106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c3931-c690-4a4f-820f-097a94b139f8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:09.501884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 912/1833] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:09.509172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f6cbd-657c-4630-83c2-2ab30544f342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:09.510551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f6cbd-657c-4630-83c2-2ab30544f342 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:09.511114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f6cbd-657c-4630-83c2-2ab30544f342 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:09.511541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f6cbd-657c-4630-83c2-2ab30544f342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:09.512925 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd3e3-2326-4eca-92b2-8291ef3efb62 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:09.514200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-051f6cbd-657c-4630-83c2-2ab30544f342 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:09.514933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-df5dd3e3-2326-4eca-92b2-8291ef3efb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:09.543778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f6cbd-657c-4630-83c2-2ab30544f342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:09.546345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f6cbd-657c-4630-83c2-2ab30544f342 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:09.561758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 922/1834] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:09.591570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd3e3-2326-4eca-92b2-8291ef3efb62 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:09.596155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbe544-844c-40c6-9ecf-2342fc7d58d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:09.598888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe544-844c-40c6-9ecf-2342fc7d58d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:09.599251 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe544-844c-40c6-9ecf-2342fc7d58d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:09.599772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe544-844c-40c6-9ecf-2342fc7d58d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:09.611833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbe544-844c-40c6-9ecf-2342fc7d58d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:09.613574 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbe544-844c-40c6-9ecf-2342fc7d58d5 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:09.631203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 913/1835] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:47:09.949804 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f6cbd-657c-4630-83c2-2ab30544f342 service nova] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:09.951544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-051f6cbd-657c-4630-83c2-2ab30544f342 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:09.971397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f6cbd-657c-4630-83c2-2ab30544f342 service nova] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:09.976524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:09.977391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:09.977667 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:09.977937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] PATH_INFO: `/v3/projects/1a2173e16b7040b1a80fdcda77dea2f0` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:09.981157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2173e16b7040b1a80fdcda77dea2f0)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:09.983119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:10.032570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2173e16b7040b1a80fdcda77dea2f0', 'request_id': 'req-a82736f6-f9ed-4ac6-934a-a397e0f93816'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:10.039028 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2173e16b7040b1a80fdcda77dea2f0', 'request_id': 'req-a82736f6-f9ed-4ac6-934a-a397e0f93816'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:10.048326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2173e16b7040b1a80fdcda77dea2f0', 'request_id': 'req-a82736f6-f9ed-4ac6-934a-a397e0f93816'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:10.061707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] The token cache is being invalidate because project 1a2173e16b7040b1a80fdcda77dea2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:10.062168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:10.066830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:10.068809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 923/1836] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:09 2022] DELETE /identity/v3/projects/1a2173e16b7040b1a80fdcda77dea2f0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:10.074031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbe544-844c-40c6-9ecf-2342fc7d58d5 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:10.086523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbe544-844c-40c6-9ecf-2342fc7d58d5 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:10.153631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:10.154611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:10.154877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:10.155149 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] PATH_INFO: `/v3/users/09dd9d4317c14a54b9982accb2ee0f8d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:10.156344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09dd9d4317c14a54b9982accb2ee0f8d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:10.159053 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:10.206207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09dd9d4317c14a54b9982accb2ee0f8d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:10.219817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09dd9d4317c14a54b9982accb2ee0f8d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:10.220591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09dd9d4317c14a54b9982accb2ee0f8d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:10.221226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09dd9d4317c14a54b9982accb2ee0f8d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:10.228020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09dd9d4317c14a54b9982accb2ee0f8d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:10.244048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 914/1837] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:10 2022] DELETE /identity/v3/users/09dd9d4317c14a54b9982accb2ee0f8d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:10.764470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:10.765968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:10.778905 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82736f6-f9ed-4ac6-934a-a397e0f93816 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:10.815778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:10.817815 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:10.880357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:10.884472 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:10.885001 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:10.886557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] PATH_INFO: `/v3/projects/47742f80985b4ffa9c0c074a1822e3a2` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:10.888286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47742f80985b4ffa9c0c074a1822e3a2)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:10.891598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:10.977678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a891f07-7c78-408a-88e9-bb4e8e276db8 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:11.007444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47742f80985b4ffa9c0c074a1822e3a2', 'request_id': 'req-9c34789e-e329-46d8-9745-17f6c29d27a0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.015679 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47742f80985b4ffa9c0c074a1822e3a2', 'request_id': 'req-9c34789e-e329-46d8-9745-17f6c29d27a0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.027537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47742f80985b4ffa9c0c074a1822e3a2', 'request_id': 'req-9c34789e-e329-46d8-9745-17f6c29d27a0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.039849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] The token cache is being invalidate because project 47742f80985b4ffa9c0c074a1822e3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:11.041531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.042990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.048262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 924/1838] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:10 2022] DELETE /identity/v3/projects/47742f80985b4ffa9c0c074a1822e3a2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:11.049454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:11.051256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:11.107270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:11.108149 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.108433 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.108706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] PATH_INFO: `/v3/projects/e4dea3cdf67d434991e9b57d4f53c6ff` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.110704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4dea3cdf67d434991e9b57d4f53c6ff)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:11.113776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:11.146027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34789e-e329-46d8-9745-17f6c29d27a0 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:11.158368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee038-22cd-4a70-bb7d-4712a3f3546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:11.159654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee038-22cd-4a70-bb7d-4712a3f3546f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.159943 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee038-22cd-4a70-bb7d-4712a3f3546f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.160221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee038-22cd-4a70-bb7d-4712a3f3546f admin admin] PATH_INFO: `/v3/users/0b8e604b0b854f67b3851be68149c074` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.162826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee038-22cd-4a70-bb7d-4712a3f3546f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b8e604b0b854f67b3851be68149c074)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:11.169550 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee038-22cd-4a70-bb7d-4712a3f3546f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:11.185583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4dea3cdf67d434991e9b57d4f53c6ff', 'request_id': 'req-c1c681a1-bf1d-4181-80b4-db7559c98c36'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.195261 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4dea3cdf67d434991e9b57d4f53c6ff', 'request_id': 'req-c1c681a1-bf1d-4181-80b4-db7559c98c36'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.210546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4dea3cdf67d434991e9b57d4f53c6ff', 'request_id': 'req-c1c681a1-bf1d-4181-80b4-db7559c98c36'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.227079 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] The token cache is being invalidate because project e4dea3cdf67d434991e9b57d4f53c6ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:11.227309 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.227966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c1c681a1-bf1d-4181-80b4-db7559c98c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.236310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 915/1839] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:10 2022] DELETE /identity/v3/projects/e4dea3cdf67d434991e9b57d4f53c6ff => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:11.238065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c787da-c11e-4937-a252-0cf1df0f1398 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.238374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c787da-c11e-4937-a252-0cf1df0f1398 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.238655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c787da-c11e-4937-a252-0cf1df0f1398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.243267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a0cee038-22cd-4a70-bb7d-4712a3f3546f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b8e604b0b854f67b3851be68149c074'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.259451 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a0cee038-22cd-4a70-bb7d-4712a3f3546f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b8e604b0b854f67b3851be68149c074'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.259601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-57c787da-c11e-4937-a252-0cf1df0f1398 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:11.261522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-57c787da-c11e-4937-a252-0cf1df0f1398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:11.262070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a0cee038-22cd-4a70-bb7d-4712a3f3546f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b8e604b0b854f67b3851be68149c074'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.263188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a0cee038-22cd-4a70-bb7d-4712a3f3546f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b8e604b0b854f67b3851be68149c074'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.271952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a0cee038-22cd-4a70-bb7d-4712a3f3546f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b8e604b0b854f67b3851be68149c074'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.299544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 925/1840] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:11 2022] DELETE /identity/v3/users/0b8e604b0b854f67b3851be68149c074 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:11.350473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 916/1841] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:11.360637 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd6216-4a6e-4c27-a4b4-e8ba61573a66 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.361725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd6216-4a6e-4c27-a4b4-e8ba61573a66 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.362011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd6216-4a6e-4c27-a4b4-e8ba61573a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.387280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7ddd6216-4a6e-4c27-a4b4-e8ba61573a66 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:11.388486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7ddd6216-4a6e-4c27-a4b4-e8ba61573a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:11.454074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 926/1842] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:11.458608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c787da-c11e-4937-a252-0cf1df0f1398 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:11.469891 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c787da-c11e-4937-a252-0cf1df0f1398 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:11.475325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd441809-602f-460a-9bd2-c0bdd21ce513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:11.476241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd441809-602f-460a-9bd2-c0bdd21ce513 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.476594 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd441809-602f-460a-9bd2-c0bdd21ce513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.476937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd441809-602f-460a-9bd2-c0bdd21ce513 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.477758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd441809-602f-460a-9bd2-c0bdd21ce513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:11.478067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd441809-602f-460a-9bd2-c0bdd21ce513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:11.479791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd441809-602f-460a-9bd2-c0bdd21ce513 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:11.491878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 917/1843] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:47:11.497074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd6216-4a6e-4c27-a4b4-e8ba61573a66 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:11.506019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd6216-4a6e-4c27-a4b4-e8ba61573a66 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:11.511354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a173ab-e64c-49cb-bff3-16e6cda5f614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:11.512010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a173ab-e64c-49cb-bff3-16e6cda5f614 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.512294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a173ab-e64c-49cb-bff3-16e6cda5f614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.512571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a173ab-e64c-49cb-bff3-16e6cda5f614 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.513270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a173ab-e64c-49cb-bff3-16e6cda5f614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:11.515214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a173ab-e64c-49cb-bff3-16e6cda5f614 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:11.541843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 927/1844] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:11 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:11.546024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd441809-602f-460a-9bd2-c0bdd21ce513 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:11.556334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd441809-602f-460a-9bd2-c0bdd21ce513 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:11.634758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9a1a1-07ae-469d-83ce-07851edceb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:11.635568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9a1a1-07ae-469d-83ce-07851edceb43 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.636294 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9a1a1-07ae-469d-83ce-07851edceb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.636294 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9a1a1-07ae-469d-83ce-07851edceb43 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.637055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9a1a1-07ae-469d-83ce-07851edceb43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:11.639376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9a1a1-07ae-469d-83ce-07851edceb43 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:11.659082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a173ab-e64c-49cb-bff3-16e6cda5f614 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:11.661045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-40a173ab-e64c-49cb-bff3-16e6cda5f614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:11.668112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 918/1845] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:11 2022] POST /identity/v3/users => generated 280 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:11.671886 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9a1a1-07ae-469d-83ce-07851edceb43 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:11.678618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a173ab-e64c-49cb-bff3-16e6cda5f614 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:11.685329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9a1a1-07ae-469d-83ce-07851edceb43 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:11.685863 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:11.686900 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.687220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.687502 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] PATH_INFO: `/v3/projects/4884499f2da2476fa5ac6564b6d8a059` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.688781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4884499f2da2476fa5ac6564b6d8a059)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:11.690741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:11.692320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad3ba0-2a0d-4849-9543-81fe6f01ca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:11.693399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad3ba0-2a0d-4849-9543-81fe6f01ca1c admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.694066 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad3ba0-2a0d-4849-9543-81fe6f01ca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.694675 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad3ba0-2a0d-4849-9543-81fe6f01ca1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.705416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad3ba0-2a0d-4849-9543-81fe6f01ca1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:11.707874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad3ba0-2a0d-4849-9543-81fe6f01ca1c admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:11.730831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 919/1846] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:11.732427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad3ba0-2a0d-4849-9543-81fe6f01ca1c admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:11.742406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad3ba0-2a0d-4849-9543-81fe6f01ca1c admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:11.758155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4884499f2da2476fa5ac6564b6d8a059', 'request_id': 'req-949cea86-1439-43b1-b0b3-94db98491147'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.767142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4884499f2da2476fa5ac6564b6d8a059', 'request_id': 'req-949cea86-1439-43b1-b0b3-94db98491147'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.775927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4884499f2da2476fa5ac6564b6d8a059', 'request_id': 'req-949cea86-1439-43b1-b0b3-94db98491147'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.787902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] The token cache is being invalidate because project 4884499f2da2476fa5ac6564b6d8a059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:11.788412 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.789173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-949cea86-1439-43b1-b0b3-94db98491147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:11.790854 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 928/1847] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:11 2022] DELETE /identity/v3/projects/4884499f2da2476fa5ac6564b6d8a059 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:11.797543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24959a-ccb3-45ad-beea-f6249eef33c7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.797879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24959a-ccb3-45ad-beea-f6249eef33c7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.798116 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24959a-ccb3-45ad-beea-f6249eef33c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.812762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7224658-eabd-4539-a35b-693b70adad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:11.813440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7224658-eabd-4539-a35b-693b70adad77 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.813723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7224658-eabd-4539-a35b-693b70adad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.814000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7224658-eabd-4539-a35b-693b70adad77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.815145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7224658-eabd-4539-a35b-693b70adad77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:11.816771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7224658-eabd-4539-a35b-693b70adad77 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:11.817614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-fe24959a-ccb3-45ad-beea-f6249eef33c7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:11.818877 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-fe24959a-ccb3-45ad-beea-f6249eef33c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:11.828481 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 929/1848] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:11.836211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc99b98-cbae-42de-a6d3-9d8f2ac07f1c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.836496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc99b98-cbae-42de-a6d3-9d8f2ac07f1c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.836771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc99b98-cbae-42de-a6d3-9d8f2ac07f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.842220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 920/1849] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:11.843617 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7224658-eabd-4539-a35b-693b70adad77 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:11.845311 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e7224658-eabd-4539-a35b-693b70adad77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:11.856215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-3bc99b98-cbae-42de-a6d3-9d8f2ac07f1c None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:11.857396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-3bc99b98-cbae-42de-a6d3-9d8f2ac07f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:11.858699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7224658-eabd-4539-a35b-693b70adad77 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:11.863625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8631b7f-5481-49fc-87cd-a34f18d9ae8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:11.864512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8631b7f-5481-49fc-87cd-a34f18d9ae8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.864796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8631b7f-5481-49fc-87cd-a34f18d9ae8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.865069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8631b7f-5481-49fc-87cd-a34f18d9ae8b admin admin] PATH_INFO: `/v3/projects/c5c9e193c6a94653881588243eda8e96/users/14f3d8507bf745dc95ff10c2d818ee0a/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.865687 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 930/1850] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:11.869508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc99b98-cbae-42de-a6d3-9d8f2ac07f1c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:11.878700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc99b98-cbae-42de-a6d3-9d8f2ac07f1c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:11.880688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8631b7f-5481-49fc-87cd-a34f18d9ae8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c9e193c6a94653881588243eda8e96, user_id=14f3d8507bf745dc95ff10c2d818ee0a, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:11.883277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d876087-281d-45ae-b1f8-4ac36fc4caf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:11.883419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8631b7f-5481-49fc-87cd-a34f18d9ae8b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:11.883915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d876087-281d-45ae-b1f8-4ac36fc4caf7 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.884939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d876087-281d-45ae-b1f8-4ac36fc4caf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.885936 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d876087-281d-45ae-b1f8-4ac36fc4caf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.887444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d876087-281d-45ae-b1f8-4ac36fc4caf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:11.887905 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d876087-281d-45ae-b1f8-4ac36fc4caf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:11.890215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d876087-281d-45ae-b1f8-4ac36fc4caf7 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:11.897379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 921/1851] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:11 2022] PUT /identity/v3/projects/c5c9e193c6a94653881588243eda8e96/users/14f3d8507bf745dc95ff10c2d818ee0a/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:11.902812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 931/1852] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:47:11.907550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8631b7f-5481-49fc-87cd-a34f18d9ae8b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:11.908666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7f5d2-3a61-40f7-abb6-73b453ea064a None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.908956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7f5d2-3a61-40f7-abb6-73b453ea064a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.909289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7f5d2-3a61-40f7-abb6-73b453ea064a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.936459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7cc7f5d2-3a61-40f7-abb6-73b453ea064a None None] MFA Rules not processed for user `14f3d8507bf745dc95ff10c2d818ee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:11.937652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7cc7f5d2-3a61-40f7-abb6-73b453ea064a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:11.968150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8631b7f-5481-49fc-87cd-a34f18d9ae8b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:11.972789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23218e8e-b26e-4792-bdfc-9621f382a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:11.973440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23218e8e-b26e-4792-bdfc-9621f382a772 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:11.973720 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23218e8e-b26e-4792-bdfc-9621f382a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:11.974608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23218e8e-b26e-4792-bdfc-9621f382a772 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:11.975335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23218e8e-b26e-4792-bdfc-9621f382a772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:11.977335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23218e8e-b26e-4792-bdfc-9621f382a772 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.001384 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 932/1853] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:11 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:12.006297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 922/1854] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:11 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:12.010185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7f5d2-3a61-40f7-abb6-73b453ea064a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.022529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7f5d2-3a61-40f7-abb6-73b453ea064a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.034096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23218e8e-b26e-4792-bdfc-9621f382a772 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.035909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-23218e8e-b26e-4792-bdfc-9621f382a772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:12.082245 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbe2c3-d7cd-4583-be75-0dc1e0bb5c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.082939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbe2c3-d7cd-4583-be75-0dc1e0bb5c8d admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.083250 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbe2c3-d7cd-4583-be75-0dc1e0bb5c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.083524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbe2c3-d7cd-4583-be75-0dc1e0bb5c8d admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.084228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbe2c3-d7cd-4583-be75-0dc1e0bb5c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.086144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbe2c3-d7cd-4583-be75-0dc1e0bb5c8d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.096178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23218e8e-b26e-4792-bdfc-9621f382a772 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.100087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787a2a-0fda-4734-875e-dbfcb7f2261a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.100818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787a2a-0fda-4734-875e-dbfcb7f2261a service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.101097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787a2a-0fda-4734-875e-dbfcb7f2261a service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.101374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787a2a-0fda-4734-875e-dbfcb7f2261a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.106880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 933/1855] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:12 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:12.111169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbe2c3-d7cd-4583-be75-0dc1e0bb5c8d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.121663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbe2c3-d7cd-4583-be75-0dc1e0bb5c8d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.126793 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcebbec-e6d0-461d-9c95-5a43c2c816be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.127530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcebbec-e6d0-461d-9c95-5a43c2c816be admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.127925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcebbec-e6d0-461d-9c95-5a43c2c816be admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.128209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcebbec-e6d0-461d-9c95-5a43c2c816be admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.129438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcebbec-e6d0-461d-9c95-5a43c2c816be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.132415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcebbec-e6d0-461d-9c95-5a43c2c816be admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.146467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 934/1856] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:47:12.150295 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcebbec-e6d0-461d-9c95-5a43c2c816be admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.159237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787a2a-0fda-4734-875e-dbfcb7f2261a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.159910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcebbec-e6d0-461d-9c95-5a43c2c816be admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.160741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787a2a-0fda-4734-875e-dbfcb7f2261a service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.164592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f2f14-df0b-46b9-93b3-7012ebf4216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.165329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f2f14-df0b-46b9-93b3-7012ebf4216b admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.165657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f2f14-df0b-46b9-93b3-7012ebf4216b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.165937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f2f14-df0b-46b9-93b3-7012ebf4216b admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.167350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f2f14-df0b-46b9-93b3-7012ebf4216b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.169474 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f2f14-df0b-46b9-93b3-7012ebf4216b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.170602 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 923/1857] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:12 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:47:12.184168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 935/1858] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:47:12.185481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787a2a-0fda-4734-875e-dbfcb7f2261a service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.185670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f2f14-df0b-46b9-93b3-7012ebf4216b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.195418 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f2f14-df0b-46b9-93b3-7012ebf4216b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.195751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787a2a-0fda-4734-875e-dbfcb7f2261a service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.200406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739a4c7-9767-400c-9d12-551d0ca072d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.200546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c1efb-adff-47d4-9cc4-cea13228ec89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.201282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a4c7-9767-400c-9d12-551d0ca072d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.201387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c1efb-adff-47d4-9cc4-cea13228ec89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.201560 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a4c7-9767-400c-9d12-551d0ca072d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.201674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c1efb-adff-47d4-9cc4-cea13228ec89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.201843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a4c7-9767-400c-9d12-551d0ca072d8 admin admin] PATH_INFO: `/v3/projects/b7ee0cfed60d41858eda0df54431e059/users/645587c08fcf4270bc0f6649db433cbb/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.201964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c1efb-adff-47d4-9cc4-cea13228ec89 admin admin] PATH_INFO: `/v3/users/14f3d8507bf745dc95ff10c2d818ee0a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.203115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c1efb-adff-47d4-9cc4-cea13228ec89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f3d8507bf745dc95ff10c2d818ee0a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.205048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c1efb-adff-47d4-9cc4-cea13228ec89 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.216608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739a4c7-9767-400c-9d12-551d0ca072d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ee0cfed60d41858eda0df54431e059, user_id=645587c08fcf4270bc0f6649db433cbb, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.219274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739a4c7-9767-400c-9d12-551d0ca072d8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.231844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 924/1859] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:12 2022] PUT /identity/v3/projects/b7ee0cfed60d41858eda0df54431e059/users/645587c08fcf4270bc0f6649db433cbb/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:12.243302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aea53-5548-44d0-934c-ae1ddd77f17e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.243532 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aea53-5548-44d0-934c-ae1ddd77f17e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.243820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aea53-5548-44d0-934c-ae1ddd77f17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.251319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6c3c1efb-adff-47d4-9cc4-cea13228ec89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f3d8507bf745dc95ff10c2d818ee0a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:12.263649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6c3c1efb-adff-47d4-9cc4-cea13228ec89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f3d8507bf745dc95ff10c2d818ee0a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:12.264342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6c3c1efb-adff-47d4-9cc4-cea13228ec89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f3d8507bf745dc95ff10c2d818ee0a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:12.264958 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6c3c1efb-adff-47d4-9cc4-cea13228ec89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f3d8507bf745dc95ff10c2d818ee0a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:12.271267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-d25aea53-5548-44d0-934c-ae1ddd77f17e None None] MFA Rules not processed for user `645587c08fcf4270bc0f6649db433cbb`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:12.272459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d25aea53-5548-44d0-934c-ae1ddd77f17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:12.275193 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6c3c1efb-adff-47d4-9cc4-cea13228ec89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f3d8507bf745dc95ff10c2d818ee0a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:12.291792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 936/1860] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:12 2022] DELETE /identity/v3/users/14f3d8507bf745dc95ff10c2d818ee0a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:12.300682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2a6cf-549c-408d-945e-28b7a5394c69 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.301169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2a6cf-549c-408d-945e-28b7a5394c69 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.301443 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2a6cf-549c-408d-945e-28b7a5394c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.332080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-59e2a6cf-549c-408d-945e-28b7a5394c69 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:12.333813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-59e2a6cf-549c-408d-945e-28b7a5394c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:12.365332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 925/1861] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:12.370504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aea53-5548-44d0-934c-ae1ddd77f17e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.372293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d25aea53-5548-44d0-934c-ae1ddd77f17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:12.422233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 937/1862] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:12.437964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2a6cf-549c-408d-945e-28b7a5394c69 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.444529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-59e2a6cf-549c-408d-945e-28b7a5394c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:12.470065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aea53-5548-44d0-934c-ae1ddd77f17e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.475399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5b60b-337e-451b-a9bd-d3f6c95d33e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.476427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5b60b-337e-451b-a9bd-d3f6c95d33e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.476930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5b60b-337e-451b-a9bd-d3f6c95d33e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.477286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5b60b-337e-451b-a9bd-d3f6c95d33e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.478594 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5b60b-337e-451b-a9bd-d3f6c95d33e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.488060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5b60b-337e-451b-a9bd-d3f6c95d33e4 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.528843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 926/1863] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:12 2022] POST /identity/v3/projects => generated 401 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:12.533070 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5b60b-337e-451b-a9bd-d3f6c95d33e4 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.565442 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2a6cf-549c-408d-945e-28b7a5394c69 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.606251 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5b60b-337e-451b-a9bd-d3f6c95d33e4 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.611528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e76fc5-edb1-40fb-86b2-45699db5bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.612276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e76fc5-edb1-40fb-86b2-45699db5bf92 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.612632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e76fc5-edb1-40fb-86b2-45699db5bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.612915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e76fc5-edb1-40fb-86b2-45699db5bf92 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.614060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e76fc5-edb1-40fb-86b2-45699db5bf92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.615588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e76fc5-edb1-40fb-86b2-45699db5bf92 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.626657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f64953-6e40-4c78-8311-8c4831adef14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.628083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64953-6e40-4c78-8311-8c4831adef14 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.628241 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64953-6e40-4c78-8311-8c4831adef14 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.628712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64953-6e40-4c78-8311-8c4831adef14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.641091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f64953-6e40-4c78-8311-8c4831adef14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.642351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 927/1864] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:12 2022] POST /identity/v3/users => generated 307 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:12.645574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f64953-6e40-4c78-8311-8c4831adef14 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.646013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e76fc5-edb1-40fb-86b2-45699db5bf92 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.655674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 938/1865] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:47:12.656061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e76fc5-edb1-40fb-86b2-45699db5bf92 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.660870 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc5f42-fd1d-426d-aec4-8ed806401922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.661533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc5f42-fd1d-426d-aec4-8ed806401922 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.661813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc5f42-fd1d-426d-aec4-8ed806401922 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.662088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc5f42-fd1d-426d-aec4-8ed806401922 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.662951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc5f42-fd1d-426d-aec4-8ed806401922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.664790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc5f42-fd1d-426d-aec4-8ed806401922 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.675798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 928/1866] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:12.679808 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f64953-6e40-4c78-8311-8c4831adef14 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.689590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f64953-6e40-4c78-8311-8c4831adef14 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.694879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bede7-00ae-4ead-b0d7-ed673fa1543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.695752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bede7-00ae-4ead-b0d7-ed673fa1543d admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.696029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bede7-00ae-4ead-b0d7-ed673fa1543d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.696303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bede7-00ae-4ead-b0d7-ed673fa1543d admin admin] PATH_INFO: `/v3/projects/26b3303be1b246b399d18a1da032e748/users/a1de4b34c2654932b46c453b8563ddd5/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.712846 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bede7-00ae-4ead-b0d7-ed673fa1543d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b3303be1b246b399d18a1da032e748, user_id=a1de4b34c2654932b46c453b8563ddd5, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.716247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715bede7-00ae-4ead-b0d7-ed673fa1543d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.740041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 939/1867] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:12 2022] PUT /identity/v3/projects/26b3303be1b246b399d18a1da032e748/users/a1de4b34c2654932b46c453b8563ddd5/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:12.741881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc5f42-fd1d-426d-aec4-8ed806401922 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.755884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc5f42-fd1d-426d-aec4-8ed806401922 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.838102 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc8116-d206-4cdf-bd27-8db87f24647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.839477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8116-d206-4cdf-bd27-8db87f24647b admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.840021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8116-d206-4cdf-bd27-8db87f24647b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.840131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8116-d206-4cdf-bd27-8db87f24647b admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.841594 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc8116-d206-4cdf-bd27-8db87f24647b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.843397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc8116-d206-4cdf-bd27-8db87f24647b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.859070 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 929/1868] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:12.860222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bede7-00ae-4ead-b0d7-ed673fa1543d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:12.871760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bede7-00ae-4ead-b0d7-ed673fa1543d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:12.876792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce182c-cd3d-4630-a386-2013619b7769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:12.877318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce182c-cd3d-4630-a386-2013619b7769 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.877598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce182c-cd3d-4630-a386-2013619b7769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.877870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce182c-cd3d-4630-a386-2013619b7769 admin admin] PATH_INFO: `/v3/projects/26b3303be1b246b399d18a1da032e748/users/a1de4b34c2654932b46c453b8563ddd5/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.880023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce182c-cd3d-4630-a386-2013619b7769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b3303be1b246b399d18a1da032e748, user_id=a1de4b34c2654932b46c453b8563ddd5, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:12.882763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce182c-cd3d-4630-a386-2013619b7769 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:12.901589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 940/1869] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:12 2022] PUT /identity/v3/projects/26b3303be1b246b399d18a1da032e748/users/a1de4b34c2654932b46c453b8563ddd5/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:12.904236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e43a-b4f5-40e4-a8d3-191c4bc5658a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:12.904531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e43a-b4f5-40e4-a8d3-191c4bc5658a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:12.904808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7e43a-b4f5-40e4-a8d3-191c4bc5658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:12.932821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-17a7e43a-b4f5-40e4-a8d3-191c4bc5658a None None] MFA Rules not processed for user `a1de4b34c2654932b46c453b8563ddd5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:12.934050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-17a7e43a-b4f5-40e4-a8d3-191c4bc5658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:13.001927 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 930/1870] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:13.013034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce182c-cd3d-4630-a386-2013619b7769 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:13.014844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ecce182c-cd3d-4630-a386-2013619b7769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:13.077766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce182c-cd3d-4630-a386-2013619b7769 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:13.081398 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d3246-59a6-4c93-86d6-5ced617b0695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:13.082096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d3246-59a6-4c93-86d6-5ced617b0695 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.082424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d3246-59a6-4c93-86d6-5ced617b0695 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.082999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d3246-59a6-4c93-86d6-5ced617b0695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.094694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d3246-59a6-4c93-86d6-5ced617b0695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:13.096232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d3246-59a6-4c93-86d6-5ced617b0695 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:13.114092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7e43a-b4f5-40e4-a8d3-191c4bc5658a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:13.114482 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 941/1871] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:13.115642 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-17a7e43a-b4f5-40e4-a8d3-191c4bc5658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:13.190568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7e43a-b4f5-40e4-a8d3-191c4bc5658a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:13.195391 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:13.195549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d3246-59a6-4c93-86d6-5ced617b0695 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:13.196275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.196718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.196817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] PATH_INFO: `/v3/projects/c5c9e193c6a94653881588243eda8e96` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.198028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c9e193c6a94653881588243eda8e96)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:13.199983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:13.204070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d3246-59a6-4c93-86d6-5ced617b0695 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:13.207738 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0a386-1039-4c60-8967-34789ec84e12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:13.208375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a386-1039-4c60-8967-34789ec84e12 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.208656 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a386-1039-4c60-8967-34789ec84e12 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.208930 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a386-1039-4c60-8967-34789ec84e12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.251408 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c9e193c6a94653881588243eda8e96', 'request_id': 'req-41aab3f0-919e-46ad-af2d-e50304f1ee9f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:13.258777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c9e193c6a94653881588243eda8e96', 'request_id': 'req-41aab3f0-919e-46ad-af2d-e50304f1ee9f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:13.264357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c9e193c6a94653881588243eda8e96', 'request_id': 'req-41aab3f0-919e-46ad-af2d-e50304f1ee9f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:13.268558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0a386-1039-4c60-8967-34789ec84e12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:13.270017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0a386-1039-4c60-8967-34789ec84e12 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:13.277109 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] The token cache is being invalidate because project c5c9e193c6a94653881588243eda8e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:13.277392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:13.278152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-41aab3f0-919e-46ad-af2d-e50304f1ee9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:13.279631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 942/1872] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:47:13.281398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 931/1873] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:13 2022] DELETE /identity/v3/projects/c5c9e193c6a94653881588243eda8e96 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:13.286518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7bef5-1f22-4c89-91c4-9918e8821fac None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.286811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7bef5-1f22-4c89-91c4-9918e8821fac None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.287088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7bef5-1f22-4c89-91c4-9918e8821fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.304709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-98e7bef5-1f22-4c89-91c4-9918e8821fac None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:13.305905 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-98e7bef5-1f22-4c89-91c4-9918e8821fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:13.365133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 943/1874] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:13.373198 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e2e34-b1ea-4199-9b0f-bdd8bcb38147 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.373493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e2e34-b1ea-4199-9b0f-bdd8bcb38147 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.373830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e2e34-b1ea-4199-9b0f-bdd8bcb38147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.392495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-3a8e2e34-b1ea-4199-9b0f-bdd8bcb38147 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:13.393781 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3a8e2e34-b1ea-4199-9b0f-bdd8bcb38147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:13.402077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 932/1875] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:13.406467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7bef5-1f22-4c89-91c4-9918e8821fac None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:13.418646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7bef5-1f22-4c89-91c4-9918e8821fac None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:13.424890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbcc16-c06d-419c-818b-e34c8a8d0b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:13.425823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbcc16-c06d-419c-818b-e34c8a8d0b5e admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.426116 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbcc16-c06d-419c-818b-e34c8a8d0b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.426608 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbcc16-c06d-419c-818b-e34c8a8d0b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.427350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbcc16-c06d-419c-818b-e34c8a8d0b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:13.427654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbcc16-c06d-419c-818b-e34c8a8d0b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:13.429352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbcc16-c06d-419c-818b-e34c8a8d0b5e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:13.442283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 944/1876] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:47:13.446647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e2e34-b1ea-4199-9b0f-bdd8bcb38147 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:13.456009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e2e34-b1ea-4199-9b0f-bdd8bcb38147 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:13.460625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715988bc-16d6-496f-b3f5-0b09431264b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:13.461270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715988bc-16d6-496f-b3f5-0b09431264b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.461548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715988bc-16d6-496f-b3f5-0b09431264b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.461816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715988bc-16d6-496f-b3f5-0b09431264b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.462534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715988bc-16d6-496f-b3f5-0b09431264b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:13.464460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715988bc-16d6-496f-b3f5-0b09431264b4 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:13.495096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 933/1877] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:13 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:13.499444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbcc16-c06d-419c-818b-e34c8a8d0b5e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:13.515040 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbcc16-c06d-419c-818b-e34c8a8d0b5e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:13.601076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadef07-018a-4735-b254-fec5f2ea7912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:13.601552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadef07-018a-4735-b254-fec5f2ea7912 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.602123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadef07-018a-4735-b254-fec5f2ea7912 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.602474 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadef07-018a-4735-b254-fec5f2ea7912 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.603239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadef07-018a-4735-b254-fec5f2ea7912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:13.605690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadef07-018a-4735-b254-fec5f2ea7912 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:13.629623 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 945/1878] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:13 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:13.634294 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715988bc-16d6-496f-b3f5-0b09431264b4 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:13.646103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715988bc-16d6-496f-b3f5-0b09431264b4 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:13.658802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7aeac-8fbe-4248-815a-8f8d1c5b0b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:13.659620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7aeac-8fbe-4248-815a-8f8d1c5b0b5c admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.659972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7aeac-8fbe-4248-815a-8f8d1c5b0b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.660258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7aeac-8fbe-4248-815a-8f8d1c5b0b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.661152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7aeac-8fbe-4248-815a-8f8d1c5b0b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:13.663106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7aeac-8fbe-4248-815a-8f8d1c5b0b5c admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:13.680939 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 934/1879] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:13.682994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadef07-018a-4735-b254-fec5f2ea7912 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:13.695264 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadef07-018a-4735-b254-fec5f2ea7912 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:13.700631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0046d5-1577-4b9a-bc99-09139d60414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:13.701756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0046d5-1577-4b9a-bc99-09139d60414e admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.701756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0046d5-1577-4b9a-bc99-09139d60414e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.701938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0046d5-1577-4b9a-bc99-09139d60414e admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.702707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0046d5-1577-4b9a-bc99-09139d60414e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:13.704563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0046d5-1577-4b9a-bc99-09139d60414e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:13.716096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 946/1880] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:13.720361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7aeac-8fbe-4248-815a-8f8d1c5b0b5c admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:13.731848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7aeac-8fbe-4248-815a-8f8d1c5b0b5c admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:13.737472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bc698-53b8-49dc-808c-ad244556d4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:13.738388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bc698-53b8-49dc-808c-ad244556d4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.738671 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bc698-53b8-49dc-808c-ad244556d4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.738941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bc698-53b8-49dc-808c-ad244556d4bb admin admin] PATH_INFO: `/v3/projects/71a90f9aac2a4a91a5c9558001978d73/users/35b591ca12b440b98809aae571d9ba2f/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.757167 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bc698-53b8-49dc-808c-ad244556d4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a90f9aac2a4a91a5c9558001978d73, user_id=35b591ca12b440b98809aae571d9ba2f, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:13.760677 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bc698-53b8-49dc-808c-ad244556d4bb admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:13.775764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 935/1881] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:13 2022] PUT /identity/v3/projects/71a90f9aac2a4a91a5c9558001978d73/users/35b591ca12b440b98809aae571d9ba2f/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:13.789099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c4a2b-34f9-4e85-a6d4-eca28aee9ec6 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:13.789865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c4a2b-34f9-4e85-a6d4-eca28aee9ec6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:13.790864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c4a2b-34f9-4e85-a6d4-eca28aee9ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:13.827223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-848c4a2b-34f9-4e85-a6d4-eca28aee9ec6 None None] MFA Rules not processed for user `35b591ca12b440b98809aae571d9ba2f`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:13.828530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-848c4a2b-34f9-4e85-a6d4-eca28aee9ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:13.924873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 947/1882] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:13.937729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bc698-53b8-49dc-808c-ad244556d4bb admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:13.939521 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-fb0bc698-53b8-49dc-808c-ad244556d4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:14.014791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bc698-53b8-49dc-808c-ad244556d4bb admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:14.018835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d5888-3dcb-44b5-9432-1b05e770b099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:14.019692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d5888-3dcb-44b5-9432-1b05e770b099 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:14.020129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d5888-3dcb-44b5-9432-1b05e770b099 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:14.020566 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d5888-3dcb-44b5-9432-1b05e770b099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:14.033300 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d5888-3dcb-44b5-9432-1b05e770b099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:14.035181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d5888-3dcb-44b5-9432-1b05e770b099 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:14.045955 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 936/1883] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:17.213824 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c4a2b-34f9-4e85-a6d4-eca28aee9ec6 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:17.215427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-848c4a2b-34f9-4e85-a6d4-eca28aee9ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:17.280852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c4a2b-34f9-4e85-a6d4-eca28aee9ec6 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:17.285435 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:17.286303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:17.286616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:17.286897 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] PATH_INFO: `/v3/users/23b65c81b0944eed84ee61743da57ac7` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:17.288096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b65c81b0944eed84ee61743da57ac7)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:17.290011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:17.338663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b65c81b0944eed84ee61743da57ac7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:17.353123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b65c81b0944eed84ee61743da57ac7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:17.354583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b65c81b0944eed84ee61743da57ac7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:17.355302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b65c81b0944eed84ee61743da57ac7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:17.362901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b65c81b0944eed84ee61743da57ac7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:17.376931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 948/1884] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:17 2022] DELETE /identity/v3/users/23b65c81b0944eed84ee61743da57ac7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:17.381804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea5976-0b07-499b-b075-6bc8347606be None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:17.382279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea5976-0b07-499b-b075-6bc8347606be None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:17.382758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea5976-0b07-499b-b075-6bc8347606be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:17.400570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-eaea5976-0b07-499b-b075-6bc8347606be None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:17.401892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-eaea5976-0b07-499b-b075-6bc8347606be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:17.458947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 937/1885] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:17.469641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:17.471053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:17.532931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e476d255-bacf-4ecc-9519-dd1322a7b0b2 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:17.536622 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e3c08-d4ff-4a16-af5c-24d507b8c9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:17.537277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e3c08-d4ff-4a16-af5c-24d507b8c9cd service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:17.537561 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e3c08-d4ff-4a16-af5c-24d507b8c9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:17.537874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e3c08-d4ff-4a16-af5c-24d507b8c9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:17.548308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e3c08-d4ff-4a16-af5c-24d507b8c9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:17.549768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e3c08-d4ff-4a16-af5c-24d507b8c9cd service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:17.559979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 949/1886] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:17.932065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea5976-0b07-499b-b075-6bc8347606be None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:17.933498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-eaea5976-0b07-499b-b075-6bc8347606be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:17.945570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea5976-0b07-499b-b075-6bc8347606be None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:17.950986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:17.951850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:17.952134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:17.952411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] PATH_INFO: `/v3/projects/cb0c02e18bf64577aaae9b4b851d025d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:17.953610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0c02e18bf64577aaae9b4b851d025d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:17.955566 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:18.003200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0c02e18bf64577aaae9b4b851d025d', 'request_id': 'req-7a18867f-8a28-475b-9f85-dbe54531936b'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.011475 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0c02e18bf64577aaae9b4b851d025d', 'request_id': 'req-7a18867f-8a28-475b-9f85-dbe54531936b'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.017698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0c02e18bf64577aaae9b4b851d025d', 'request_id': 'req-7a18867f-8a28-475b-9f85-dbe54531936b'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.029595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] The token cache is being invalidate because project cb0c02e18bf64577aaae9b4b851d025d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:18.029888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.030586 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.032127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 938/1887] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:17 2022] DELETE /identity/v3/projects/cb0c02e18bf64577aaae9b4b851d025d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:18.036090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e3c08-d4ff-4a16-af5c-24d507b8c9cd service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:18.045461 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e3c08-d4ff-4a16-af5c-24d507b8c9cd service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:18.102738 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1919377-f70b-4f4b-b00f-e5c857fa671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:18.103624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1919377-f70b-4f4b-b00f-e5c857fa671a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:18.103961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1919377-f70b-4f4b-b00f-e5c857fa671a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:18.104233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1919377-f70b-4f4b-b00f-e5c857fa671a admin admin] PATH_INFO: `/v3/users/d1e423a4d0fe4d19a0f8311b8a6ba8b2` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:18.105466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1919377-f70b-4f4b-b00f-e5c857fa671a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e423a4d0fe4d19a0f8311b8a6ba8b2)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:18.107432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1919377-f70b-4f4b-b00f-e5c857fa671a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:18.151887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a1919377-f70b-4f4b-b00f-e5c857fa671a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e423a4d0fe4d19a0f8311b8a6ba8b2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.163173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a1919377-f70b-4f4b-b00f-e5c857fa671a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e423a4d0fe4d19a0f8311b8a6ba8b2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.163827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a1919377-f70b-4f4b-b00f-e5c857fa671a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e423a4d0fe4d19a0f8311b8a6ba8b2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.164422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a1919377-f70b-4f4b-b00f-e5c857fa671a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e423a4d0fe4d19a0f8311b8a6ba8b2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.170871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a1919377-f70b-4f4b-b00f-e5c857fa671a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e423a4d0fe4d19a0f8311b8a6ba8b2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.183709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 950/1888] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:18 2022] DELETE /identity/v3/users/d1e423a4d0fe4d19a0f8311b8a6ba8b2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:18.489912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:18.491674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:18.510929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18867f-8a28-475b-9f85-dbe54531936b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:18.566082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:18.566980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:18.567256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:18.567529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] PATH_INFO: `/v3/projects/639483e0e39744bb99492b1c00cefdeb` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:18.568771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=639483e0e39744bb99492b1c00cefdeb)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:18.570731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:18.620713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '639483e0e39744bb99492b1c00cefdeb', 'request_id': 'req-6481a63b-74c2-4527-8876-190a5d92f8fe'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.627641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '639483e0e39744bb99492b1c00cefdeb', 'request_id': 'req-6481a63b-74c2-4527-8876-190a5d92f8fe'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.633132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '639483e0e39744bb99492b1c00cefdeb', 'request_id': 'req-6481a63b-74c2-4527-8876-190a5d92f8fe'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.643944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] The token cache is being invalidate because project 639483e0e39744bb99492b1c00cefdeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:18.644246 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.644986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6481a63b-74c2-4527-8876-190a5d92f8fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:18.646676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 939/1889] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:18 2022] DELETE /identity/v3/projects/639483e0e39744bb99492b1c00cefdeb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:18.651853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c655d0-8417-406d-ba52-0dc67f902015 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:18.652329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c655d0-8417-406d-ba52-0dc67f902015 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:18.652453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c655d0-8417-406d-ba52-0dc67f902015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:18.671906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-04c655d0-8417-406d-ba52-0dc67f902015 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:18.673075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-04c655d0-8417-406d-ba52-0dc67f902015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:18.735746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 951/1890] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:18.743299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddbb99-0266-4ce8-b08f-5dd9341f775d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:18.743586 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddbb99-0266-4ce8-b08f-5dd9341f775d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:18.743863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddbb99-0266-4ce8-b08f-5dd9341f775d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:18.766682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-34ddbb99-0266-4ce8-b08f-5dd9341f775d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:18.766682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-34ddbb99-0266-4ce8-b08f-5dd9341f775d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:18.776570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 940/1891] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:18.780682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c655d0-8417-406d-ba52-0dc67f902015 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:18.792302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c655d0-8417-406d-ba52-0dc67f902015 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:18.797493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cec859-8432-4baf-ac24-c7e15c257cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:18.798234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cec859-8432-4baf-ac24-c7e15c257cca admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:18.798612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cec859-8432-4baf-ac24-c7e15c257cca admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:18.798890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cec859-8432-4baf-ac24-c7e15c257cca admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:18.799628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cec859-8432-4baf-ac24-c7e15c257cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:18.799935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cec859-8432-4baf-ac24-c7e15c257cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:18.801533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cec859-8432-4baf-ac24-c7e15c257cca admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:18.814163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 952/1892] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:47:18.818565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddbb99-0266-4ce8-b08f-5dd9341f775d None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:18.828708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddbb99-0266-4ce8-b08f-5dd9341f775d None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:18.839701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df3ad7-5d7b-4665-8474-b30aaea3b1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:18.839701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df3ad7-5d7b-4665-8474-b30aaea3b1ee admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:18.839701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df3ad7-5d7b-4665-8474-b30aaea3b1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:18.839701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df3ad7-5d7b-4665-8474-b30aaea3b1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:18.840646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df3ad7-5d7b-4665-8474-b30aaea3b1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:18.840646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df3ad7-5d7b-4665-8474-b30aaea3b1ee admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:18.871609 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 941/1893] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:18 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:18.872828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cec859-8432-4baf-ac24-c7e15c257cca admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:18.882978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cec859-8432-4baf-ac24-c7e15c257cca admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:18.944783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174d600-c037-45a6-8415-847b9b93b57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:18.945470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d600-c037-45a6-8415-847b9b93b57b admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:18.945752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d600-c037-45a6-8415-847b9b93b57b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:18.946031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174d600-c037-45a6-8415-847b9b93b57b admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:18.946768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174d600-c037-45a6-8415-847b9b93b57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:18.948724 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174d600-c037-45a6-8415-847b9b93b57b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:18.972920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 953/1894] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:18 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:18.974216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df3ad7-5d7b-4665-8474-b30aaea3b1ee admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:18.986147 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df3ad7-5d7b-4665-8474-b30aaea3b1ee admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:18.990739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bb712-acc8-4765-b3d4-571ec6bf78a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:18.991412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb712-acc8-4765-b3d4-571ec6bf78a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:18.991708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb712-acc8-4765-b3d4-571ec6bf78a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:18.991981 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb712-acc8-4765-b3d4-571ec6bf78a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:18.992706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bb712-acc8-4765-b3d4-571ec6bf78a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:18.994278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bb712-acc8-4765-b3d4-571ec6bf78a2 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:19.006289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 942/1895] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:19.010194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174d600-c037-45a6-8415-847b9b93b57b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:19.019853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174d600-c037-45a6-8415-847b9b93b57b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:19.024507 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e899d6-9f8a-48fd-8f40-5b69d4578758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:19.025174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e899d6-9f8a-48fd-8f40-5b69d4578758 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:19.025428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e899d6-9f8a-48fd-8f40-5b69d4578758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:19.026234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e899d6-9f8a-48fd-8f40-5b69d4578758 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:19.027156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e899d6-9f8a-48fd-8f40-5b69d4578758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:19.028739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e899d6-9f8a-48fd-8f40-5b69d4578758 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:19.041369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 954/1896] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:19.043670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bb712-acc8-4765-b3d4-571ec6bf78a2 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:19.053873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bb712-acc8-4765-b3d4-571ec6bf78a2 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:19.058775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6763d2e-8a67-4224-b39a-d77996441fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:19.059991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763d2e-8a67-4224-b39a-d77996441fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:19.060152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763d2e-8a67-4224-b39a-d77996441fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:19.060600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763d2e-8a67-4224-b39a-d77996441fb0 admin admin] PATH_INFO: `/v3/projects/bf377e4e9cf8475d95412fc0ad8d3653/users/ce81cacd661e48829a1d0ed4a5115043/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:19.075665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6763d2e-8a67-4224-b39a-d77996441fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf377e4e9cf8475d95412fc0ad8d3653, user_id=ce81cacd661e48829a1d0ed4a5115043, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:19.078297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6763d2e-8a67-4224-b39a-d77996441fb0 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:19.091498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 943/1897] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:19 2022] PUT /identity/v3/projects/bf377e4e9cf8475d95412fc0ad8d3653/users/ce81cacd661e48829a1d0ed4a5115043/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:19.101783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9e0d4-900c-42d7-95ff-ce4a640e2c17 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:19.102075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9e0d4-900c-42d7-95ff-ce4a640e2c17 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:19.102387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9e0d4-900c-42d7-95ff-ce4a640e2c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:19.131526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-5ae9e0d4-900c-42d7-95ff-ce4a640e2c17 None None] MFA Rules not processed for user `ce81cacd661e48829a1d0ed4a5115043`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:19.132709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-5ae9e0d4-900c-42d7-95ff-ce4a640e2c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:19.195546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 955/1898] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:19.200037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6763d2e-8a67-4224-b39a-d77996441fb0 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:19.261510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6763d2e-8a67-4224-b39a-d77996441fb0 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:19.266207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb4f8f-f6a9-467b-ae7a-7f855109c36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:19.266888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb4f8f-f6a9-467b-ae7a-7f855109c36d admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:19.267204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb4f8f-f6a9-467b-ae7a-7f855109c36d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:19.267480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb4f8f-f6a9-467b-ae7a-7f855109c36d admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:19.268171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb4f8f-f6a9-467b-ae7a-7f855109c36d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:19.270075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb4f8f-f6a9-467b-ae7a-7f855109c36d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:19.295526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 944/1899] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:19 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:19.299695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9e0d4-900c-42d7-95ff-ce4a640e2c17 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:19.310094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9e0d4-900c-42d7-95ff-ce4a640e2c17 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:19.365404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe25ee-71df-4c85-8cc0-bfa4b7da97a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:19.366069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe25ee-71df-4c85-8cc0-bfa4b7da97a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:19.366379 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe25ee-71df-4c85-8cc0-bfa4b7da97a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:19.366659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe25ee-71df-4c85-8cc0-bfa4b7da97a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:19.367363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe25ee-71df-4c85-8cc0-bfa4b7da97a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:19.369310 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe25ee-71df-4c85-8cc0-bfa4b7da97a4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:19.391758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 956/1900] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:19 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:19.394303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb4f8f-f6a9-467b-ae7a-7f855109c36d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:19.405763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb4f8f-f6a9-467b-ae7a-7f855109c36d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:19.410257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3f3c2-c7fe-4bb0-8268-25f5ea056ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:19.410937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3f3c2-c7fe-4bb0-8268-25f5ea056ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:19.411218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3f3c2-c7fe-4bb0-8268-25f5ea056ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:19.411489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3f3c2-c7fe-4bb0-8268-25f5ea056ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:19.412207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3f3c2-c7fe-4bb0-8268-25f5ea056ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:19.413784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3f3c2-c7fe-4bb0-8268-25f5ea056ab7 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:19.424342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 945/1901] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:19.428508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe25ee-71df-4c85-8cc0-bfa4b7da97a4 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:19.438803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe25ee-71df-4c85-8cc0-bfa4b7da97a4 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:19.443417 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a1a12-b7f2-445e-a85a-843ea425f1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:19.444366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1a12-b7f2-445e-a85a-843ea425f1fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:19.444579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1a12-b7f2-445e-a85a-843ea425f1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:19.444856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a1a12-b7f2-445e-a85a-843ea425f1fc admin admin] PATH_INFO: `/v3/projects/7ec4ef90cb1247728acd26741a45e38f/users/41d30cffc3ea4088a585a0c1336448b2/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:19.463089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1a12-b7f2-445e-a85a-843ea425f1fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec4ef90cb1247728acd26741a45e38f, user_id=41d30cffc3ea4088a585a0c1336448b2, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:19.467660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a1a12-b7f2-445e-a85a-843ea425f1fc admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:19.480508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 957/1902] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:19 2022] PUT /identity/v3/projects/7ec4ef90cb1247728acd26741a45e38f/users/41d30cffc3ea4088a585a0c1336448b2/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:19.484339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3f3c2-c7fe-4bb0-8268-25f5ea056ab7 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:19.495907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3f3c2-c7fe-4bb0-8268-25f5ea056ab7 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:19.561457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a0cda-9f67-419c-ba0e-50755dbbf907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:19.562133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0cda-9f67-419c-ba0e-50755dbbf907 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:19.562459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0cda-9f67-419c-ba0e-50755dbbf907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:19.562737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a0cda-9f67-419c-ba0e-50755dbbf907 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:19.563474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a0cda-9f67-419c-ba0e-50755dbbf907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:19.565104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a0cda-9f67-419c-ba0e-50755dbbf907 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:19.579328 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 946/1903] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:19.580325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a1a12-b7f2-445e-a85a-843ea425f1fc admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:19.591634 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a1a12-b7f2-445e-a85a-843ea425f1fc admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:19.596308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a11a-622b-42fd-a4db-b9d6a8a7396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:19.597197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a11a-622b-42fd-a4db-b9d6a8a7396d admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:19.597483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a11a-622b-42fd-a4db-b9d6a8a7396d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:19.597762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72a11a-622b-42fd-a4db-b9d6a8a7396d admin admin] PATH_INFO: `/v3/projects/7ec4ef90cb1247728acd26741a45e38f/users/41d30cffc3ea4088a585a0c1336448b2/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:19.599853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72a11a-622b-42fd-a4db-b9d6a8a7396d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec4ef90cb1247728acd26741a45e38f, user_id=41d30cffc3ea4088a585a0c1336448b2, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:19.602529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72a11a-622b-42fd-a4db-b9d6a8a7396d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:19.613986 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 958/1904] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:19 2022] PUT /identity/v3/projects/7ec4ef90cb1247728acd26741a45e38f/users/41d30cffc3ea4088a585a0c1336448b2/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:19.625577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e0049-c2f9-427d-a37d-f6bd3e2bf91b None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:19.625868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e0049-c2f9-427d-a37d-f6bd3e2bf91b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:19.626395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e0049-c2f9-427d-a37d-f6bd3e2bf91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:19.655619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-088e0049-c2f9-427d-a37d-f6bd3e2bf91b None None] MFA Rules not processed for user `41d30cffc3ea4088a585a0c1336448b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:19.656841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-088e0049-c2f9-427d-a37d-f6bd3e2bf91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:19.725713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 947/1905] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:19.737312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a11a-622b-42fd-a4db-b9d6a8a7396d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:19.739057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9e72a11a-622b-42fd-a4db-b9d6a8a7396d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:19.797484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72a11a-622b-42fd-a4db-b9d6a8a7396d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:19.801217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1a449-9af2-4cb7-b93d-06e555ae7cc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:19.801885 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1a449-9af2-4cb7-b93d-06e555ae7cc4 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:19.802236 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1a449-9af2-4cb7-b93d-06e555ae7cc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:19.802569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1a449-9af2-4cb7-b93d-06e555ae7cc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:19.812075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1a449-9af2-4cb7-b93d-06e555ae7cc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:19.813628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1a449-9af2-4cb7-b93d-06e555ae7cc4 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:19.823564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 959/1906] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:21.165254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e0049-c2f9-427d-a37d-f6bd3e2bf91b None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:21.230468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e0049-c2f9-427d-a37d-f6bd3e2bf91b None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:21.239406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:21.240762 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:21.241313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:21.241787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] PATH_INFO: `/v3/users/ce81cacd661e48829a1d0ed4a5115043` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:21.243507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce81cacd661e48829a1d0ed4a5115043)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:21.246684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:21.301419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce81cacd661e48829a1d0ed4a5115043'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:21.313931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce81cacd661e48829a1d0ed4a5115043'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:21.315367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce81cacd661e48829a1d0ed4a5115043'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:21.315987 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce81cacd661e48829a1d0ed4a5115043'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:21.323713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce81cacd661e48829a1d0ed4a5115043'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:21.341220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 948/1907] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:21 2022] DELETE /identity/v3/users/ce81cacd661e48829a1d0ed4a5115043 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:21.346029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a9bb-14c9-487f-946e-d3480188a68e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:21.346537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a9bb-14c9-487f-946e-d3480188a68e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:21.346613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31a9bb-14c9-487f-946e-d3480188a68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:21.367042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2c31a9bb-14c9-487f-946e-d3480188a68e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:21.369148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2c31a9bb-14c9-487f-946e-d3480188a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:21.444685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 960/1908] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:21.456176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:21.457577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:21.523179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8033b1-5950-4378-9c62-2573487d4fa5 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:21.527333 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8629e24-a465-4366-82a7-f5d6fb3791a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:21.527983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8629e24-a465-4366-82a7-f5d6fb3791a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:21.528265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8629e24-a465-4366-82a7-f5d6fb3791a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:21.528543 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8629e24-a465-4366-82a7-f5d6fb3791a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:21.537583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8629e24-a465-4366-82a7-f5d6fb3791a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:21.539130 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8629e24-a465-4366-82a7-f5d6fb3791a7 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:21.549266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 949/1909] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:21.810142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31a9bb-14c9-487f-946e-d3480188a68e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:21.811628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2c31a9bb-14c9-487f-946e-d3480188a68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:21.830391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31a9bb-14c9-487f-946e-d3480188a68e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:21.836983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:21.838249 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:21.839812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:21.840211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] PATH_INFO: `/v3/projects/bf377e4e9cf8475d95412fc0ad8d3653` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:21.841682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf377e4e9cf8475d95412fc0ad8d3653)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:21.844212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:21.894372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf377e4e9cf8475d95412fc0ad8d3653', 'request_id': 'req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:21.901572 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf377e4e9cf8475d95412fc0ad8d3653', 'request_id': 'req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:21.908345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf377e4e9cf8475d95412fc0ad8d3653', 'request_id': 'req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:21.918823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] The token cache is being invalidate because project bf377e4e9cf8475d95412fc0ad8d3653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:21.919112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:21.919730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:21.921278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 961/1910] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:21 2022] DELETE /identity/v3/projects/bf377e4e9cf8475d95412fc0ad8d3653 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:21.925417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8629e24-a465-4366-82a7-f5d6fb3791a7 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:21.936171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8629e24-a465-4366-82a7-f5d6fb3791a7 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:21.997881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b53384-c1c6-4c60-9761-1ceb270456e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:21.998824 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b53384-c1c6-4c60-9761-1ceb270456e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:21.999113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b53384-c1c6-4c60-9761-1ceb270456e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:22.000123 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b53384-c1c6-4c60-9761-1ceb270456e3 admin admin] PATH_INFO: `/v3/users/41d30cffc3ea4088a585a0c1336448b2` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:22.001380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b53384-c1c6-4c60-9761-1ceb270456e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d30cffc3ea4088a585a0c1336448b2)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:22.003380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b53384-c1c6-4c60-9761-1ceb270456e3 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:22.049800 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e3b53384-c1c6-4c60-9761-1ceb270456e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d30cffc3ea4088a585a0c1336448b2'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:22.062535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e3b53384-c1c6-4c60-9761-1ceb270456e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d30cffc3ea4088a585a0c1336448b2'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:22.063283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e3b53384-c1c6-4c60-9761-1ceb270456e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d30cffc3ea4088a585a0c1336448b2'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:22.063963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e3b53384-c1c6-4c60-9761-1ceb270456e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d30cffc3ea4088a585a0c1336448b2'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:22.071395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e3b53384-c1c6-4c60-9761-1ceb270456e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d30cffc3ea4088a585a0c1336448b2'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:22.086198 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 950/1911] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:21 2022] DELETE /identity/v3/users/41d30cffc3ea4088a585a0c1336448b2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:22.377873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:22.379466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:22.393938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a2f3-adb5-4ada-9338-89cf06bd7271 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:22.455696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:22.456740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:22.457146 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:22.457537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] PATH_INFO: `/v3/projects/7ec4ef90cb1247728acd26741a45e38f` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:22.458861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec4ef90cb1247728acd26741a45e38f)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:22.460949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:22.523809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec4ef90cb1247728acd26741a45e38f', 'request_id': 'req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:22.530954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec4ef90cb1247728acd26741a45e38f', 'request_id': 'req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:22.538341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec4ef90cb1247728acd26741a45e38f', 'request_id': 'req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:22.549471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] The token cache is being invalidate because project 7ec4ef90cb1247728acd26741a45e38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:22.549762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:22.550448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7c2716ce-0679-4d05-9dce-e01acc8ed7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:22.552449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 962/1912] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:22 2022] DELETE /identity/v3/projects/7ec4ef90cb1247728acd26741a45e38f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:22.557731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9d9ba-6eeb-4e10-b1f0-6c4662162f9c None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:22.558399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9d9ba-6eeb-4e10-b1f0-6c4662162f9c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:22.558399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9d9ba-6eeb-4e10-b1f0-6c4662162f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:22.576549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-61f9d9ba-6eeb-4e10-b1f0-6c4662162f9c None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:22.577679 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-61f9d9ba-6eeb-4e10-b1f0-6c4662162f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:22.675333 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 951/1913] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:22.683650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26c6d-4c64-4b18-ac0a-7025444902ac None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:22.687600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26c6d-4c64-4b18-ac0a-7025444902ac None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:22.687971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d26c6d-4c64-4b18-ac0a-7025444902ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:22.709002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-96d26c6d-4c64-4b18-ac0a-7025444902ac None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:22.710267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-96d26c6d-4c64-4b18-ac0a-7025444902ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:22.719282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 963/1914] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:22.723606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9d9ba-6eeb-4e10-b1f0-6c4662162f9c None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:22.733915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9d9ba-6eeb-4e10-b1f0-6c4662162f9c None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:22.739021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1a2c2-aece-44d4-a4be-c372330a283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:22.739674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1a2c2-aece-44d4-a4be-c372330a283b admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:22.739956 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1a2c2-aece-44d4-a4be-c372330a283b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:22.740232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1a2c2-aece-44d4-a4be-c372330a283b admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:22.740958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1a2c2-aece-44d4-a4be-c372330a283b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:22.741264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1a2c2-aece-44d4-a4be-c372330a283b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:22.742889 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1a2c2-aece-44d4-a4be-c372330a283b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:22.754264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 952/1915] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:47:22.758629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d26c6d-4c64-4b18-ac0a-7025444902ac None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:22.767991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d26c6d-4c64-4b18-ac0a-7025444902ac None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:22.772632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06e602-d52a-4b5e-9229-295b37689b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:22.773319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e602-d52a-4b5e-9229-295b37689b23 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:22.773597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e602-d52a-4b5e-9229-295b37689b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:22.773869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06e602-d52a-4b5e-9229-295b37689b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:22.774599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06e602-d52a-4b5e-9229-295b37689b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:22.777143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06e602-d52a-4b5e-9229-295b37689b23 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:22.801939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 964/1916] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:22 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:22.806014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1a2c2-aece-44d4-a4be-c372330a283b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:22.815768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1a2c2-aece-44d4-a4be-c372330a283b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:22.876820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30005eb-5c79-42a6-a792-fe0b399a5aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:22.877571 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30005eb-5c79-42a6-a792-fe0b399a5aec admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:22.877756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30005eb-5c79-42a6-a792-fe0b399a5aec admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:22.878030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30005eb-5c79-42a6-a792-fe0b399a5aec admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:22.878767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30005eb-5c79-42a6-a792-fe0b399a5aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:22.880809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30005eb-5c79-42a6-a792-fe0b399a5aec admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:22.903660 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 953/1917] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:22 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:22.905060 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06e602-d52a-4b5e-9229-295b37689b23 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:22.915226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06e602-d52a-4b5e-9229-295b37689b23 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:22.922229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e04aae-9954-4c4c-a62f-e4d339bdf252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:22.923144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e04aae-9954-4c4c-a62f-e4d339bdf252 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:22.923425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e04aae-9954-4c4c-a62f-e4d339bdf252 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:22.923700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e04aae-9954-4c4c-a62f-e4d339bdf252 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:22.924472 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e04aae-9954-4c4c-a62f-e4d339bdf252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:22.926061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e04aae-9954-4c4c-a62f-e4d339bdf252 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:22.937197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 965/1918] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:22.941474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30005eb-5c79-42a6-a792-fe0b399a5aec admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:22.952210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30005eb-5c79-42a6-a792-fe0b399a5aec admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:22.957757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d496f7d-5b6c-4f07-bb88-89d8153e4917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:22.958605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d496f7d-5b6c-4f07-bb88-89d8153e4917 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:22.958898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d496f7d-5b6c-4f07-bb88-89d8153e4917 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:22.959178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d496f7d-5b6c-4f07-bb88-89d8153e4917 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:22.960005 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d496f7d-5b6c-4f07-bb88-89d8153e4917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:22.961897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d496f7d-5b6c-4f07-bb88-89d8153e4917 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:22.972319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 954/1919] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:22.976343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e04aae-9954-4c4c-a62f-e4d339bdf252 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:22.987314 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e04aae-9954-4c4c-a62f-e4d339bdf252 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:22.993255 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4af866-d15b-44ee-900f-f3e08e374c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:22.994288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4af866-d15b-44ee-900f-f3e08e374c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:22.994862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4af866-d15b-44ee-900f-f3e08e374c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:22.995268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4af866-d15b-44ee-900f-f3e08e374c17 admin admin] PATH_INFO: `/v3/projects/16220beaefed4b11a6cfa9c5bbd42079/users/54958b643e88455188f0fcc8f0b301f0/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:23.018122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4af866-d15b-44ee-900f-f3e08e374c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16220beaefed4b11a6cfa9c5bbd42079, user_id=54958b643e88455188f0fcc8f0b301f0, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:23.021001 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4af866-d15b-44ee-900f-f3e08e374c17 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:23.037549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 966/1920] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:22 2022] PUT /identity/v3/projects/16220beaefed4b11a6cfa9c5bbd42079/users/54958b643e88455188f0fcc8f0b301f0/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:23.047883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5606b-2cfe-48fb-a50f-46dd084fbd72 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:23.048214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5606b-2cfe-48fb-a50f-46dd084fbd72 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:23.048618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5606b-2cfe-48fb-a50f-46dd084fbd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:23.076469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-77a5606b-2cfe-48fb-a50f-46dd084fbd72 None None] MFA Rules not processed for user `54958b643e88455188f0fcc8f0b301f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:23.077678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-77a5606b-2cfe-48fb-a50f-46dd084fbd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:23.141365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 955/1921] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:23.145803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4af866-d15b-44ee-900f-f3e08e374c17 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:23.210570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4af866-d15b-44ee-900f-f3e08e374c17 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:23.219359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac0c40-7843-460e-855d-94034260f07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:23.220077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0c40-7843-460e-855d-94034260f07e admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:23.220322 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0c40-7843-460e-855d-94034260f07e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:23.220603 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0c40-7843-460e-855d-94034260f07e admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:23.221322 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac0c40-7843-460e-855d-94034260f07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:23.223264 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac0c40-7843-460e-855d-94034260f07e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:23.257720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 967/1922] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:23 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:23.258935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5606b-2cfe-48fb-a50f-46dd084fbd72 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:23.269784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5606b-2cfe-48fb-a50f-46dd084fbd72 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:23.324893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff4751-fa18-48b8-b462-3014fcce058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:23.325573 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4751-fa18-48b8-b462-3014fcce058d admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:23.325860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4751-fa18-48b8-b462-3014fcce058d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:23.326137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff4751-fa18-48b8-b462-3014fcce058d admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:23.326946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff4751-fa18-48b8-b462-3014fcce058d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:23.328887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff4751-fa18-48b8-b462-3014fcce058d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:23.349734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 956/1923] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:23 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:23.354564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac0c40-7843-460e-855d-94034260f07e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:23.365231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac0c40-7843-460e-855d-94034260f07e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:23.370731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316571b7-11c2-4d83-be66-69407e3a30a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:23.371504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316571b7-11c2-4d83-be66-69407e3a30a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:23.371856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316571b7-11c2-4d83-be66-69407e3a30a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:23.372202 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316571b7-11c2-4d83-be66-69407e3a30a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:23.373006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316571b7-11c2-4d83-be66-69407e3a30a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:23.374722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316571b7-11c2-4d83-be66-69407e3a30a3 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:23.385307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 968/1924] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:23.390254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff4751-fa18-48b8-b462-3014fcce058d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:23.404906 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff4751-fa18-48b8-b462-3014fcce058d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:23.409784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9e37e-71a5-4aac-8b5b-289af3a35971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:23.410771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9e37e-71a5-4aac-8b5b-289af3a35971 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:23.411127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9e37e-71a5-4aac-8b5b-289af3a35971 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:23.411528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9e37e-71a5-4aac-8b5b-289af3a35971 admin admin] PATH_INFO: `/v3/projects/0e847072ad66475fb25debf4fe9e26a6/users/82f6cf39692d4caabda0f21adf14e8d0/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:23.427657 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9e37e-71a5-4aac-8b5b-289af3a35971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e847072ad66475fb25debf4fe9e26a6, user_id=82f6cf39692d4caabda0f21adf14e8d0, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:23.430388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9e37e-71a5-4aac-8b5b-289af3a35971 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:23.443698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 957/1925] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:23 2022] PUT /identity/v3/projects/0e847072ad66475fb25debf4fe9e26a6/users/82f6cf39692d4caabda0f21adf14e8d0/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:23.447946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316571b7-11c2-4d83-be66-69407e3a30a3 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:23.457814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316571b7-11c2-4d83-be66-69407e3a30a3 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:23.512118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830374a-0108-455b-9ef2-ce9364096e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:23.512768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830374a-0108-455b-9ef2-ce9364096e7d admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:23.513051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830374a-0108-455b-9ef2-ce9364096e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:23.513325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830374a-0108-455b-9ef2-ce9364096e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:23.514038 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830374a-0108-455b-9ef2-ce9364096e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:23.515657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830374a-0108-455b-9ef2-ce9364096e7d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:23.524927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 969/1926] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:47:23.529480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9e37e-71a5-4aac-8b5b-289af3a35971 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:23.539513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9e37e-71a5-4aac-8b5b-289af3a35971 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:23.544572 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766498-20bf-4941-a67d-dd152f77889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:23.545435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766498-20bf-4941-a67d-dd152f77889e admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:23.545717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766498-20bf-4941-a67d-dd152f77889e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:23.546071 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766498-20bf-4941-a67d-dd152f77889e admin admin] PATH_INFO: `/v3/projects/0e847072ad66475fb25debf4fe9e26a6/users/82f6cf39692d4caabda0f21adf14e8d0/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:23.548177 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d766498-20bf-4941-a67d-dd152f77889e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e847072ad66475fb25debf4fe9e26a6, user_id=82f6cf39692d4caabda0f21adf14e8d0, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:23.551136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d766498-20bf-4941-a67d-dd152f77889e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:23.561107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 958/1927] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:23 2022] PUT /identity/v3/projects/0e847072ad66475fb25debf4fe9e26a6/users/82f6cf39692d4caabda0f21adf14e8d0/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:23.571845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c0386-97da-4902-a4f5-11d0c8c58bf9 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:23.572224 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c0386-97da-4902-a4f5-11d0c8c58bf9 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:23.572471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c0386-97da-4902-a4f5-11d0c8c58bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:23.598395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d32c0386-97da-4902-a4f5-11d0c8c58bf9 None None] MFA Rules not processed for user `82f6cf39692d4caabda0f21adf14e8d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:23.599592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d32c0386-97da-4902-a4f5-11d0c8c58bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:23.665959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 970/1928] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:23.678504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766498-20bf-4941-a67d-dd152f77889e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:23.680327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7d766498-20bf-4941-a67d-dd152f77889e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:23.748680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766498-20bf-4941-a67d-dd152f77889e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:23.752570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7a206-4afe-4325-a817-3a0cb0690c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:23.753232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7a206-4afe-4325-a817-3a0cb0690c3d service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:23.753511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7a206-4afe-4325-a817-3a0cb0690c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:23.753944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7a206-4afe-4325-a817-3a0cb0690c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:23.774503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7a206-4afe-4325-a817-3a0cb0690c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:23.776963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7a206-4afe-4325-a817-3a0cb0690c3d service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:23.789724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 959/1929] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:23.944427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c0386-97da-4902-a4f5-11d0c8c58bf9 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:24.006257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c0386-97da-4902-a4f5-11d0c8c58bf9 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:24.011520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:24.012521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:24.012796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:24.013097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] PATH_INFO: `/v3/users/54958b643e88455188f0fcc8f0b301f0` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:24.014294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=54958b643e88455188f0fcc8f0b301f0)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:24.016228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:24.067297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54958b643e88455188f0fcc8f0b301f0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.080094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54958b643e88455188f0fcc8f0b301f0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.080765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54958b643e88455188f0fcc8f0b301f0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.081369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54958b643e88455188f0fcc8f0b301f0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.088781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54958b643e88455188f0fcc8f0b301f0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.101018 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 971/1930] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:23 2022] DELETE /identity/v3/users/54958b643e88455188f0fcc8f0b301f0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:24.105637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294107d-18b2-4d00-9a7c-764e75bbcf7f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:24.105919 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294107d-18b2-4d00-9a7c-764e75bbcf7f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:24.106219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294107d-18b2-4d00-9a7c-764e75bbcf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:24.123878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-0294107d-18b2-4d00-9a7c-764e75bbcf7f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:24.125110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-0294107d-18b2-4d00-9a7c-764e75bbcf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:24.186619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 960/1931] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:24.196517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:24.198844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:24.265256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2ce20-dc13-49a5-bbdd-e85f5bb830ff admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:24.269026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc371d4-6f13-465f-8622-8c5a8dd710f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:24.269728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc371d4-6f13-465f-8622-8c5a8dd710f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:24.270057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc371d4-6f13-465f-8622-8c5a8dd710f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:24.270422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc371d4-6f13-465f-8622-8c5a8dd710f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:24.279651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc371d4-6f13-465f-8622-8c5a8dd710f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:24.281078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc371d4-6f13-465f-8622-8c5a8dd710f8 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:24.290189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 972/1932] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:24.557860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294107d-18b2-4d00-9a7c-764e75bbcf7f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:24.559319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-0294107d-18b2-4d00-9a7c-764e75bbcf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:24.571076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294107d-18b2-4d00-9a7c-764e75bbcf7f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:24.576940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:24.578059 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:24.578605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:24.579057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] PATH_INFO: `/v3/projects/16220beaefed4b11a6cfa9c5bbd42079` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:24.580632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] RBAC: Authorizing `identity:delete_project(project_id=16220beaefed4b11a6cfa9c5bbd42079)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:24.582792 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:24.632107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16220beaefed4b11a6cfa9c5bbd42079', 'request_id': 'req-d708f73f-b9db-4e44-8ed4-aa1c2726224f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.640974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16220beaefed4b11a6cfa9c5bbd42079', 'request_id': 'req-d708f73f-b9db-4e44-8ed4-aa1c2726224f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.647993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16220beaefed4b11a6cfa9c5bbd42079', 'request_id': 'req-d708f73f-b9db-4e44-8ed4-aa1c2726224f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.659407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] The token cache is being invalidate because project 16220beaefed4b11a6cfa9c5bbd42079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:24.659810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.660514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.662126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 961/1933] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:24 2022] DELETE /identity/v3/projects/16220beaefed4b11a6cfa9c5bbd42079 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:24.666909 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc371d4-6f13-465f-8622-8c5a8dd710f8 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:24.676819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc371d4-6f13-465f-8622-8c5a8dd710f8 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:24.731079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed858cd0-138e-4d36-a4ce-278bf0fe4893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:24.731934 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed858cd0-138e-4d36-a4ce-278bf0fe4893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:24.732214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed858cd0-138e-4d36-a4ce-278bf0fe4893 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:24.732487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed858cd0-138e-4d36-a4ce-278bf0fe4893 admin admin] PATH_INFO: `/v3/users/82f6cf39692d4caabda0f21adf14e8d0` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:24.733668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed858cd0-138e-4d36-a4ce-278bf0fe4893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f6cf39692d4caabda0f21adf14e8d0)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:24.735602 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed858cd0-138e-4d36-a4ce-278bf0fe4893 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:24.779260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-ed858cd0-138e-4d36-a4ce-278bf0fe4893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f6cf39692d4caabda0f21adf14e8d0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.790364 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-ed858cd0-138e-4d36-a4ce-278bf0fe4893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f6cf39692d4caabda0f21adf14e8d0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.791022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-ed858cd0-138e-4d36-a4ce-278bf0fe4893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f6cf39692d4caabda0f21adf14e8d0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.792271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-ed858cd0-138e-4d36-a4ce-278bf0fe4893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f6cf39692d4caabda0f21adf14e8d0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.798737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-ed858cd0-138e-4d36-a4ce-278bf0fe4893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f6cf39692d4caabda0f21adf14e8d0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:24.811760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 973/1934] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:24 2022] DELETE /identity/v3/users/82f6cf39692d4caabda0f21adf14e8d0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:25.160924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:25.162493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:25.181352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708f73f-b9db-4e44-8ed4-aa1c2726224f admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:25.240674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:25.241545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:25.241827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:25.242104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] PATH_INFO: `/v3/projects/0e847072ad66475fb25debf4fe9e26a6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:25.243319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e847072ad66475fb25debf4fe9e26a6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:25.245321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:25.289938 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e847072ad66475fb25debf4fe9e26a6', 'request_id': 'req-926950e9-3b9c-4c73-9c53-271790e22538'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:25.296832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e847072ad66475fb25debf4fe9e26a6', 'request_id': 'req-926950e9-3b9c-4c73-9c53-271790e22538'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:25.302013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e847072ad66475fb25debf4fe9e26a6', 'request_id': 'req-926950e9-3b9c-4c73-9c53-271790e22538'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:25.312834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] The token cache is being invalidate because project 0e847072ad66475fb25debf4fe9e26a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:25.313119 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:25.313744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-926950e9-3b9c-4c73-9c53-271790e22538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:25.315325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 962/1935] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:25 2022] DELETE /identity/v3/projects/0e847072ad66475fb25debf4fe9e26a6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:25.321051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1770616-0f33-404c-9700-bfc8a327c24e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:25.321339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1770616-0f33-404c-9700-bfc8a327c24e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:25.321616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1770616-0f33-404c-9700-bfc8a327c24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:25.339721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-e1770616-0f33-404c-9700-bfc8a327c24e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:25.340901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e1770616-0f33-404c-9700-bfc8a327c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:25.397235 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 974/1936] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:25.405600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a90dd-2ea6-470e-b6cf-3f4bb64aeab3 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:25.405889 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a90dd-2ea6-470e-b6cf-3f4bb64aeab3 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:25.406169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a90dd-2ea6-470e-b6cf-3f4bb64aeab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:25.424125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-4b5a90dd-2ea6-470e-b6cf-3f4bb64aeab3 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:25.425319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4b5a90dd-2ea6-470e-b6cf-3f4bb64aeab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:25.433872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 963/1937] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:25.438137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1770616-0f33-404c-9700-bfc8a327c24e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:25.448443 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1770616-0f33-404c-9700-bfc8a327c24e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:25.453005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301eb13-4eeb-4ac6-ab46-7019b215aec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:25.453653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301eb13-4eeb-4ac6-ab46-7019b215aec4 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:25.453936 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301eb13-4eeb-4ac6-ab46-7019b215aec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:25.454212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301eb13-4eeb-4ac6-ab46-7019b215aec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:25.454976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301eb13-4eeb-4ac6-ab46-7019b215aec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:25.455282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301eb13-4eeb-4ac6-ab46-7019b215aec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:25.456878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301eb13-4eeb-4ac6-ab46-7019b215aec4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:25.468840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 975/1938] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:47:25.473010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a90dd-2ea6-470e-b6cf-3f4bb64aeab3 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:25.482098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a90dd-2ea6-470e-b6cf-3f4bb64aeab3 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:25.487003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc98d48-8014-4c78-bd20-843df47ef8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:25.487646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc98d48-8014-4c78-bd20-843df47ef8ff admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:25.487926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc98d48-8014-4c78-bd20-843df47ef8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:25.488200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc98d48-8014-4c78-bd20-843df47ef8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:25.488891 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc98d48-8014-4c78-bd20-843df47ef8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:25.490826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc98d48-8014-4c78-bd20-843df47ef8ff admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:25.516073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 964/1939] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:25 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:25.520108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301eb13-4eeb-4ac6-ab46-7019b215aec4 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:25.532105 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301eb13-4eeb-4ac6-ab46-7019b215aec4 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:25.589109 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a47fe-911e-4478-b694-563a4ad0fca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:25.589774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a47fe-911e-4478-b694-563a4ad0fca6 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:25.590057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a47fe-911e-4478-b694-563a4ad0fca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:25.590354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a47fe-911e-4478-b694-563a4ad0fca6 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:25.591084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a47fe-911e-4478-b694-563a4ad0fca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:25.593001 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a47fe-911e-4478-b694-563a4ad0fca6 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:25.612156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 976/1940] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:25 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:25.616380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc98d48-8014-4c78-bd20-843df47ef8ff admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:25.626687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc98d48-8014-4c78-bd20-843df47ef8ff admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:25.631357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece99e-da67-412c-bd2c-f90c65e55c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:25.632014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece99e-da67-412c-bd2c-f90c65e55c45 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:25.632300 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece99e-da67-412c-bd2c-f90c65e55c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:25.632613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ece99e-da67-412c-bd2c-f90c65e55c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:25.633345 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ece99e-da67-412c-bd2c-f90c65e55c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:25.635688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ece99e-da67-412c-bd2c-f90c65e55c45 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:25.649352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 965/1941] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:25.650650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a47fe-911e-4478-b694-563a4ad0fca6 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:25.660962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a47fe-911e-4478-b694-563a4ad0fca6 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:25.665648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84860f7-8faa-41a4-8c99-864c9875191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:25.666495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84860f7-8faa-41a4-8c99-864c9875191b admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:25.666783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84860f7-8faa-41a4-8c99-864c9875191b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:25.667046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84860f7-8faa-41a4-8c99-864c9875191b admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:25.667788 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84860f7-8faa-41a4-8c99-864c9875191b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:25.669381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84860f7-8faa-41a4-8c99-864c9875191b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:25.680890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 977/1942] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:47:25.685863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece99e-da67-412c-bd2c-f90c65e55c45 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:25.697280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ece99e-da67-412c-bd2c-f90c65e55c45 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:25.703166 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b4c4-7462-49fc-b6ac-dcb0a7821137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:25.704173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b4c4-7462-49fc-b6ac-dcb0a7821137 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:25.704558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b4c4-7462-49fc-b6ac-dcb0a7821137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:25.704930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60b4c4-7462-49fc-b6ac-dcb0a7821137 admin admin] PATH_INFO: `/v3/projects/8d872318caa449019e29bc1127bcba0d/users/439249fa60264855adcb7e91d828f8de/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:25.721335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60b4c4-7462-49fc-b6ac-dcb0a7821137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d872318caa449019e29bc1127bcba0d, user_id=439249fa60264855adcb7e91d828f8de, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:25.723997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60b4c4-7462-49fc-b6ac-dcb0a7821137 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:25.738015 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 966/1943] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:25 2022] PUT /identity/v3/projects/8d872318caa449019e29bc1127bcba0d/users/439249fa60264855adcb7e91d828f8de/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:25.750115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8331d-05b1-414c-bccf-ae10a7d96327 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:25.750454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8331d-05b1-414c-bccf-ae10a7d96327 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:25.750757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8331d-05b1-414c-bccf-ae10a7d96327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:25.777442 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-68b8331d-05b1-414c-bccf-ae10a7d96327 None None] MFA Rules not processed for user `439249fa60264855adcb7e91d828f8de`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:25.778797 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-68b8331d-05b1-414c-bccf-ae10a7d96327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:25.862242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 978/1944] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:25.874407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b4c4-7462-49fc-b6ac-dcb0a7821137 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:25.876403 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ae60b4c4-7462-49fc-b6ac-dcb0a7821137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:25.934689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60b4c4-7462-49fc-b6ac-dcb0a7821137 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:25.938514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccf260-edd8-4d37-aea2-39ac28dfd873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:25.939176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccf260-edd8-4d37-aea2-39ac28dfd873 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:25.939462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccf260-edd8-4d37-aea2-39ac28dfd873 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:25.939739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccf260-edd8-4d37-aea2-39ac28dfd873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:25.948669 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccf260-edd8-4d37-aea2-39ac28dfd873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:25.950126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccf260-edd8-4d37-aea2-39ac28dfd873 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:25.959520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 967/1945] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:34.519099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8331d-05b1-414c-bccf-ae10a7d96327 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:34.521589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-68b8331d-05b1-414c-bccf-ae10a7d96327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:34.620166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8331d-05b1-414c-bccf-ae10a7d96327 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:34.625096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:34.625975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:34.626259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:34.626563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] PATH_INFO: `/v3/users/645587c08fcf4270bc0f6649db433cbb` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:34.627776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=645587c08fcf4270bc0f6649db433cbb)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:34.629690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:34.679870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645587c08fcf4270bc0f6649db433cbb'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:34.692906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645587c08fcf4270bc0f6649db433cbb'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:34.693564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645587c08fcf4270bc0f6649db433cbb'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:34.694422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645587c08fcf4270bc0f6649db433cbb'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:34.701859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645587c08fcf4270bc0f6649db433cbb'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:34.716974 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 979/1946] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:34 2022] DELETE /identity/v3/users/645587c08fcf4270bc0f6649db433cbb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:34.721699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544980aa-9bfc-4de4-9bd5-5775c31e84f7 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:34.722153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544980aa-9bfc-4de4-9bd5-5775c31e84f7 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:34.722229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544980aa-9bfc-4de4-9bd5-5775c31e84f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:34.741927 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-544980aa-9bfc-4de4-9bd5-5775c31e84f7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:34.743438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-544980aa-9bfc-4de4-9bd5-5775c31e84f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:34.816490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 968/1947] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:34.826366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:34.827788 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:34.901294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54ddec-84a7-4d1c-afa5-fcbd7fa69cee admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:34.908081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291ea76-454e-4701-be6d-9ade4bc4b14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:34.908904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ea76-454e-4701-be6d-9ade4bc4b14e service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:34.909341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ea76-454e-4701-be6d-9ade4bc4b14e service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:34.910515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291ea76-454e-4701-be6d-9ade4bc4b14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:34.927505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291ea76-454e-4701-be6d-9ade4bc4b14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:34.929708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291ea76-454e-4701-be6d-9ade4bc4b14e service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:34.942198 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 980/1948] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:35.555535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544980aa-9bfc-4de4-9bd5-5775c31e84f7 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:35.557199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-544980aa-9bfc-4de4-9bd5-5775c31e84f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:35.569820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544980aa-9bfc-4de4-9bd5-5775c31e84f7 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:35.575704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:35.576603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:35.576884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:35.577161 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] PATH_INFO: `/v3/projects/b7ee0cfed60d41858eda0df54431e059` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:35.578443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ee0cfed60d41858eda0df54431e059)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:35.580346 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:35.631532 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ee0cfed60d41858eda0df54431e059', 'request_id': 'req-cffe281f-468d-4fbd-91a6-a57328655065'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:35.645469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ee0cfed60d41858eda0df54431e059', 'request_id': 'req-cffe281f-468d-4fbd-91a6-a57328655065'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:35.652811 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ee0cfed60d41858eda0df54431e059', 'request_id': 'req-cffe281f-468d-4fbd-91a6-a57328655065'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:35.665155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] The token cache is being invalidate because project b7ee0cfed60d41858eda0df54431e059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:35.665557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:35.667121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:35.668920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 969/1949] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:35 2022] DELETE /identity/v3/projects/b7ee0cfed60d41858eda0df54431e059 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:35.673531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291ea76-454e-4701-be6d-9ade4bc4b14e service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:35.684523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291ea76-454e-4701-be6d-9ade4bc4b14e service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:35.749343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75adb895-265c-4cbd-80fa-9797a241a4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:35.750213 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adb895-265c-4cbd-80fa-9797a241a4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:35.750531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adb895-265c-4cbd-80fa-9797a241a4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:35.750806 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75adb895-265c-4cbd-80fa-9797a241a4d3 admin admin] PATH_INFO: `/v3/users/a1de4b34c2654932b46c453b8563ddd5` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:35.752085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75adb895-265c-4cbd-80fa-9797a241a4d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1de4b34c2654932b46c453b8563ddd5)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:35.754032 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75adb895-265c-4cbd-80fa-9797a241a4d3 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:35.855215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-75adb895-265c-4cbd-80fa-9797a241a4d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1de4b34c2654932b46c453b8563ddd5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:35.877480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-75adb895-265c-4cbd-80fa-9797a241a4d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1de4b34c2654932b46c453b8563ddd5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:35.878273 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-75adb895-265c-4cbd-80fa-9797a241a4d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1de4b34c2654932b46c453b8563ddd5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:35.878964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-75adb895-265c-4cbd-80fa-9797a241a4d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1de4b34c2654932b46c453b8563ddd5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:35.887199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-75adb895-265c-4cbd-80fa-9797a241a4d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1de4b34c2654932b46c453b8563ddd5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:35.940977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 981/1950] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:35 2022] DELETE /identity/v3/users/a1de4b34c2654932b46c453b8563ddd5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:36.319235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:36.321173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:36.354030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe281f-468d-4fbd-91a6-a57328655065 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:36.423592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:36.424436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:36.424720 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:36.425232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] PATH_INFO: `/v3/projects/26b3303be1b246b399d18a1da032e748` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:36.427359 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b3303be1b246b399d18a1da032e748)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:36.429947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:36.481759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b3303be1b246b399d18a1da032e748', 'request_id': 'req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:36.488620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b3303be1b246b399d18a1da032e748', 'request_id': 'req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:36.495922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b3303be1b246b399d18a1da032e748', 'request_id': 'req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:36.509002 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] The token cache is being invalidate because project 26b3303be1b246b399d18a1da032e748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:36.509303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:36.511218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-22341a10-a6bd-40e2-8f57-0d13c0c1e4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:36.513211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 970/1951] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:36 2022] DELETE /identity/v3/projects/26b3303be1b246b399d18a1da032e748 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:36.518809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e7e5d-eb4f-4c76-9706-60b5a6253875 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:36.519108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e7e5d-eb4f-4c76-9706-60b5a6253875 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:36.519390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e7e5d-eb4f-4c76-9706-60b5a6253875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:36.542096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c80e7e5d-eb4f-4c76-9706-60b5a6253875 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:36.543351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c80e7e5d-eb4f-4c76-9706-60b5a6253875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:36.618261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 982/1952] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:36.626513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff0d24-98a7-4047-8d8b-5b8d9d6794d8 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:36.626802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff0d24-98a7-4047-8d8b-5b8d9d6794d8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:36.627077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff0d24-98a7-4047-8d8b-5b8d9d6794d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:36.657568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-1aff0d24-98a7-4047-8d8b-5b8d9d6794d8 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:36.659513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1aff0d24-98a7-4047-8d8b-5b8d9d6794d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:36.686102 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 971/1953] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:36.686611 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e7e5d-eb4f-4c76-9706-60b5a6253875 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:36.699331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e7e5d-eb4f-4c76-9706-60b5a6253875 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:36.706148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d36b02-aa00-4956-9ef3-2b8cc9e565d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:36.706871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d36b02-aa00-4956-9ef3-2b8cc9e565d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:36.707156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d36b02-aa00-4956-9ef3-2b8cc9e565d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:36.707435 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d36b02-aa00-4956-9ef3-2b8cc9e565d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:36.708370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d36b02-aa00-4956-9ef3-2b8cc9e565d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:36.708884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d36b02-aa00-4956-9ef3-2b8cc9e565d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:36.710810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d36b02-aa00-4956-9ef3-2b8cc9e565d8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:36.724018 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 983/1954] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:47:36.728851 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff0d24-98a7-4047-8d8b-5b8d9d6794d8 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:36.740364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff0d24-98a7-4047-8d8b-5b8d9d6794d8 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:36.747387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a769d50-3198-43f0-9777-ae2f69f29679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:36.748393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a769d50-3198-43f0-9777-ae2f69f29679 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:36.748775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a769d50-3198-43f0-9777-ae2f69f29679 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:36.749062 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a769d50-3198-43f0-9777-ae2f69f29679 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:36.749769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a769d50-3198-43f0-9777-ae2f69f29679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:36.751746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a769d50-3198-43f0-9777-ae2f69f29679 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:36.787914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 972/1955] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:36 2022] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:36.792141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d36b02-aa00-4956-9ef3-2b8cc9e565d8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:36.802220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d36b02-aa00-4956-9ef3-2b8cc9e565d8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:36.873982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaee97a-8160-4256-ab29-77cab721aba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:36.874690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaee97a-8160-4256-ab29-77cab721aba4 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:36.874973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaee97a-8160-4256-ab29-77cab721aba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:36.875247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaee97a-8160-4256-ab29-77cab721aba4 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:36.875942 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaee97a-8160-4256-ab29-77cab721aba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:36.877870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaee97a-8160-4256-ab29-77cab721aba4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:36.902689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 984/1956] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:36 2022] POST /identity/v3/users => generated 305 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:36.903841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a769d50-3198-43f0-9777-ae2f69f29679 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:36.914428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a769d50-3198-43f0-9777-ae2f69f29679 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:36.920491 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f41c63-a656-44af-8024-4369ecc84176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:36.921278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f41c63-a656-44af-8024-4369ecc84176 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:36.922007 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f41c63-a656-44af-8024-4369ecc84176 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:36.922419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f41c63-a656-44af-8024-4369ecc84176 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:36.923579 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f41c63-a656-44af-8024-4369ecc84176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:36.925597 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f41c63-a656-44af-8024-4369ecc84176 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:36.954733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 973/1957] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:36.955844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaee97a-8160-4256-ab29-77cab721aba4 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:36.967178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaee97a-8160-4256-ab29-77cab721aba4 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:36.972148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddc575-d683-4b45-92cd-4b3467503c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:36.972816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc575-d683-4b45-92cd-4b3467503c26 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:36.973097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc575-d683-4b45-92cd-4b3467503c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:36.973378 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc575-d683-4b45-92cd-4b3467503c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:36.975062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddc575-d683-4b45-92cd-4b3467503c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:36.976902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddc575-d683-4b45-92cd-4b3467503c26 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:36.995049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 985/1958] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:36.996425 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f41c63-a656-44af-8024-4369ecc84176 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:37.014038 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f41c63-a656-44af-8024-4369ecc84176 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:37.020735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05379e47-2e1e-46a8-bcb1-a12d3d3a863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:37.021974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05379e47-2e1e-46a8-bcb1-a12d3d3a863b admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.022436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05379e47-2e1e-46a8-bcb1-a12d3d3a863b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.022791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05379e47-2e1e-46a8-bcb1-a12d3d3a863b admin admin] PATH_INFO: `/v3/projects/ddb330ced7ec4119b19a29e3b8f03b9c/users/4d02d626a3124d4d823b6e7079214897/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.040537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05379e47-2e1e-46a8-bcb1-a12d3d3a863b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb330ced7ec4119b19a29e3b8f03b9c, user_id=4d02d626a3124d4d823b6e7079214897, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:37.044056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05379e47-2e1e-46a8-bcb1-a12d3d3a863b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:37.057192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 974/1959] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:36 2022] PUT /identity/v3/projects/ddb330ced7ec4119b19a29e3b8f03b9c/users/4d02d626a3124d4d823b6e7079214897/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:37.069096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aae783-261d-475a-9ee1-9ea959ce16dc None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.069386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aae783-261d-475a-9ee1-9ea959ce16dc None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.069665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aae783-261d-475a-9ee1-9ea959ce16dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.096239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f0aae783-261d-475a-9ee1-9ea959ce16dc None None] MFA Rules not processed for user `4d02d626a3124d4d823b6e7079214897`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:37.097479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f0aae783-261d-475a-9ee1-9ea959ce16dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:37.170353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 986/1960] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:37.174990 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05379e47-2e1e-46a8-bcb1-a12d3d3a863b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:37.247806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05379e47-2e1e-46a8-bcb1-a12d3d3a863b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:37.255397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6dc04-97a6-4bdf-add6-8d3b7af6b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:37.256137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dc04-97a6-4bdf-add6-8d3b7af6b2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.257009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dc04-97a6-4bdf-add6-8d3b7af6b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.257304 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6dc04-97a6-4bdf-add6-8d3b7af6b2b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.258077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6dc04-97a6-4bdf-add6-8d3b7af6b2b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:37.261982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6dc04-97a6-4bdf-add6-8d3b7af6b2b9 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:37.288092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 975/1961] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:37 2022] POST /identity/v3/projects => generated 409 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:37.292004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aae783-261d-475a-9ee1-9ea959ce16dc None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:37.302761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aae783-261d-475a-9ee1-9ea959ce16dc None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:37.373852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b55e5-0fd0-42ce-a215-fdec74a236e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:37.374934 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b55e5-0fd0-42ce-a215-fdec74a236e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.375393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b55e5-0fd0-42ce-a215-fdec74a236e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.376477 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b55e5-0fd0-42ce-a215-fdec74a236e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.376622 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b55e5-0fd0-42ce-a215-fdec74a236e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:37.379138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b55e5-0fd0-42ce-a215-fdec74a236e5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:37.401639 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 987/1962] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:37 2022] POST /identity/v3/users => generated 311 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:37.403075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6dc04-97a6-4bdf-add6-8d3b7af6b2b9 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:37.423979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6dc04-97a6-4bdf-add6-8d3b7af6b2b9 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:37.432252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a891e7-06e0-4f55-a2a5-9f561589c29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:37.432993 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b55e5-0fd0-42ce-a215-fdec74a236e5 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:37.433290 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a891e7-06e0-4f55-a2a5-9f561589c29f admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.433700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a891e7-06e0-4f55-a2a5-9f561589c29f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.434458 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a891e7-06e0-4f55-a2a5-9f561589c29f admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.435228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ab4b55e5-0fd0-42ce-a215-fdec74a236e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:37.435466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a891e7-06e0-4f55-a2a5-9f561589c29f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:37.449497 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a891e7-06e0-4f55-a2a5-9f561589c29f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:37.450521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b55e5-0fd0-42ce-a215-fdec74a236e5 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:37.455860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bd084-58e2-4aca-af84-cba029a703b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:37.457618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bd084-58e2-4aca-af84-cba029a703b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.457967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bd084-58e2-4aca-af84-cba029a703b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.458618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bd084-58e2-4aca-af84-cba029a703b4 admin admin] PATH_INFO: `/v3/users/f4c25f712b4e46a5bba6fb8960420b16` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.459959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bd084-58e2-4aca-af84-cba029a703b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c25f712b4e46a5bba6fb8960420b16)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:37.462079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bd084-58e2-4aca-af84-cba029a703b4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:37.479905 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 976/1963] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:47:37.484739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a891e7-06e0-4f55-a2a5-9f561589c29f admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:37.496487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a891e7-06e0-4f55-a2a5-9f561589c29f admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:37.501823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419cb02-76c7-4676-952b-c9c3fd24e254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:37.502806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419cb02-76c7-4676-952b-c9c3fd24e254 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.503158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419cb02-76c7-4676-952b-c9c3fd24e254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.503443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419cb02-76c7-4676-952b-c9c3fd24e254 admin admin] PATH_INFO: `/v3/projects/d1b2bbcdab634685949add6b4dea7c1f/users/612fc16a3d4e40ac8db47d00b779dd1c/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.513061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-693bd084-58e2-4aca-af84-cba029a703b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c25f712b4e46a5bba6fb8960420b16'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:37.520654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419cb02-76c7-4676-952b-c9c3fd24e254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b2bbcdab634685949add6b4dea7c1f, user_id=612fc16a3d4e40ac8db47d00b779dd1c, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:37.523418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419cb02-76c7-4676-952b-c9c3fd24e254 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:37.524603 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-693bd084-58e2-4aca-af84-cba029a703b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c25f712b4e46a5bba6fb8960420b16'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:37.525359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-693bd084-58e2-4aca-af84-cba029a703b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c25f712b4e46a5bba6fb8960420b16'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:37.526191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-693bd084-58e2-4aca-af84-cba029a703b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c25f712b4e46a5bba6fb8960420b16'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:37.533464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-693bd084-58e2-4aca-af84-cba029a703b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c25f712b4e46a5bba6fb8960420b16'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:37.536644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 977/1964] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:37 2022] PUT /identity/v3/projects/d1b2bbcdab634685949add6b4dea7c1f/users/612fc16a3d4e40ac8db47d00b779dd1c/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:37.541527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419cb02-76c7-4676-952b-c9c3fd24e254 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:37.543266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-5419cb02-76c7-4676-952b-c9c3fd24e254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:37.548486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 988/1965] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:37 2022] DELETE /identity/v3/users/f4c25f712b4e46a5bba6fb8960420b16 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:37.553453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b034cd-fa3f-4c07-a95d-e9cd626ab75f None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.553786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b034cd-fa3f-4c07-a95d-e9cd626ab75f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.554061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b034cd-fa3f-4c07-a95d-e9cd626ab75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.572544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-01b034cd-fa3f-4c07-a95d-e9cd626ab75f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:37.573866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-01b034cd-fa3f-4c07-a95d-e9cd626ab75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:37.617239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419cb02-76c7-4676-952b-c9c3fd24e254 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:37.640340 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 989/1966] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:37.649837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b034cd-fa3f-4c07-a95d-e9cd626ab75f None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:37.651350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-01b034cd-fa3f-4c07-a95d-e9cd626ab75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:37.682118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53406c9-2c5c-473b-a699-e3675640fc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:37.682978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53406c9-2c5c-473b-a699-e3675640fc68 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.683373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53406c9-2c5c-473b-a699-e3675640fc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.683746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53406c9-2c5c-473b-a699-e3675640fc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.684603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53406c9-2c5c-473b-a699-e3675640fc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:37.686513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53406c9-2c5c-473b-a699-e3675640fc68 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:37.697261 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 978/1967] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:47:37.701172 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53406c9-2c5c-473b-a699-e3675640fc68 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:37.711936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53406c9-2c5c-473b-a699-e3675640fc68 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:37.717622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca99ccc-aa10-4bc3-8073-36ce6449c101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:37.718598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca99ccc-aa10-4bc3-8073-36ce6449c101 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.718884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca99ccc-aa10-4bc3-8073-36ce6449c101 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.719159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca99ccc-aa10-4bc3-8073-36ce6449c101 admin admin] PATH_INFO: `/v3/projects/d1b2bbcdab634685949add6b4dea7c1f/users/612fc16a3d4e40ac8db47d00b779dd1c/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.721142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca99ccc-aa10-4bc3-8073-36ce6449c101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b2bbcdab634685949add6b4dea7c1f, user_id=612fc16a3d4e40ac8db47d00b779dd1c, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:37.724967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca99ccc-aa10-4bc3-8073-36ce6449c101 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:37.731567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b034cd-fa3f-4c07-a95d-e9cd626ab75f None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:37.740292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 979/1968] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:37 2022] PUT /identity/v3/projects/d1b2bbcdab634685949add6b4dea7c1f/users/612fc16a3d4e40ac8db47d00b779dd1c/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:37.751326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72799b-37fc-42ec-994e-e6ba4aa1df66 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.751752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72799b-37fc-42ec-994e-e6ba4aa1df66 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.752908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72799b-37fc-42ec-994e-e6ba4aa1df66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.780851 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-2f72799b-37fc-42ec-994e-e6ba4aa1df66 None None] MFA Rules not processed for user `612fc16a3d4e40ac8db47d00b779dd1c`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:37.782124 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2f72799b-37fc-42ec-994e-e6ba4aa1df66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:37.791759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dce2d-3643-4505-a09e-606b5b809d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:37.791759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dce2d-3643-4505-a09e-606b5b809d37 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.791759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dce2d-3643-4505-a09e-606b5b809d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.791759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dce2d-3643-4505-a09e-606b5b809d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.859991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dce2d-3643-4505-a09e-606b5b809d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:37.861695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dce2d-3643-4505-a09e-606b5b809d37 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:37.868919 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 980/1969] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:37 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:37.878521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 990/1970] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:47:37.881239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72799b-37fc-42ec-994e-e6ba4aa1df66 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:37.882674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2f72799b-37fc-42ec-994e-e6ba4aa1df66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:37.955038 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72799b-37fc-42ec-994e-e6ba4aa1df66 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:37.960456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e954d0c-e085-4c72-949e-73523e161892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:37.961103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954d0c-e085-4c72-949e-73523e161892 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:37.961390 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954d0c-e085-4c72-949e-73523e161892 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:37.961667 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e954d0c-e085-4c72-949e-73523e161892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:37.972564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e954d0c-e085-4c72-949e-73523e161892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:37.974088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e954d0c-e085-4c72-949e-73523e161892 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:37.984836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 981/1971] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:38.170505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dce2d-3643-4505-a09e-606b5b809d37 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:38.181419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dce2d-3643-4505-a09e-606b5b809d37 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:38.185272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d75d89-db04-4952-b24f-632953dfce9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:38.186282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d75d89-db04-4952-b24f-632953dfce9a service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:38.186687 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d75d89-db04-4952-b24f-632953dfce9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:38.187056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d75d89-db04-4952-b24f-632953dfce9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:38.189268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-67d75d89-db04-4952-b24f-632953dfce9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:38.285131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e954d0c-e085-4c72-949e-73523e161892 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:38.285661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d75d89-db04-4952-b24f-632953dfce9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:38.287115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4e954d0c-e085-4c72-949e-73523e161892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:38.287698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d75d89-db04-4952-b24f-632953dfce9a service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:38.298860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 991/1972] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:38 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:38.310249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e954d0c-e085-4c72-949e-73523e161892 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:38.329709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:38.330771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:38.331318 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:38.332056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] PATH_INFO: `/v3/projects/7a6f47da46b743f4bfdf8c0ea70e05b2` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:38.333356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6f47da46b743f4bfdf8c0ea70e05b2)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:38.335873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:38.427913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6f47da46b743f4bfdf8c0ea70e05b2', 'request_id': 'req-3794925b-aa09-4977-8dc3-07dc73158136'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:38.452933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6f47da46b743f4bfdf8c0ea70e05b2', 'request_id': 'req-3794925b-aa09-4977-8dc3-07dc73158136'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:38.460825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6f47da46b743f4bfdf8c0ea70e05b2', 'request_id': 'req-3794925b-aa09-4977-8dc3-07dc73158136'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:38.477776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] The token cache is being invalidate because project 7a6f47da46b743f4bfdf8c0ea70e05b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:38.479169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:38.480274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:38.482302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 982/1973] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:38 2022] DELETE /identity/v3/projects/7a6f47da46b743f4bfdf8c0ea70e05b2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:38.486952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d75d89-db04-4952-b24f-632953dfce9a service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:38.507370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d75d89-db04-4952-b24f-632953dfce9a service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:38.607965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da12e8-acbc-4a11-adaf-c207a17ccfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:38.609349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da12e8-acbc-4a11-adaf-c207a17ccfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:38.610180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da12e8-acbc-4a11-adaf-c207a17ccfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:38.610657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da12e8-acbc-4a11-adaf-c207a17ccfc3 admin admin] PATH_INFO: `/v3/users/ca138461d1e24d6c9981b260b62243ea` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:38.614045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da12e8-acbc-4a11-adaf-c207a17ccfc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca138461d1e24d6c9981b260b62243ea)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:38.616326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da12e8-acbc-4a11-adaf-c207a17ccfc3 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:38.711672 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b6da12e8-acbc-4a11-adaf-c207a17ccfc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca138461d1e24d6c9981b260b62243ea'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:38.730455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b6da12e8-acbc-4a11-adaf-c207a17ccfc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca138461d1e24d6c9981b260b62243ea'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:38.731534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b6da12e8-acbc-4a11-adaf-c207a17ccfc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca138461d1e24d6c9981b260b62243ea'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:38.732570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b6da12e8-acbc-4a11-adaf-c207a17ccfc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca138461d1e24d6c9981b260b62243ea'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:38.742220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b6da12e8-acbc-4a11-adaf-c207a17ccfc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca138461d1e24d6c9981b260b62243ea'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:38.756954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 992/1974] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:38 2022] DELETE /identity/v3/users/ca138461d1e24d6c9981b260b62243ea => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:39.029146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:39.031193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:39.056062 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794925b-aa09-4977-8dc3-07dc73158136 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:39.126657 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:39.127518 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.127802 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.128081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] PATH_INFO: `/v3/projects/c4176c990dc24685b2f0e8fe2308517f` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.129262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4176c990dc24685b2f0e8fe2308517f)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:39.131214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:39.176017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4176c990dc24685b2f0e8fe2308517f', 'request_id': 'req-64c70d15-ee84-4241-be8a-b70557765af1'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:39.183795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4176c990dc24685b2f0e8fe2308517f', 'request_id': 'req-64c70d15-ee84-4241-be8a-b70557765af1'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:39.189308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4176c990dc24685b2f0e8fe2308517f', 'request_id': 'req-64c70d15-ee84-4241-be8a-b70557765af1'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:39.200203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] The token cache is being invalidate because project c4176c990dc24685b2f0e8fe2308517f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:39.200489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:39.201132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-64c70d15-ee84-4241-be8a-b70557765af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:39.202839 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 983/1975] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:39 2022] DELETE /identity/v3/projects/c4176c990dc24685b2f0e8fe2308517f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:39.207695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58bf56-598e-4d08-823a-a000d3f474af None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.207988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58bf56-598e-4d08-823a-a000d3f474af None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.208311 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58bf56-598e-4d08-823a-a000d3f474af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.226337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-cc58bf56-598e-4d08-823a-a000d3f474af None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:39.227543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-cc58bf56-598e-4d08-823a-a000d3f474af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:39.290261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 993/1976] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:39.298748 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca921008-7062-45ff-b02d-b126a9a1385d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.298907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca921008-7062-45ff-b02d-b126a9a1385d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.299343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca921008-7062-45ff-b02d-b126a9a1385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.318984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-ca921008-7062-45ff-b02d-b126a9a1385d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:39.320422 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ca921008-7062-45ff-b02d-b126a9a1385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:39.328954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 984/1977] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:39.332986 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58bf56-598e-4d08-823a-a000d3f474af None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:39.344036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58bf56-598e-4d08-823a-a000d3f474af None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:39.349332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29258540-c115-4f71-9a1b-888a2047abca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:39.350003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29258540-c115-4f71-9a1b-888a2047abca admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.350286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29258540-c115-4f71-9a1b-888a2047abca admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.350605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29258540-c115-4f71-9a1b-888a2047abca admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.351344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29258540-c115-4f71-9a1b-888a2047abca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:39.351650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29258540-c115-4f71-9a1b-888a2047abca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:39.353267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29258540-c115-4f71-9a1b-888a2047abca admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:39.370618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 994/1978] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:47:39.372198 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca921008-7062-45ff-b02d-b126a9a1385d None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:39.381552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca921008-7062-45ff-b02d-b126a9a1385d None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:39.386758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdacbb7-599d-49c0-b92d-543143a091db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:39.387568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdacbb7-599d-49c0-b92d-543143a091db admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.387920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdacbb7-599d-49c0-b92d-543143a091db admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.388263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdacbb7-599d-49c0-b92d-543143a091db admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.389144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdacbb7-599d-49c0-b92d-543143a091db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:39.391380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdacbb7-599d-49c0-b92d-543143a091db admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:39.425483 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 985/1979] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:39 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:39.426772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29258540-c115-4f71-9a1b-888a2047abca admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:39.439093 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29258540-c115-4f71-9a1b-888a2047abca admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:39.502018 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513815a-cd63-45e7-9646-00048fb991df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:39.502728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513815a-cd63-45e7-9646-00048fb991df admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.503009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513815a-cd63-45e7-9646-00048fb991df admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.503280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513815a-cd63-45e7-9646-00048fb991df admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.503965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513815a-cd63-45e7-9646-00048fb991df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:39.506149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513815a-cd63-45e7-9646-00048fb991df admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:39.528265 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 995/1980] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:39 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:39.532201 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdacbb7-599d-49c0-b92d-543143a091db admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:39.542579 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdacbb7-599d-49c0-b92d-543143a091db admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:39.547298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95daac7-23b7-43ef-9492-6cb228488492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:39.547959 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95daac7-23b7-43ef-9492-6cb228488492 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.548243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95daac7-23b7-43ef-9492-6cb228488492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.548517 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95daac7-23b7-43ef-9492-6cb228488492 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.549245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95daac7-23b7-43ef-9492-6cb228488492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:39.550869 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95daac7-23b7-43ef-9492-6cb228488492 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:39.561752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 986/1981] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:39.565810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513815a-cd63-45e7-9646-00048fb991df admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:39.576458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513815a-cd63-45e7-9646-00048fb991df admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:39.581459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd0929-464d-496d-857b-09cad4664318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:39.582120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd0929-464d-496d-857b-09cad4664318 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.582434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd0929-464d-496d-857b-09cad4664318 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.582716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd0929-464d-496d-857b-09cad4664318 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.583450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd0929-464d-496d-857b-09cad4664318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:39.585050 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd0929-464d-496d-857b-09cad4664318 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:39.598354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 996/1982] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:47:39.601701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95daac7-23b7-43ef-9492-6cb228488492 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:39.612645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95daac7-23b7-43ef-9492-6cb228488492 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:39.617283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c06bd-fca8-4703-af82-0beaee79366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:39.618193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c06bd-fca8-4703-af82-0beaee79366e admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.618510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c06bd-fca8-4703-af82-0beaee79366e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.618787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c06bd-fca8-4703-af82-0beaee79366e admin admin] PATH_INFO: `/v3/projects/4804c201d5aa4a88ab7d289c4922695a/users/f15835dc8f454b3ea58d7c34c78f2f7b/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.634935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c06bd-fca8-4703-af82-0beaee79366e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4804c201d5aa4a88ab7d289c4922695a, user_id=f15835dc8f454b3ea58d7c34c78f2f7b, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:39.637588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c06bd-fca8-4703-af82-0beaee79366e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:39.654612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 987/1983] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:39 2022] PUT /identity/v3/projects/4804c201d5aa4a88ab7d289c4922695a/users/f15835dc8f454b3ea58d7c34c78f2f7b/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:39.665005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb1e0-09d3-4d64-9f55-1fcabd8b2c1f None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.665305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb1e0-09d3-4d64-9f55-1fcabd8b2c1f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.665587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb1e0-09d3-4d64-9f55-1fcabd8b2c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.698707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-454cb1e0-09d3-4d64-9f55-1fcabd8b2c1f None None] MFA Rules not processed for user `f15835dc8f454b3ea58d7c34c78f2f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:39.699869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-454cb1e0-09d3-4d64-9f55-1fcabd8b2c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:39.791521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 997/1984] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:39.796061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c06bd-fca8-4703-af82-0beaee79366e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:39.878140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c06bd-fca8-4703-af82-0beaee79366e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:39.882932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7acfb-8a76-4c36-b27e-09a06e5069b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:39.883676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7acfb-8a76-4c36-b27e-09a06e5069b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.883961 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7acfb-8a76-4c36-b27e-09a06e5069b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.884266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7acfb-8a76-4c36-b27e-09a06e5069b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.885565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7acfb-8a76-4c36-b27e-09a06e5069b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:39.887660 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7acfb-8a76-4c36-b27e-09a06e5069b3 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:39.916149 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 988/1985] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:39 2022] POST /identity/v3/projects => generated 391 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:39.920253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb1e0-09d3-4d64-9f55-1fcabd8b2c1f None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:39.932224 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb1e0-09d3-4d64-9f55-1fcabd8b2c1f None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:39.988812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b8cf8-34a2-4c24-b266-835d3525d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:39.989514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8cf8-34a2-4c24-b266-835d3525d6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:39.989806 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8cf8-34a2-4c24-b266-835d3525d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:39.990114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b8cf8-34a2-4c24-b266-835d3525d6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:39.990850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b8cf8-34a2-4c24-b266-835d3525d6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:39.992858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b8cf8-34a2-4c24-b266-835d3525d6e2 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:40.013866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 998/1986] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:39 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:40.017610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7acfb-8a76-4c36-b27e-09a06e5069b3 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:40.029070 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7acfb-8a76-4c36-b27e-09a06e5069b3 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:40.033851 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a9ee8-348a-4f0f-91b9-844d27442d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:40.034562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9ee8-348a-4f0f-91b9-844d27442d0e admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:40.034983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9ee8-348a-4f0f-91b9-844d27442d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:40.035239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9ee8-348a-4f0f-91b9-844d27442d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:40.035966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a9ee8-348a-4f0f-91b9-844d27442d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:40.037578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a9ee8-348a-4f0f-91b9-844d27442d0e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:40.048758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 989/1987] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:40.052933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b8cf8-34a2-4c24-b266-835d3525d6e2 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:40.063524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b8cf8-34a2-4c24-b266-835d3525d6e2 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:40.068824 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb2b61-1a68-45f0-b476-285be19c4b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:40.069804 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2b61-1a68-45f0-b476-285be19c4b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:40.070157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2b61-1a68-45f0-b476-285be19c4b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:40.070498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2b61-1a68-45f0-b476-285be19c4b86 admin admin] PATH_INFO: `/v3/projects/b8a55b768a0040e6bc44a360f360b0ec/users/cea5f4ced984421a8d05de75e7f1f565/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:40.089616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb2b61-1a68-45f0-b476-285be19c4b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a55b768a0040e6bc44a360f360b0ec, user_id=cea5f4ced984421a8d05de75e7f1f565, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:40.092323 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb2b61-1a68-45f0-b476-285be19c4b86 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:40.106460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 999/1988] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:40 2022] PUT /identity/v3/projects/b8a55b768a0040e6bc44a360f360b0ec/users/cea5f4ced984421a8d05de75e7f1f565/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:40.110510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a9ee8-348a-4f0f-91b9-844d27442d0e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:40.120512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a9ee8-348a-4f0f-91b9-844d27442d0e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:40.180405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96143552-3afb-46ed-876e-5c54eee206ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:40.180405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143552-3afb-46ed-876e-5c54eee206ec admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:40.180405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143552-3afb-46ed-876e-5c54eee206ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:40.180405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143552-3afb-46ed-876e-5c54eee206ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:40.180757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96143552-3afb-46ed-876e-5c54eee206ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:40.180757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96143552-3afb-46ed-876e-5c54eee206ec admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:40.189578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 990/1989] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:40.193564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb2b61-1a68-45f0-b476-285be19c4b86 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:40.203874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb2b61-1a68-45f0-b476-285be19c4b86 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:40.208554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982228-6d6a-4651-afc5-dedea9422f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:40.209429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982228-6d6a-4651-afc5-dedea9422f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:40.209710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982228-6d6a-4651-afc5-dedea9422f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:40.209982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de982228-6d6a-4651-afc5-dedea9422f4a admin admin] PATH_INFO: `/v3/projects/b8a55b768a0040e6bc44a360f360b0ec/users/cea5f4ced984421a8d05de75e7f1f565/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:40.212048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982228-6d6a-4651-afc5-dedea9422f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a55b768a0040e6bc44a360f360b0ec, user_id=cea5f4ced984421a8d05de75e7f1f565, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:40.215965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de982228-6d6a-4651-afc5-dedea9422f4a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:40.227798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1000/1990] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:40 2022] PUT /identity/v3/projects/b8a55b768a0040e6bc44a360f360b0ec/users/cea5f4ced984421a8d05de75e7f1f565/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:40.242362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4adcd-15e1-4cfd-864e-cd6c01ff60ac None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:40.242651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4adcd-15e1-4cfd-864e-cd6c01ff60ac None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:40.242929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4adcd-15e1-4cfd-864e-cd6c01ff60ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:40.268754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-f6e4adcd-15e1-4cfd-864e-cd6c01ff60ac None None] MFA Rules not processed for user `cea5f4ced984421a8d05de75e7f1f565`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:40.269950 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f6e4adcd-15e1-4cfd-864e-cd6c01ff60ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:40.340540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 991/1991] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:40.351325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982228-6d6a-4651-afc5-dedea9422f4a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:40.353039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-de982228-6d6a-4651-afc5-dedea9422f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:40.408603 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de982228-6d6a-4651-afc5-dedea9422f4a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:40.412230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad7d6c-bed3-4e66-9e39-1bf5cdb47a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:40.412871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad7d6c-bed3-4e66-9e39-1bf5cdb47a76 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:40.413154 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad7d6c-bed3-4e66-9e39-1bf5cdb47a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:40.413430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad7d6c-bed3-4e66-9e39-1bf5cdb47a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:40.422289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad7d6c-bed3-4e66-9e39-1bf5cdb47a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:40.423819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad7d6c-bed3-4e66-9e39-1bf5cdb47a76 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:40.433373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1001/1992] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:47:40.479227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4adcd-15e1-4cfd-864e-cd6c01ff60ac None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:40.480640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f6e4adcd-15e1-4cfd-864e-cd6c01ff60ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:40.492299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4adcd-15e1-4cfd-864e-cd6c01ff60ac None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:40.496189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5804e-1658-47cc-b1c1-0d4e48c692d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:40.496830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5804e-1658-47cc-b1c1-0d4e48c692d1 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:40.497113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5804e-1658-47cc-b1c1-0d4e48c692d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:40.497387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5804e-1658-47cc-b1c1-0d4e48c692d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:40.553965 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5804e-1658-47cc-b1c1-0d4e48c692d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:40.555511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5804e-1658-47cc-b1c1-0d4e48c692d1 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:40.565750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 992/1993] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:50.110054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad7d6c-bed3-4e66-9e39-1bf5cdb47a76 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:50.177967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad7d6c-bed3-4e66-9e39-1bf5cdb47a76 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:50.183562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:50.184764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:50.185060 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:50.185384 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] PATH_INFO: `/v3/users/f15835dc8f454b3ea58d7c34c78f2f7b` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:50.186998 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15835dc8f454b3ea58d7c34c78f2f7b)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:50.189072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:50.236597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15835dc8f454b3ea58d7c34c78f2f7b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.250046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15835dc8f454b3ea58d7c34c78f2f7b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.250999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15835dc8f454b3ea58d7c34c78f2f7b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.251570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15835dc8f454b3ea58d7c34c78f2f7b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.258226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15835dc8f454b3ea58d7c34c78f2f7b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.271647 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1002/1994] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:50 2022] DELETE /identity/v3/users/f15835dc8f454b3ea58d7c34c78f2f7b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:50.277288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5c1a3-4656-47b8-8ed2-30c57e967b98 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:50.277778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5c1a3-4656-47b8-8ed2-30c57e967b98 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:50.277975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5c1a3-4656-47b8-8ed2-30c57e967b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:50.295876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-18e5c1a3-4656-47b8-8ed2-30c57e967b98 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:50.297057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-18e5c1a3-4656-47b8-8ed2-30c57e967b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:50.355853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 993/1995] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:50.366248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:50.367684 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:50.424296 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074bcd4-8451-4d8b-ad62-727517b10dd4 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:50.428208 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb56c2-fb69-4877-bd1c-3a3280d073fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:50.428848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb56c2-fb69-4877-bd1c-3a3280d073fd service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:50.429128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb56c2-fb69-4877-bd1c-3a3280d073fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:50.429400 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb56c2-fb69-4877-bd1c-3a3280d073fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:50.445446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb56c2-fb69-4877-bd1c-3a3280d073fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:50.447264 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb56c2-fb69-4877-bd1c-3a3280d073fd service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:50.457540 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1003/1996] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:50.715328 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5c1a3-4656-47b8-8ed2-30c57e967b98 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:50.716975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-18e5c1a3-4656-47b8-8ed2-30c57e967b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:50.729850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5c1a3-4656-47b8-8ed2-30c57e967b98 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:50.734763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:50.735780 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:50.736540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:50.736818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] PATH_INFO: `/v3/projects/4804c201d5aa4a88ab7d289c4922695a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:50.738031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4804c201d5aa4a88ab7d289c4922695a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:50.739970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:50.787181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4804c201d5aa4a88ab7d289c4922695a', 'request_id': 'req-aef1acc1-4990-47e8-96e9-a7bda3f98293'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.796788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4804c201d5aa4a88ab7d289c4922695a', 'request_id': 'req-aef1acc1-4990-47e8-96e9-a7bda3f98293'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.802878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4804c201d5aa4a88ab7d289c4922695a', 'request_id': 'req-aef1acc1-4990-47e8-96e9-a7bda3f98293'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.813933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] The token cache is being invalidate because project 4804c201d5aa4a88ab7d289c4922695a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:50.814221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.814911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.816457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 994/1997] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:50 2022] DELETE /identity/v3/projects/4804c201d5aa4a88ab7d289c4922695a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:50.820371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb56c2-fb69-4877-bd1c-3a3280d073fd service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:50.831601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb56c2-fb69-4877-bd1c-3a3280d073fd service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:50.905179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e185b1a-02a2-4869-9bc3-e42138cf5226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:50.905179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e185b1a-02a2-4869-9bc3-e42138cf5226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:50.905492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e185b1a-02a2-4869-9bc3-e42138cf5226 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:50.905774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e185b1a-02a2-4869-9bc3-e42138cf5226 admin admin] PATH_INFO: `/v3/users/cea5f4ced984421a8d05de75e7f1f565` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:50.907627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e185b1a-02a2-4869-9bc3-e42138cf5226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea5f4ced984421a8d05de75e7f1f565)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:50.910000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e185b1a-02a2-4869-9bc3-e42138cf5226 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:50.920360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:50.921491 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:50.947288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1acc1-4990-47e8-96e9-a7bda3f98293 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:50.953504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:50.954577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:50.955228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:50.955228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] PATH_INFO: `/v3/users/439249fa60264855adcb7e91d828f8de` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:50.956386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=439249fa60264855adcb7e91d828f8de)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:50.959103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:50.966795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0e185b1a-02a2-4869-9bc3-e42138cf5226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea5f4ced984421a8d05de75e7f1f565'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.980072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0e185b1a-02a2-4869-9bc3-e42138cf5226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea5f4ced984421a8d05de75e7f1f565'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.981139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0e185b1a-02a2-4869-9bc3-e42138cf5226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea5f4ced984421a8d05de75e7f1f565'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.981750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0e185b1a-02a2-4869-9bc3-e42138cf5226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea5f4ced984421a8d05de75e7f1f565'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:50.988939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0e185b1a-02a2-4869-9bc3-e42138cf5226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea5f4ced984421a8d05de75e7f1f565'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.003865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1004/1998] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:50 2022] DELETE /identity/v3/users/cea5f4ced984421a8d05de75e7f1f565 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:51.027427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439249fa60264855adcb7e91d828f8de'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.040018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439249fa60264855adcb7e91d828f8de'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.041362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439249fa60264855adcb7e91d828f8de'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.041996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439249fa60264855adcb7e91d828f8de'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.049291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439249fa60264855adcb7e91d828f8de'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.064445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 995/1999] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:50 2022] DELETE /identity/v3/users/439249fa60264855adcb7e91d828f8de => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:51.069422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9944f-30d7-49d5-aa23-044da42980a0 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.069707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9944f-30d7-49d5-aa23-044da42980a0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.069984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9944f-30d7-49d5-aa23-044da42980a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.093139 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-0ad9944f-30d7-49d5-aa23-044da42980a0 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:51.094907 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0ad9944f-30d7-49d5-aa23-044da42980a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:51.156133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1005/2000] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:51.170504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.172107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:51.247485 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a59400-82ae-4178-98b7-2fe678f30d8b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:51.251494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf512d4-9472-4500-94c8-5d1f5893e17e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:51.252150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf512d4-9472-4500-94c8-5d1f5893e17e service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.252429 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf512d4-9472-4500-94c8-5d1f5893e17e service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.252703 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf512d4-9472-4500-94c8-5d1f5893e17e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.265337 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf512d4-9472-4500-94c8-5d1f5893e17e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:51.267441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf512d4-9472-4500-94c8-5d1f5893e17e service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:51.282373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 996/2001] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:51.353912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9944f-30d7-49d5-aa23-044da42980a0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.355367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0ad9944f-30d7-49d5-aa23-044da42980a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:51.381344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9944f-30d7-49d5-aa23-044da42980a0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:51.393768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:51.393768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.393768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.393768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] PATH_INFO: `/v3/projects/b8a55b768a0040e6bc44a360f360b0ec` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.394056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a55b768a0040e6bc44a360f360b0ec)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:51.394056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:51.447613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a55b768a0040e6bc44a360f360b0ec', 'request_id': 'req-99327b31-dd91-4913-8fcd-d51291e65e96'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.455273 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a55b768a0040e6bc44a360f360b0ec', 'request_id': 'req-99327b31-dd91-4913-8fcd-d51291e65e96'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.467282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a55b768a0040e6bc44a360f360b0ec', 'request_id': 'req-99327b31-dd91-4913-8fcd-d51291e65e96'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.481498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] The token cache is being invalidate because project b8a55b768a0040e6bc44a360f360b0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:51.482065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.483005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-99327b31-dd91-4913-8fcd-d51291e65e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.484787 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1006/2002] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:51 2022] DELETE /identity/v3/projects/b8a55b768a0040e6bc44a360f360b0ec => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:51.490357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356525f-6afd-4f53-8467-ca19cf38703e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.490707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356525f-6afd-4f53-8467-ca19cf38703e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.490897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356525f-6afd-4f53-8467-ca19cf38703e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.509565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-0356525f-6afd-4f53-8467-ca19cf38703e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:51.510795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-0356525f-6afd-4f53-8467-ca19cf38703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:51.585537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 997/2003] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:51.586835 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb291-9122-42f4-bf4f-17f3fed2d384 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.587137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb291-9122-42f4-bf4f-17f3fed2d384 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.588016 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb291-9122-42f4-bf4f-17f3fed2d384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.609044 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-bfbfb291-9122-42f4-bf4f-17f3fed2d384 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:51.610546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-bfbfb291-9122-42f4-bf4f-17f3fed2d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:51.617981 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356525f-6afd-4f53-8467-ca19cf38703e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.620272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-0356525f-6afd-4f53-8467-ca19cf38703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:51.624725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1007/2004] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:51.626689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb291-9122-42f4-bf4f-17f3fed2d384 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.639459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356525f-6afd-4f53-8467-ca19cf38703e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:51.645003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:51.646300 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.646628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.646974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] PATH_INFO: `/v3/projects/8d872318caa449019e29bc1127bcba0d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.648527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d872318caa449019e29bc1127bcba0d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:51.652718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:51.654872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb291-9122-42f4-bf4f-17f3fed2d384 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:51.660767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6de7a-bf7b-48c8-990b-2c4292e2954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:51.661457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6de7a-bf7b-48c8-990b-2c4292e2954e admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.661756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6de7a-bf7b-48c8-990b-2c4292e2954e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.662022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6de7a-bf7b-48c8-990b-2c4292e2954e admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.662826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6de7a-bf7b-48c8-990b-2c4292e2954e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:51.663149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6de7a-bf7b-48c8-990b-2c4292e2954e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:51.664779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6de7a-bf7b-48c8-990b-2c4292e2954e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:51.678597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1008/2005] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:47:51.684465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6de7a-bf7b-48c8-990b-2c4292e2954e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.696358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6de7a-bf7b-48c8-990b-2c4292e2954e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:51.702780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77707074-5a29-4583-8483-ac82abaae98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:51.703546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77707074-5a29-4583-8483-ac82abaae98a admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.704097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77707074-5a29-4583-8483-ac82abaae98a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.704232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77707074-5a29-4583-8483-ac82abaae98a admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.705045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77707074-5a29-4583-8483-ac82abaae98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:51.707207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77707074-5a29-4583-8483-ac82abaae98a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:51.714481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d872318caa449019e29bc1127bcba0d', 'request_id': 'req-090f064d-48a4-4316-aa9c-e984df4e60ea'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.723264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d872318caa449019e29bc1127bcba0d', 'request_id': 'req-090f064d-48a4-4316-aa9c-e984df4e60ea'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.729279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d872318caa449019e29bc1127bcba0d', 'request_id': 'req-090f064d-48a4-4316-aa9c-e984df4e60ea'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.741286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] The token cache is being invalidate because project 8d872318caa449019e29bc1127bcba0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:51.741575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.742249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-090f064d-48a4-4316-aa9c-e984df4e60ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:51.745730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1009/2006] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:51 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:51.745875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 998/2007] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:51 2022] DELETE /identity/v3/projects/8d872318caa449019e29bc1127bcba0d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:51.751376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77707074-5a29-4583-8483-ac82abaae98a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.751833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51de5bd-055b-410d-a055-3047ef6d098a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.752120 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51de5bd-055b-410d-a055-3047ef6d098a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.752401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51de5bd-055b-410d-a055-3047ef6d098a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.754243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-77707074-5a29-4583-8483-ac82abaae98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:51.775670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e51de5bd-055b-410d-a055-3047ef6d098a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:51.776977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e51de5bd-055b-410d-a055-3047ef6d098a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:51.823850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77707074-5a29-4583-8483-ac82abaae98a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:51.829192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6261f3d-52cb-4544-bac7-ade1dedfc908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:51.829900 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6261f3d-52cb-4544-bac7-ade1dedfc908 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.830180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6261f3d-52cb-4544-bac7-ade1dedfc908 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.830491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6261f3d-52cb-4544-bac7-ade1dedfc908 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.835394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6261f3d-52cb-4544-bac7-ade1dedfc908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:51.839790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6261f3d-52cb-4544-bac7-ade1dedfc908 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:51.839948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 999/2008] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:51.848039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd336b-aa19-449a-af48-184c7855699a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.848709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd336b-aa19-449a-af48-184c7855699a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.848709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd336b-aa19-449a-af48-184c7855699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.863761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1010/2009] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:51 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:51.867308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b1fd336b-aa19-449a-af48-184c7855699a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:51.868547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b1fd336b-aa19-449a-af48-184c7855699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:51.873313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6261f3d-52cb-4544-bac7-ade1dedfc908 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.876651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1000/2010] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:51.880970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd336b-aa19-449a-af48-184c7855699a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.883219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6261f3d-52cb-4544-bac7-ade1dedfc908 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:51.888895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d54c19-7929-4613-91d2-361c4174ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:51.889819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d54c19-7929-4613-91d2-361c4174ef68 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.890109 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d54c19-7929-4613-91d2-361c4174ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.890427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd336b-aa19-449a-af48-184c7855699a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:51.890534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d54c19-7929-4613-91d2-361c4174ef68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.891141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d54c19-7929-4613-91d2-361c4174ef68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:51.892844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d54c19-7929-4613-91d2-361c4174ef68 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:51.895549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212522bd-8272-436f-8d79-87d18cd420c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:51.896193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212522bd-8272-436f-8d79-87d18cd420c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.896541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212522bd-8272-436f-8d79-87d18cd420c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.896818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212522bd-8272-436f-8d79-87d18cd420c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.897638 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212522bd-8272-436f-8d79-87d18cd420c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:51.898354 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212522bd-8272-436f-8d79-87d18cd420c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:51.899597 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212522bd-8272-436f-8d79-87d18cd420c3 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:51.904405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1011/2011] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:51.908338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d54c19-7929-4613-91d2-361c4174ef68 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.915505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1001/2012] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:47:51.916609 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212522bd-8272-436f-8d79-87d18cd420c3 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.918303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d54c19-7929-4613-91d2-361c4174ef68 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:51.923147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5b477-4617-47a1-b3de-26804f9eb242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:51.923829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5b477-4617-47a1-b3de-26804f9eb242 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.924114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5b477-4617-47a1-b3de-26804f9eb242 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.924416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5b477-4617-47a1-b3de-26804f9eb242 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.925171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5b477-4617-47a1-b3de-26804f9eb242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:51.925824 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212522bd-8272-436f-8d79-87d18cd420c3 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:51.926816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5b477-4617-47a1-b3de-26804f9eb242 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:51.930331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a877d-b874-4b19-a5a3-45c08c964614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:51.931479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a877d-b874-4b19-a5a3-45c08c964614 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.931893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a877d-b874-4b19-a5a3-45c08c964614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.932165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a877d-b874-4b19-a5a3-45c08c964614 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.932871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a877d-b874-4b19-a5a3-45c08c964614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:51.935162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a877d-b874-4b19-a5a3-45c08c964614 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:51.937403 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1012/2013] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:47:51.941110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5b477-4617-47a1-b3de-26804f9eb242 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.957051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5b477-4617-47a1-b3de-26804f9eb242 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:51.961967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac43c5-7a30-4428-b868-cb75583e55b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:51.962785 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1002/2014] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:51 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:51.965888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac43c5-7a30-4428-b868-cb75583e55b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:51.966200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac43c5-7a30-4428-b868-cb75583e55b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:51.966555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac43c5-7a30-4428-b868-cb75583e55b8 admin admin] PATH_INFO: `/v3/projects/128aa8bdcbe3444f8221c11b0ed4d5c8/users/cfd162c8f26e4d33a95c37ebc54f6100/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:51.966637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a877d-b874-4b19-a5a3-45c08c964614 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:51.987782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac43c5-7a30-4428-b868-cb75583e55b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=128aa8bdcbe3444f8221c11b0ed4d5c8, user_id=cfd162c8f26e4d33a95c37ebc54f6100, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:51.990448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac43c5-7a30-4428-b868-cb75583e55b8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.006045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1013/2015] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:51 2022] PUT /identity/v3/projects/128aa8bdcbe3444f8221c11b0ed4d5c8/users/cfd162c8f26e4d33a95c37ebc54f6100/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:52.017343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e8d53-dabd-4dbe-b712-e045a5dfde74 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.017629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e8d53-dabd-4dbe-b712-e045a5dfde74 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.017903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e8d53-dabd-4dbe-b712-e045a5dfde74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.033712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a877d-b874-4b19-a5a3-45c08c964614 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.045176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-e43e8d53-dabd-4dbe-b712-e045a5dfde74 None None] MFA Rules not processed for user `cfd162c8f26e4d33a95c37ebc54f6100`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:52.046411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e43e8d53-dabd-4dbe-b712-e045a5dfde74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:52.104053 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf697f-f6c7-4731-b9c2-2bee6507851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.105394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf697f-f6c7-4731-b9c2-2bee6507851a admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.105690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf697f-f6c7-4731-b9c2-2bee6507851a admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.105969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf697f-f6c7-4731-b9c2-2bee6507851a admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.106773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf697f-f6c7-4731-b9c2-2bee6507851a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.108831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf697f-f6c7-4731-b9c2-2bee6507851a admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.132881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1003/2016] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:51 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:52.133816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1014/2017] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:52.138434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf697f-f6c7-4731-b9c2-2bee6507851a admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.139695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e8d53-dabd-4dbe-b712-e045a5dfde74 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.155999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e8d53-dabd-4dbe-b712-e045a5dfde74 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.156192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf697f-f6c7-4731-b9c2-2bee6507851a admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.161362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e14540-5a63-40aa-9553-0bd05da80d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.161855 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276e103-e1fc-407c-a616-80738fea6865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.161973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14540-5a63-40aa-9553-0bd05da80d2f admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.161973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14540-5a63-40aa-9553-0bd05da80d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.162141 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276e103-e1fc-407c-a616-80738fea6865 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.162213 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14540-5a63-40aa-9553-0bd05da80d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.162282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276e103-e1fc-407c-a616-80738fea6865 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.162282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276e103-e1fc-407c-a616-80738fea6865 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.162606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e14540-5a63-40aa-9553-0bd05da80d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.163702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276e103-e1fc-407c-a616-80738fea6865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.164773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276e103-e1fc-407c-a616-80738fea6865 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.165122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e14540-5a63-40aa-9553-0bd05da80d2f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.176277 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1004/2018] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:47:52.178131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276e103-e1fc-407c-a616-80738fea6865 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.180501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7276e103-e1fc-407c-a616-80738fea6865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:52.195360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276e103-e1fc-407c-a616-80738fea6865 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.202530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.203508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.203918 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1015/2019] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:52 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:52.205173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e14540-5a63-40aa-9553-0bd05da80d2f admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.207104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.207429 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] PATH_INFO: `/v3/users/4d02d626a3124d4d823b6e7079214897` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.208785 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d02d626a3124d4d823b6e7079214897)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.210882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.269472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d02d626a3124d4d823b6e7079214897'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:52.271366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e14540-5a63-40aa-9553-0bd05da80d2f admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.278014 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5b77-dc96-4c55-abb3-875db9abc684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.278914 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5b77-dc96-4c55-abb3-875db9abc684 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.279242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5b77-dc96-4c55-abb3-875db9abc684 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.279653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e5b77-dc96-4c55-abb3-875db9abc684 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.280458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e5b77-dc96-4c55-abb3-875db9abc684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.282338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e5b77-dc96-4c55-abb3-875db9abc684 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.283245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d02d626a3124d4d823b6e7079214897'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:52.284541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d02d626a3124d4d823b6e7079214897'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:52.285606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d02d626a3124d4d823b6e7079214897'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:52.295021 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1016/2020] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:52.295979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5b77-dc96-4c55-abb3-875db9abc684 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.297688 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f19e5b77-dc96-4c55-abb3-875db9abc684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:52.303777 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d02d626a3124d4d823b6e7079214897'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:52.311462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e5b77-dc96-4c55-abb3-875db9abc684 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.316456 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a6053-7d0a-4100-b746-750b77f2d23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.317128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6053-7d0a-4100-b746-750b77f2d23b admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.317417 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6053-7d0a-4100-b746-750b77f2d23b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.317695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6053-7d0a-4100-b746-750b77f2d23b admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.318389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1005/2021] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:52 2022] DELETE /identity/v3/users/4d02d626a3124d4d823b6e7079214897 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:52.318500 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a6053-7d0a-4100-b746-750b77f2d23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.319161 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.320529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a6053-7d0a-4100-b746-750b77f2d23b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.320655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:52.343894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1017/2022] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:52 2022] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:52.344428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef1274-db37-4482-b59d-df91634ed676 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.345003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef1274-db37-4482-b59d-df91634ed676 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.345406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef1274-db37-4482-b59d-df91634ed676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.366479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-81ef1274-db37-4482-b59d-df91634ed676 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:52.368171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-81ef1274-db37-4482-b59d-df91634ed676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:52.409214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5642b-8418-44b8-bf0b-8fd57acbcbd3 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.418125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7bc41-f041-466a-90d7-e31d645b3e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.419411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bc41-f041-466a-90d7-e31d645b3e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.419701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bc41-f041-466a-90d7-e31d645b3e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.420036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bc41-f041-466a-90d7-e31d645b3e37 admin admin] PATH_INFO: `/v3/projects/ef77e5a7b74e485fb8f6f7a90cfa0f2d/users/451f023a11a745e3aef0c23dd1e3a41c/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.445100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7bc41-f041-466a-90d7-e31d645b3e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef77e5a7b74e485fb8f6f7a90cfa0f2d, user_id=451f023a11a745e3aef0c23dd1e3a41c, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.448941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7bc41-f041-466a-90d7-e31d645b3e37 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.449554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1018/2023] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:52.450577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef1274-db37-4482-b59d-df91634ed676 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.463648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef1274-db37-4482-b59d-df91634ed676 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.470976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf7559-2b0c-4c81-a9ad-d878265a2539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.471724 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf7559-2b0c-4c81-a9ad-d878265a2539 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.471982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf7559-2b0c-4c81-a9ad-d878265a2539 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.472239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf7559-2b0c-4c81-a9ad-d878265a2539 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.473455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf7559-2b0c-4c81-a9ad-d878265a2539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.475405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf7559-2b0c-4c81-a9ad-d878265a2539 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.480104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1006/2024] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:52 2022] PUT /identity/v3/projects/ef77e5a7b74e485fb8f6f7a90cfa0f2d/users/451f023a11a745e3aef0c23dd1e3a41c/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:52.481698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7bc41-f041-466a-90d7-e31d645b3e37 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.483407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4cd7bc41-f041-466a-90d7-e31d645b3e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:52.488395 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1019/2025] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:52.490836 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b6e00-6085-4fa8-b4d5-2e7113d43f34 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.491441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b6e00-6085-4fa8-b4d5-2e7113d43f34 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.491866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b6e00-6085-4fa8-b4d5-2e7113d43f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.520626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-188b6e00-6085-4fa8-b4d5-2e7113d43f34 None None] MFA Rules not processed for user `451f023a11a745e3aef0c23dd1e3a41c`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:52.521822 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-188b6e00-6085-4fa8-b4d5-2e7113d43f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:52.550869 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7bc41-f041-466a-90d7-e31d645b3e37 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.554751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ff0ad-8107-44c2-8cd0-3e90ff41250f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.555429 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff0ad-8107-44c2-8cd0-3e90ff41250f service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.555724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff0ad-8107-44c2-8cd0-3e90ff41250f service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.556130 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ff0ad-8107-44c2-8cd0-3e90ff41250f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.593221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1020/2026] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:52.596907 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b6e00-6085-4fa8-b4d5-2e7113d43f34 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.644863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ff0ad-8107-44c2-8cd0-3e90ff41250f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.647471 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ff0ad-8107-44c2-8cd0-3e90ff41250f service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.657892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1007/2027] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:52.659046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ff0ad-8107-44c2-8cd0-3e90ff41250f service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.660132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-be5ff0ad-8107-44c2-8cd0-3e90ff41250f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:52.664990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b6e00-6085-4fa8-b4d5-2e7113d43f34 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.674802 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75d4a-2dbb-425a-9d2a-3cbdbeea4e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.675713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75d4a-2dbb-425a-9d2a-3cbdbeea4e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.675997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75d4a-2dbb-425a-9d2a-3cbdbeea4e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.676312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75d4a-2dbb-425a-9d2a-3cbdbeea4e00 admin admin] PATH_INFO: `/v3/projects/6070e1d72a9046c9a46fbc5614239b21/users/56d7cdb5cf5b47f691c466b2e10e29c1/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.695078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e75d4a-2dbb-425a-9d2a-3cbdbeea4e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6070e1d72a9046c9a46fbc5614239b21, user_id=56d7cdb5cf5b47f691c466b2e10e29c1, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.698453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e75d4a-2dbb-425a-9d2a-3cbdbeea4e00 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.720030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1021/2028] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:52 2022] PUT /identity/v3/projects/6070e1d72a9046c9a46fbc5614239b21/users/56d7cdb5cf5b47f691c466b2e10e29c1/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:52.721463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75d4a-2dbb-425a-9d2a-3cbdbeea4e00 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.724271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-59e75d4a-2dbb-425a-9d2a-3cbdbeea4e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:52.725974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ff0ad-8107-44c2-8cd0-3e90ff41250f service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.781608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed712f-29c2-44d0-a3b8-b8041617d467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.782260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed712f-29c2-44d0-a3b8-b8041617d467 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.782568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed712f-29c2-44d0-a3b8-b8041617d467 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.782848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed712f-29c2-44d0-a3b8-b8041617d467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.794125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75d4a-2dbb-425a-9d2a-3cbdbeea4e00 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.800119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbfde01-cec7-4fd4-ba37-41f25701ccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.800994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfde01-cec7-4fd4-ba37-41f25701ccd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.801273 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfde01-cec7-4fd4-ba37-41f25701ccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.801543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbfde01-cec7-4fd4-ba37-41f25701ccd0 admin admin] PATH_INFO: `/v3/users/35b591ca12b440b98809aae571d9ba2f` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.803112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfde01-cec7-4fd4-ba37-41f25701ccd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b591ca12b440b98809aae571d9ba2f)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.805540 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbfde01-cec7-4fd4-ba37-41f25701ccd0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.866338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed712f-29c2-44d0-a3b8-b8041617d467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.867992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed712f-29c2-44d0-a3b8-b8041617d467 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.882790 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1008/2029] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:52.894993 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2bbfde01-cec7-4fd4-ba37-41f25701ccd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b591ca12b440b98809aae571d9ba2f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:52.897639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed712f-29c2-44d0-a3b8-b8041617d467 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.910381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2bbfde01-cec7-4fd4-ba37-41f25701ccd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b591ca12b440b98809aae571d9ba2f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:52.911114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2bbfde01-cec7-4fd4-ba37-41f25701ccd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b591ca12b440b98809aae571d9ba2f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:52.911776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2bbfde01-cec7-4fd4-ba37-41f25701ccd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b591ca12b440b98809aae571d9ba2f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:52.919911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2bbfde01-cec7-4fd4-ba37-41f25701ccd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b591ca12b440b98809aae571d9ba2f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:52.935464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed712f-29c2-44d0-a3b8-b8041617d467 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:52.948682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849bd47-19a3-47b2-96b7-6444c3145207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:52.949093 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849bd47-19a3-47b2-96b7-6444c3145207 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.949377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849bd47-19a3-47b2-96b7-6444c3145207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.949653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849bd47-19a3-47b2-96b7-6444c3145207 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.950482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849bd47-19a3-47b2-96b7-6444c3145207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:52.955124 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849bd47-19a3-47b2-96b7-6444c3145207 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:52.956201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1022/2030] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:52 2022] DELETE /identity/v3/users/35b591ca12b440b98809aae571d9ba2f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:52.966591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd0c3b-6643-44b4-8ae6-e4f0e5438ed7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:52.966884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd0c3b-6643-44b4-8ae6-e4f0e5438ed7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:52.967165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd0c3b-6643-44b4-8ae6-e4f0e5438ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:52.984618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1009/2031] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:52.986207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849bd47-19a3-47b2-96b7-6444c3145207 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:52.989524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8849bd47-19a3-47b2-96b7-6444c3145207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:53.021137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849bd47-19a3-47b2-96b7-6444c3145207 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:53.026516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-67bd0c3b-6643-44b4-8ae6-e4f0e5438ed7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:53.031683 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-67bd0c3b-6643-44b4-8ae6-e4f0e5438ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:53.147520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1023/2032] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:53.148602 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd0c3b-6643-44b4-8ae6-e4f0e5438ed7 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:53.152919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-67bd0c3b-6643-44b4-8ae6-e4f0e5438ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:53.164527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840b30d-6966-4c4f-bb81-ce1102da4978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:53.165559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840b30d-6966-4c4f-bb81-ce1102da4978 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:53.165840 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840b30d-6966-4c4f-bb81-ce1102da4978 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:53.166113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840b30d-6966-4c4f-bb81-ce1102da4978 admin admin] PATH_INFO: `/v3/projects/6070e1d72a9046c9a46fbc5614239b21/users/56d7cdb5cf5b47f691c466b2e10e29c1/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:53.171331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd0c3b-6643-44b4-8ae6-e4f0e5438ed7 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:53.171817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840b30d-6966-4c4f-bb81-ce1102da4978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6070e1d72a9046c9a46fbc5614239b21, user_id=56d7cdb5cf5b47f691c466b2e10e29c1, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:53.174593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840b30d-6966-4c4f-bb81-ce1102da4978 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:53.179989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:53.181959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:53.182099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:53.182330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] PATH_INFO: `/v3/projects/ddb330ced7ec4119b19a29e3b8f03b9c` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:53.184655 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb330ced7ec4119b19a29e3b8f03b9c)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:53.186698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:53.207916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1010/2033] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:52 2022] PUT /identity/v3/projects/6070e1d72a9046c9a46fbc5614239b21/users/56d7cdb5cf5b47f691c466b2e10e29c1/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:53.209694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840b30d-6966-4c4f-bb81-ce1102da4978 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:53.216313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f840b30d-6966-4c4f-bb81-ce1102da4978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:53.257552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb330ced7ec4119b19a29e3b8f03b9c', 'request_id': 'req-51b6c380-b5b0-47b2-9512-cb0517457ed2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:53.267678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb330ced7ec4119b19a29e3b8f03b9c', 'request_id': 'req-51b6c380-b5b0-47b2-9512-cb0517457ed2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:53.279535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb330ced7ec4119b19a29e3b8f03b9c', 'request_id': 'req-51b6c380-b5b0-47b2-9512-cb0517457ed2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:53.293029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] The token cache is being invalidate because project ddb330ced7ec4119b19a29e3b8f03b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:53.300187 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:53.305402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-51b6c380-b5b0-47b2-9512-cb0517457ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:53.309749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1024/2034] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:53 2022] DELETE /identity/v3/projects/ddb330ced7ec4119b19a29e3b8f03b9c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:53.312460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4063755-f2f7-4820-919f-0ddd76082330 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:53.313991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4063755-f2f7-4820-919f-0ddd76082330 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:53.315697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4063755-f2f7-4820-919f-0ddd76082330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:53.341751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840b30d-6966-4c4f-bb81-ce1102da4978 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:53.349442 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f4063755-f2f7-4820-919f-0ddd76082330 None None] MFA Rules not processed for user `56d7cdb5cf5b47f691c466b2e10e29c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:53.350924 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f4063755-f2f7-4820-919f-0ddd76082330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:53.468584 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bfa7e-e78a-45e7-95ba-08f0def54955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:53.469248 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bfa7e-e78a-45e7-95ba-08f0def54955 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:53.469526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bfa7e-e78a-45e7-95ba-08f0def54955 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:53.469799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bfa7e-e78a-45e7-95ba-08f0def54955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:53.489335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-576bfa7e-e78a-45e7-95ba-08f0def54955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:53.503964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1025/2035] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:53.503964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4063755-f2f7-4820-919f-0ddd76082330 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:53.505534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f4063755-f2f7-4820-919f-0ddd76082330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:53.579993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bfa7e-e78a-45e7-95ba-08f0def54955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:53.583578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bfa7e-e78a-45e7-95ba-08f0def54955 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:53.596982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1011/2036] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:53.597922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bfa7e-e78a-45e7-95ba-08f0def54955 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:53.601162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-576bfa7e-e78a-45e7-95ba-08f0def54955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:53.605697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4063755-f2f7-4820-919f-0ddd76082330 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:53.622570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:53.623346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:53.623635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:53.623913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] PATH_INFO: `/v3/users/612fc16a3d4e40ac8db47d00b779dd1c` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:53.625859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=612fc16a3d4e40ac8db47d00b779dd1c)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:53.628632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:53.708694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612fc16a3d4e40ac8db47d00b779dd1c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:53.732056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612fc16a3d4e40ac8db47d00b779dd1c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:53.732902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bfa7e-e78a-45e7-95ba-08f0def54955 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:53.734217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612fc16a3d4e40ac8db47d00b779dd1c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:53.735218 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612fc16a3d4e40ac8db47d00b779dd1c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:53.746481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf782f76-e2d1-4dde-a3a1-de5196624ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:53.747148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf782f76-e2d1-4dde-a3a1-de5196624ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:53.747428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf782f76-e2d1-4dde-a3a1-de5196624ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:53.747704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf782f76-e2d1-4dde-a3a1-de5196624ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:53.750593 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612fc16a3d4e40ac8db47d00b779dd1c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:53.753030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-bf782f76-e2d1-4dde-a3a1-de5196624ee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:53.779753 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf782f76-e2d1-4dde-a3a1-de5196624ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:53.782134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf782f76-e2d1-4dde-a3a1-de5196624ee9 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:53.790261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1026/2037] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:47:53 2022] DELETE /identity/v3/users/612fc16a3d4e40ac8db47d00b779dd1c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:53.810001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1012/2038] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:53.921500 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:53.923163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:53.995355 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00516fe-6ebb-4d29-893b-3778cc7bfc3a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:53.999759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a21e59-1c9b-483e-be31-3abd7c9f15a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:54.000419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21e59-1c9b-483e-be31-3abd7c9f15a4 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.001009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21e59-1c9b-483e-be31-3abd7c9f15a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.001009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a21e59-1c9b-483e-be31-3abd7c9f15a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.003181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-07a21e59-1c9b-483e-be31-3abd7c9f15a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:54.072623 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a21e59-1c9b-483e-be31-3abd7c9f15a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:54.074167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a21e59-1c9b-483e-be31-3abd7c9f15a4 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:54.075999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf782f76-e2d1-4dde-a3a1-de5196624ee9 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:54.077693 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-bf782f76-e2d1-4dde-a3a1-de5196624ee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:54.099867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1027/2039] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:54.100008 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf782f76-e2d1-4dde-a3a1-de5196624ee9 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:54.169202 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:54.170340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.170637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.171631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] PATH_INFO: `/v3/projects/71a90f9aac2a4a91a5c9558001978d73` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.173571 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a90f9aac2a4a91a5c9558001978d73)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:54.176774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:54.232611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a90f9aac2a4a91a5c9558001978d73', 'request_id': 'req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:54.242705 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a90f9aac2a4a91a5c9558001978d73', 'request_id': 'req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:54.250012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a90f9aac2a4a91a5c9558001978d73', 'request_id': 'req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:54.263853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] The token cache is being invalidate because project 71a90f9aac2a4a91a5c9558001978d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:54.264208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:54.264878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d750ec42-f89e-4c9d-aff4-d16cb8a89a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:54.269838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1013/2040] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:54 2022] DELETE /identity/v3/projects/71a90f9aac2a4a91a5c9558001978d73 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:54.272090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad62f91-f522-4d2b-8853-8854aad43fa1 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.272615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad62f91-f522-4d2b-8853-8854aad43fa1 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.272707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad62f91-f522-4d2b-8853-8854aad43fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.297270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-6ad62f91-f522-4d2b-8853-8854aad43fa1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:54.298975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6ad62f91-f522-4d2b-8853-8854aad43fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:54.410394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1028/2041] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:54.413548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1774eb4-db3f-4aaf-a799-ebb5a6948853 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.414046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1774eb4-db3f-4aaf-a799-ebb5a6948853 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.414341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1774eb4-db3f-4aaf-a799-ebb5a6948853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.454389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a1774eb4-db3f-4aaf-a799-ebb5a6948853 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:54.455642 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a1774eb4-db3f-4aaf-a799-ebb5a6948853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:54.478983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1014/2042] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:54.484454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad62f91-f522-4d2b-8853-8854aad43fa1 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:54.499548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad62f91-f522-4d2b-8853-8854aad43fa1 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:54.505101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042256-4c14-4c28-9504-056bd7956689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:54.506277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042256-4c14-4c28-9504-056bd7956689 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.506878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042256-4c14-4c28-9504-056bd7956689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.507348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40042256-4c14-4c28-9504-056bd7956689 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.508294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40042256-4c14-4c28-9504-056bd7956689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:54.508807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40042256-4c14-4c28-9504-056bd7956689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:54.511594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40042256-4c14-4c28-9504-056bd7956689 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:54.532896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1774eb4-db3f-4aaf-a799-ebb5a6948853 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:54.545774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1774eb4-db3f-4aaf-a799-ebb5a6948853 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:54.550757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1029/2043] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:47:54.555187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ef6ba-3b16-403e-b457-c7eb7d80cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:54.556848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef6ba-3b16-403e-b457-c7eb7d80cab4 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.557304 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef6ba-3b16-403e-b457-c7eb7d80cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.557845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef6ba-3b16-403e-b457-c7eb7d80cab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.558757 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ef6ba-3b16-403e-b457-c7eb7d80cab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:54.561148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ef6ba-3b16-403e-b457-c7eb7d80cab4 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:54.611802 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042256-4c14-4c28-9504-056bd7956689 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:54.614885 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-40042256-4c14-4c28-9504-056bd7956689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:54.635843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1015/2044] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:54 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:54.642956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40042256-4c14-4c28-9504-056bd7956689 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:54.654713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ef6ba-3b16-403e-b457-c7eb7d80cab4 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:54.738702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:54.741200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.741655 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.742120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] PATH_INFO: `/v3/projects/d1b2bbcdab634685949add6b4dea7c1f` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.745157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b2bbcdab634685949add6b4dea7c1f)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:54.748339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:54.749770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ef6ba-3b16-403e-b457-c7eb7d80cab4 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:54.756538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ddef5-4b45-4e33-9c3d-df3ac6946e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:54.757553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddef5-4b45-4e33-9c3d-df3ac6946e3e admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.758491 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddef5-4b45-4e33-9c3d-df3ac6946e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.759012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddef5-4b45-4e33-9c3d-df3ac6946e3e admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.761665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ddef5-4b45-4e33-9c3d-df3ac6946e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:54.764220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ddef5-4b45-4e33-9c3d-df3ac6946e3e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:54.795398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1016/2045] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:54 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:54.799207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ddef5-4b45-4e33-9c3d-df3ac6946e3e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:54.823658 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ddef5-4b45-4e33-9c3d-df3ac6946e3e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:54.852384 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b2bbcdab634685949add6b4dea7c1f', 'request_id': 'req-029bbc71-5af6-4907-8a95-0360719baac6'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:54.867032 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b2bbcdab634685949add6b4dea7c1f', 'request_id': 'req-029bbc71-5af6-4907-8a95-0360719baac6'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:54.880406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b2bbcdab634685949add6b4dea7c1f', 'request_id': 'req-029bbc71-5af6-4907-8a95-0360719baac6'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:54.899008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] The token cache is being invalidate because project d1b2bbcdab634685949add6b4dea7c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:47:54.899363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:54.900302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-029bbc71-5af6-4907-8a95-0360719baac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:47:54.903270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1030/2046] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:47:54 2022] DELETE /identity/v3/projects/d1b2bbcdab634685949add6b4dea7c1f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:54.907898 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269e261-d74f-4ddb-8fb2-e7c498808ab2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.908522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269e261-d74f-4ddb-8fb2-e7c498808ab2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.908884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269e261-d74f-4ddb-8fb2-e7c498808ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.912191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ad046-a3bc-4e2a-8dd3-4fa96ee77fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:54.913034 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ad046-a3bc-4e2a-8dd3-4fa96ee77fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.913388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ad046-a3bc-4e2a-8dd3-4fa96ee77fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.913741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ad046-a3bc-4e2a-8dd3-4fa96ee77fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.915826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ad046-a3bc-4e2a-8dd3-4fa96ee77fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:54.918171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ad046-a3bc-4e2a-8dd3-4fa96ee77fd8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:54.931349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1017/2047] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:54.934030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b269e261-d74f-4ddb-8fb2-e7c498808ab2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:54.935401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ad046-a3bc-4e2a-8dd3-4fa96ee77fd8 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:54.935591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b269e261-d74f-4ddb-8fb2-e7c498808ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:54.937729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-eb3ad046-a3bc-4e2a-8dd3-4fa96ee77fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:54.945063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1031/2048] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:54.951713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ad046-a3bc-4e2a-8dd3-4fa96ee77fd8 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:54.954081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9161e1-f771-44b6-aca6-52a429a597e7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.954406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9161e1-f771-44b6-aca6-52a429a597e7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.954689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9161e1-f771-44b6-aca6-52a429a597e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.958054 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06210e31-2869-4077-b76c-3b40952d0f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:54.959110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06210e31-2869-4077-b76c-3b40952d0f64 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:54.959721 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06210e31-2869-4077-b76c-3b40952d0f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:54.960247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06210e31-2869-4077-b76c-3b40952d0f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:54.961270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06210e31-2869-4077-b76c-3b40952d0f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:54.963630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06210e31-2869-4077-b76c-3b40952d0f64 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:54.976402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7a9161e1-f771-44b6-aca6-52a429a597e7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:54.977040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1018/2049] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:47:54.981237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06210e31-2869-4077-b76c-3b40952d0f64 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:54.982615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7a9161e1-f771-44b6-aca6-52a429a597e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:54.991070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1032/2050] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:54.995548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9161e1-f771-44b6-aca6-52a429a597e7 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:54.997050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06210e31-2869-4077-b76c-3b40952d0f64 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:55.005008 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93bee8-19d2-4831-9769-f33a1ec53c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:55.006181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9161e1-f771-44b6-aca6-52a429a597e7 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:55.006983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93bee8-19d2-4831-9769-f33a1ec53c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:55.008074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93bee8-19d2-4831-9769-f33a1ec53c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:55.009086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93bee8-19d2-4831-9769-f33a1ec53c78 admin admin] PATH_INFO: `/v3/projects/30f37fbad5cd43f6848efdd436546bab/users/ee9e8845d84e4ed291de260dad44308d/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:55.012291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873289c7-bafe-43aa-994a-9e4e8fd55aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:55.013437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873289c7-bafe-43aa-994a-9e4e8fd55aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:55.013794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873289c7-bafe-43aa-994a-9e4e8fd55aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:55.014183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873289c7-bafe-43aa-994a-9e4e8fd55aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:55.015874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873289c7-bafe-43aa-994a-9e4e8fd55aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:47:55.016299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873289c7-bafe-43aa-994a-9e4e8fd55aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:55.018346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873289c7-bafe-43aa-994a-9e4e8fd55aa8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:55.031708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93bee8-19d2-4831-9769-f33a1ec53c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f37fbad5cd43f6848efdd436546bab, user_id=ee9e8845d84e4ed291de260dad44308d, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:55.034786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93bee8-19d2-4831-9769-f33a1ec53c78 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:55.039238 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1033/2051] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:47:55.040438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873289c7-bafe-43aa-994a-9e4e8fd55aa8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:55.053544 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1019/2052] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:54 2022] PUT /identity/v3/projects/30f37fbad5cd43f6848efdd436546bab/users/ee9e8845d84e4ed291de260dad44308d/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:55.066524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb78014-b342-4a4f-a849-16e16c8102db None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:55.067176 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb78014-b342-4a4f-a849-16e16c8102db None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:55.067564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb78014-b342-4a4f-a849-16e16c8102db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:55.075973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873289c7-bafe-43aa-994a-9e4e8fd55aa8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:55.116382 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-5bb78014-b342-4a4f-a849-16e16c8102db None None] MFA Rules not processed for user `ee9e8845d84e4ed291de260dad44308d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:55.118148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-5bb78014-b342-4a4f-a849-16e16c8102db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:55.169061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f350a4e-d5e7-4aa5-8d99-bbe00812296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:55.170101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f350a4e-d5e7-4aa5-8d99-bbe00812296e admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:55.170504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f350a4e-d5e7-4aa5-8d99-bbe00812296e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:55.170786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f350a4e-d5e7-4aa5-8d99-bbe00812296e admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:55.171505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f350a4e-d5e7-4aa5-8d99-bbe00812296e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:55.173493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f350a4e-d5e7-4aa5-8d99-bbe00812296e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:55.206356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1020/2053] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:55.210706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1034/2054] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:55 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:55.211729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb78014-b342-4a4f-a849-16e16c8102db None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:55.218887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f350a4e-d5e7-4aa5-8d99-bbe00812296e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:55.220664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4f350a4e-d5e7-4aa5-8d99-bbe00812296e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:55.224356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb78014-b342-4a4f-a849-16e16c8102db None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:55.296361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6129a67-2141-4938-86ab-8237c4f021f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:55.297206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6129a67-2141-4938-86ab-8237c4f021f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:55.297543 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6129a67-2141-4938-86ab-8237c4f021f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:55.297930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6129a67-2141-4938-86ab-8237c4f021f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:55.298744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6129a67-2141-4938-86ab-8237c4f021f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:55.300882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6129a67-2141-4938-86ab-8237c4f021f1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:55.304762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f350a4e-d5e7-4aa5-8d99-bbe00812296e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:55.323014 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0f01d-2489-4664-843b-00603fd2d682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:55.323687 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0f01d-2489-4664-843b-00603fd2d682 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:55.324739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0f01d-2489-4664-843b-00603fd2d682 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:55.325035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0f01d-2489-4664-843b-00603fd2d682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:55.330362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1021/2055] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:55 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:55.332997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6129a67-2141-4938-86ab-8237c4f021f1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:55.344685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6129a67-2141-4938-86ab-8237c4f021f1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:55.350155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e39271-aa7c-4f2e-87d1-cb14cfd060ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:55.350859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e39271-aa7c-4f2e-87d1-cb14cfd060ee admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:55.351138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e39271-aa7c-4f2e-87d1-cb14cfd060ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:55.351414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e39271-aa7c-4f2e-87d1-cb14cfd060ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:55.354643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e39271-aa7c-4f2e-87d1-cb14cfd060ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:55.356274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e39271-aa7c-4f2e-87d1-cb14cfd060ee admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:55.373529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1022/2056] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:55.375114 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e39271-aa7c-4f2e-87d1-cb14cfd060ee admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:55.386437 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e39271-aa7c-4f2e-87d1-cb14cfd060ee admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:55.392659 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dc886-83f5-4f0f-a74f-d09f3e337d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:55.393329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc886-83f5-4f0f-a74f-d09f3e337d37 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:55.393609 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc886-83f5-4f0f-a74f-d09f3e337d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:55.393884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dc886-83f5-4f0f-a74f-d09f3e337d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:55.394634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dc886-83f5-4f0f-a74f-d09f3e337d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:55.396227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dc886-83f5-4f0f-a74f-d09f3e337d37 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:55.407421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1023/2057] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:55.411452 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dc886-83f5-4f0f-a74f-d09f3e337d37 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:55.411690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0f01d-2489-4664-843b-00603fd2d682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:55.413884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0f01d-2489-4664-843b-00603fd2d682 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:55.422818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dc886-83f5-4f0f-a74f-d09f3e337d37 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:55.428652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1035/2058] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:47:55.430520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8539622-0e04-4033-add1-b97ab7d6d30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:55.432266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8539622-0e04-4033-add1-b97ab7d6d30e admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:55.432715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8539622-0e04-4033-add1-b97ab7d6d30e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:55.433642 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8539622-0e04-4033-add1-b97ab7d6d30e admin admin] PATH_INFO: `/v3/projects/3594a317448848a484e9f4ca47e4f33b/users/73e7877dfb1341dd929c544d357d0ff7/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:55.457136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8539622-0e04-4033-add1-b97ab7d6d30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3594a317448848a484e9f4ca47e4f33b, user_id=73e7877dfb1341dd929c544d357d0ff7, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:55.460372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8539622-0e04-4033-add1-b97ab7d6d30e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:55.479601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1024/2059] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:55 2022] PUT /identity/v3/projects/3594a317448848a484e9f4ca47e4f33b/users/73e7877dfb1341dd929c544d357d0ff7/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:55.484857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76900d-a69a-45f8-a73e-084fb182f981 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:55.485143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76900d-a69a-45f8-a73e-084fb182f981 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:55.485437 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76900d-a69a-45f8-a73e-084fb182f981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:55.504322 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4f76900d-a69a-45f8-a73e-084fb182f981 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:55.505536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4f76900d-a69a-45f8-a73e-084fb182f981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:55.585903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1036/2060] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:55.597056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8539622-0e04-4033-add1-b97ab7d6d30e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:55.598932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a8539622-0e04-4033-add1-b97ab7d6d30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:55.704027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8539622-0e04-4033-add1-b97ab7d6d30e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:55.709740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22723071-db14-40c9-8c67-a9094141b1b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:55.710759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22723071-db14-40c9-8c67-a9094141b1b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:55.711243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22723071-db14-40c9-8c67-a9094141b1b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:55.711781 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22723071-db14-40c9-8c67-a9094141b1b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:55.724419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22723071-db14-40c9-8c67-a9094141b1b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:55.726273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22723071-db14-40c9-8c67-a9094141b1b1 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:55.750519 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1025/2061] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:47:56.523706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212162a4-454f-4603-b953-69f49c30f54c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:56.524167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212162a4-454f-4603-b953-69f49c30f54c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:56.524247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212162a4-454f-4603-b953-69f49c30f54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:56.552405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-212162a4-454f-4603-b953-69f49c30f54c None None] MFA Rules not processed for user `73e7877dfb1341dd929c544d357d0ff7`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:56.553613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-212162a4-454f-4603-b953-69f49c30f54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:56.626076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1037/2062] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:47:56.630747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22723071-db14-40c9-8c67-a9094141b1b1 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:56.644456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22723071-db14-40c9-8c67-a9094141b1b1 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:56.650900 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b4f88-9951-45c1-9cc8-4b6eafed4285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:56.651740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4f88-9951-45c1-9cc8-4b6eafed4285 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:56.652273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4f88-9951-45c1-9cc8-4b6eafed4285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:56.652728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4f88-9951-45c1-9cc8-4b6eafed4285 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:56.653721 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b4f88-9951-45c1-9cc8-4b6eafed4285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:56.656034 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b4f88-9951-45c1-9cc8-4b6eafed4285 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:56.693390 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1026/2063] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:47:56 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:47:56.694826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212162a4-454f-4603-b953-69f49c30f54c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:56.712871 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212162a4-454f-4603-b953-69f49c30f54c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:56.773608 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564c84-8eda-45d4-ad4c-fdd9184c4b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:56.774282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564c84-8eda-45d4-ad4c-fdd9184c4b73 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:56.775128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564c84-8eda-45d4-ad4c-fdd9184c4b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:56.775486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82564c84-8eda-45d4-ad4c-fdd9184c4b73 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:56.776189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82564c84-8eda-45d4-ad4c-fdd9184c4b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:56.778108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82564c84-8eda-45d4-ad4c-fdd9184c4b73 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:56.801869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1038/2064] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:47:56 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:47:56.803347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b4f88-9951-45c1-9cc8-4b6eafed4285 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:56.813944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b4f88-9951-45c1-9cc8-4b6eafed4285 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:56.819080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274f39b-f381-4e4b-9540-44e615f7b0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:56.819763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274f39b-f381-4e4b-9540-44e615f7b0df admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:56.820099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274f39b-f381-4e4b-9540-44e615f7b0df admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:56.820386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274f39b-f381-4e4b-9540-44e615f7b0df admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:56.821037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274f39b-f381-4e4b-9540-44e615f7b0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:56.823977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274f39b-f381-4e4b-9540-44e615f7b0df admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:56.841714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1027/2065] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:56.844888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564c84-8eda-45d4-ad4c-fdd9184c4b73 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:56.855413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82564c84-8eda-45d4-ad4c-fdd9184c4b73 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:56.860268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f605c-6ad4-4150-90cc-ba8a5afe2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:56.861194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f605c-6ad4-4150-90cc-ba8a5afe2df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:56.861915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f605c-6ad4-4150-90cc-ba8a5afe2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:56.862151 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f605c-6ad4-4150-90cc-ba8a5afe2df1 admin admin] PATH_INFO: `/v3/projects/c1aa4f0d03ed416a9dd9c60254648c77/users/7d4625838678488087a02021c94e7ef8/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:56.879141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f605c-6ad4-4150-90cc-ba8a5afe2df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1aa4f0d03ed416a9dd9c60254648c77, user_id=7d4625838678488087a02021c94e7ef8, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:56.881785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f605c-6ad4-4150-90cc-ba8a5afe2df1 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:56.902764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1039/2066] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:56 2022] PUT /identity/v3/projects/c1aa4f0d03ed416a9dd9c60254648c77/users/7d4625838678488087a02021c94e7ef8/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:47:56.906627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274f39b-f381-4e4b-9540-44e615f7b0df admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:56.917140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274f39b-f381-4e4b-9540-44e615f7b0df admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:56.975899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47ed8e-b616-4931-a0fd-afa63fa56846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:56.976570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ed8e-b616-4931-a0fd-afa63fa56846 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:56.976849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ed8e-b616-4931-a0fd-afa63fa56846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:56.977122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ed8e-b616-4931-a0fd-afa63fa56846 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:56.977902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47ed8e-b616-4931-a0fd-afa63fa56846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:56.979548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47ed8e-b616-4931-a0fd-afa63fa56846 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:56.990274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1028/2067] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:47:56.994783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f605c-6ad4-4150-90cc-ba8a5afe2df1 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:57.005320 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f605c-6ad4-4150-90cc-ba8a5afe2df1 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:57.010761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3583-622a-41a1-9dea-9e9c41a2c141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:57.011682 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3583-622a-41a1-9dea-9e9c41a2c141 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:57.011950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3583-622a-41a1-9dea-9e9c41a2c141 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:57.012222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3583-622a-41a1-9dea-9e9c41a2c141 admin admin] PATH_INFO: `/v3/projects/c1aa4f0d03ed416a9dd9c60254648c77/users/7d4625838678488087a02021c94e7ef8/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:57.014203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e3583-622a-41a1-9dea-9e9c41a2c141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1aa4f0d03ed416a9dd9c60254648c77, user_id=7d4625838678488087a02021c94e7ef8, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:57.016867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e3583-622a-41a1-9dea-9e9c41a2c141 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:57.029606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1040/2068] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:47:56 2022] PUT /identity/v3/projects/c1aa4f0d03ed416a9dd9c60254648c77/users/7d4625838678488087a02021c94e7ef8/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:47:57.729154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22feba-9c37-483d-8831-c50fb9ee4fae None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:57.729612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22feba-9c37-483d-8831-c50fb9ee4fae None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:57.729688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22feba-9c37-483d-8831-c50fb9ee4fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:57.761659 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-4b22feba-9c37-483d-8831-c50fb9ee4fae None None] MFA Rules not processed for user `7d4625838678488087a02021c94e7ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:47:57.763120 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4b22feba-9c37-483d-8831-c50fb9ee4fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:47:57.834957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1029/2069] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:47:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:47:57.846737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3583-622a-41a1-9dea-9e9c41a2c141 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:47:57.903649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3583-622a-41a1-9dea-9e9c41a2c141 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:47:57.907469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed6e16-0e10-49fa-a0da-79ed291cdfb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:47:57.908117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6e16-0e10-49fa-a0da-79ed291cdfb3 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:47:57.908399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6e16-0e10-49fa-a0da-79ed291cdfb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:47:57.908677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6e16-0e10-49fa-a0da-79ed291cdfb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:47:57.980569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed6e16-0e10-49fa-a0da-79ed291cdfb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:47:57.982007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed6e16-0e10-49fa-a0da-79ed291cdfb3 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:47:57.991530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1041/2070] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:47:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:02.167321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22feba-9c37-483d-8831-c50fb9ee4fae None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:02.168967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4b22feba-9c37-483d-8831-c50fb9ee4fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:02.233948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22feba-9c37-483d-8831-c50fb9ee4fae None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:02.238954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:02.239827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:02.240112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:02.240394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] PATH_INFO: `/v3/users/cfd162c8f26e4d33a95c37ebc54f6100` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:02.241586 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd162c8f26e4d33a95c37ebc54f6100)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:02.243637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:02.309980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd162c8f26e4d33a95c37ebc54f6100'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:02.330107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd162c8f26e4d33a95c37ebc54f6100'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:02.330871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd162c8f26e4d33a95c37ebc54f6100'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:02.331473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd162c8f26e4d33a95c37ebc54f6100'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:02.339014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd162c8f26e4d33a95c37ebc54f6100'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:02.353333 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1030/2071] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:02 2022] DELETE /identity/v3/users/cfd162c8f26e4d33a95c37ebc54f6100 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:02.357909 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f687-926f-4079-9efb-21e94c3da23e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:02.358472 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f687-926f-4079-9efb-21e94c3da23e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:02.358598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f687-926f-4079-9efb-21e94c3da23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:02.381041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7996f687-926f-4079-9efb-21e94c3da23e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:02.382262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7996f687-926f-4079-9efb-21e94c3da23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:02.444076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1042/2072] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:02.459078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:02.460533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:02.484929 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996f687-926f-4079-9efb-21e94c3da23e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:02.486597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7996f687-926f-4079-9efb-21e94c3da23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:02.518479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3cdd6-458d-4bd5-8496-9e5057613812 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:02.522137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23e606-87b8-4ecd-b8e5-ac806a9c98e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:02.522825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e606-87b8-4ecd-b8e5-ac806a9c98e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:02.523107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e606-87b8-4ecd-b8e5-ac806a9c98e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:02.523379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23e606-87b8-4ecd-b8e5-ac806a9c98e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:02.533088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23e606-87b8-4ecd-b8e5-ac806a9c98e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:02.534569 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23e606-87b8-4ecd-b8e5-ac806a9c98e8 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:02.543259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996f687-926f-4079-9efb-21e94c3da23e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:02.544100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1031/2073] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:02.547119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6073fa-f6bc-4641-91f4-9cecc53688b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:02.547767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6073fa-f6bc-4641-91f4-9cecc53688b7 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:02.548052 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6073fa-f6bc-4641-91f4-9cecc53688b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:02.548337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6073fa-f6bc-4641-91f4-9cecc53688b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:02.550283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7a6073fa-f6bc-4641-91f4-9cecc53688b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:02.620973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6073fa-f6bc-4641-91f4-9cecc53688b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:02.622569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6073fa-f6bc-4641-91f4-9cecc53688b7 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:02.632280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1043/2074] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:48:03.031776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23e606-87b8-4ecd-b8e5-ac806a9c98e8 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:03.033477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-df23e606-87b8-4ecd-b8e5-ac806a9c98e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:03.067687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23e606-87b8-4ecd-b8e5-ac806a9c98e8 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:03.074491 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:03.075393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:03.075678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:03.075957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] PATH_INFO: `/v3/projects/128aa8bdcbe3444f8221c11b0ed4d5c8` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:03.077169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=128aa8bdcbe3444f8221c11b0ed4d5c8)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:03.079127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:03.130213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128aa8bdcbe3444f8221c11b0ed4d5c8', 'request_id': 'req-374423be-d77a-443f-9481-794c18e24356'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.137978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128aa8bdcbe3444f8221c11b0ed4d5c8', 'request_id': 'req-374423be-d77a-443f-9481-794c18e24356'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.143460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128aa8bdcbe3444f8221c11b0ed4d5c8', 'request_id': 'req-374423be-d77a-443f-9481-794c18e24356'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.154262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] The token cache is being invalidate because project 128aa8bdcbe3444f8221c11b0ed4d5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:03.154581 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.155314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.156865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1032/2075] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:03 2022] DELETE /identity/v3/projects/128aa8bdcbe3444f8221c11b0ed4d5c8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:03.160994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6073fa-f6bc-4641-91f4-9cecc53688b7 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:03.171977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6073fa-f6bc-4641-91f4-9cecc53688b7 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:03.228600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4b57e-4ef0-4ff4-97ff-670bfb878f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:03.229380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b57e-4ef0-4ff4-97ff-670bfb878f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:03.229660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b57e-4ef0-4ff4-97ff-670bfb878f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:03.229933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b57e-4ef0-4ff4-97ff-670bfb878f0b admin admin] PATH_INFO: `/v3/users/56d7cdb5cf5b47f691c466b2e10e29c1` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:03.231344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4b57e-4ef0-4ff4-97ff-670bfb878f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d7cdb5cf5b47f691c466b2e10e29c1)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:03.233309 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4b57e-4ef0-4ff4-97ff-670bfb878f0b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:03.286240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-5ff4b57e-4ef0-4ff4-97ff-670bfb878f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d7cdb5cf5b47f691c466b2e10e29c1'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.299127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-5ff4b57e-4ef0-4ff4-97ff-670bfb878f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d7cdb5cf5b47f691c466b2e10e29c1'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.299978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-5ff4b57e-4ef0-4ff4-97ff-670bfb878f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d7cdb5cf5b47f691c466b2e10e29c1'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.300592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-5ff4b57e-4ef0-4ff4-97ff-670bfb878f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d7cdb5cf5b47f691c466b2e10e29c1'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.309033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-5ff4b57e-4ef0-4ff4-97ff-670bfb878f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d7cdb5cf5b47f691c466b2e10e29c1'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.321492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1044/2076] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:03 2022] DELETE /identity/v3/users/56d7cdb5cf5b47f691c466b2e10e29c1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:03.597752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:03.599372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:03.614252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374423be-d77a-443f-9481-794c18e24356 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:03.671849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:03.672699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:03.672986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:03.673263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] PATH_INFO: `/v3/projects/6070e1d72a9046c9a46fbc5614239b21` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:03.674472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6070e1d72a9046c9a46fbc5614239b21)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:03.676384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:03.721591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6070e1d72a9046c9a46fbc5614239b21', 'request_id': 'req-d3b480bf-554c-4919-86c0-e9c4e44ca77b'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.729704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6070e1d72a9046c9a46fbc5614239b21', 'request_id': 'req-d3b480bf-554c-4919-86c0-e9c4e44ca77b'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.735248 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6070e1d72a9046c9a46fbc5614239b21', 'request_id': 'req-d3b480bf-554c-4919-86c0-e9c4e44ca77b'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.747722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] The token cache is being invalidate because project 6070e1d72a9046c9a46fbc5614239b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:03.747982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.748620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d3b480bf-554c-4919-86c0-e9c4e44ca77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:03.750164 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1033/2077] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:03 2022] DELETE /identity/v3/projects/6070e1d72a9046c9a46fbc5614239b21 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:03.755560 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13072dd-ba9c-4535-b229-740c36818741 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:03.756028 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13072dd-ba9c-4535-b229-740c36818741 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:03.756246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13072dd-ba9c-4535-b229-740c36818741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:03.775243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d13072dd-ba9c-4535-b229-740c36818741 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:03.776442 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d13072dd-ba9c-4535-b229-740c36818741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:03.833787 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1045/2078] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:03.841720 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f4df1-86fb-4f14-9b03-885aa7902f9e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:03.842017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f4df1-86fb-4f14-9b03-885aa7902f9e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:03.842301 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f4df1-86fb-4f14-9b03-885aa7902f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:03.860751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-2d3f4df1-86fb-4f14-9b03-885aa7902f9e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:03.862207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2d3f4df1-86fb-4f14-9b03-885aa7902f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:03.871398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1034/2079] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:03.875595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13072dd-ba9c-4535-b229-740c36818741 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:03.885988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13072dd-ba9c-4535-b229-740c36818741 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:03.891070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b5552-e7a7-4da8-af99-9d3c99d29879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:03.891724 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5552-e7a7-4da8-af99-9d3c99d29879 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:03.892003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5552-e7a7-4da8-af99-9d3c99d29879 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:03.892280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5552-e7a7-4da8-af99-9d3c99d29879 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:03.893045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b5552-e7a7-4da8-af99-9d3c99d29879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:48:03.893349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b5552-e7a7-4da8-af99-9d3c99d29879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:03.894989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b5552-e7a7-4da8-af99-9d3c99d29879 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:03.906525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1046/2080] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:48:03.910853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f4df1-86fb-4f14-9b03-885aa7902f9e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:03.921325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f4df1-86fb-4f14-9b03-885aa7902f9e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:03.925975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f936e0-320d-4030-bef0-3f1714855f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:03.926656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f936e0-320d-4030-bef0-3f1714855f8c admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:03.926940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f936e0-320d-4030-bef0-3f1714855f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:03.927217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f936e0-320d-4030-bef0-3f1714855f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:03.927929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f936e0-320d-4030-bef0-3f1714855f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:03.929820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f936e0-320d-4030-bef0-3f1714855f8c admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:03.955622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1035/2081] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:48:03 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:03.959763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b5552-e7a7-4da8-af99-9d3c99d29879 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:03.970299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b5552-e7a7-4da8-af99-9d3c99d29879 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:04.026470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7985b9-b5fc-47e3-8771-9951e8b73d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:04.027061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7985b9-b5fc-47e3-8771-9951e8b73d3c admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:04.027343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7985b9-b5fc-47e3-8771-9951e8b73d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:04.027620 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7985b9-b5fc-47e3-8771-9951e8b73d3c admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:04.028320 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7985b9-b5fc-47e3-8771-9951e8b73d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:04.030237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7985b9-b5fc-47e3-8771-9951e8b73d3c admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:04.051930 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1047/2082] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:48:03 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:04.055544 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f936e0-320d-4030-bef0-3f1714855f8c admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:04.065648 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f936e0-320d-4030-bef0-3f1714855f8c admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:04.071299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb96e1-ff9d-4636-af11-32c970b18f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:04.072572 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb96e1-ff9d-4636-af11-32c970b18f62 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:04.072863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb96e1-ff9d-4636-af11-32c970b18f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:04.073144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb96e1-ff9d-4636-af11-32c970b18f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:04.073926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb96e1-ff9d-4636-af11-32c970b18f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:04.075559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb96e1-ff9d-4636-af11-32c970b18f62 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:04.088748 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1036/2083] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:04.092859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7985b9-b5fc-47e3-8771-9951e8b73d3c admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:04.104196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7985b9-b5fc-47e3-8771-9951e8b73d3c admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:04.109452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ebb05-edda-43c5-8c26-90c7bb737859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:04.110101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ebb05-edda-43c5-8c26-90c7bb737859 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:04.110462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ebb05-edda-43c5-8c26-90c7bb737859 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:04.110749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ebb05-edda-43c5-8c26-90c7bb737859 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:04.111739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ebb05-edda-43c5-8c26-90c7bb737859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:04.113332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ebb05-edda-43c5-8c26-90c7bb737859 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:04.124059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1048/2084] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:04.128185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb96e1-ff9d-4636-af11-32c970b18f62 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:04.138984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb96e1-ff9d-4636-af11-32c970b18f62 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:04.143700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb042-76d7-4e61-8fb9-733abb783b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:04.144552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb042-76d7-4e61-8fb9-733abb783b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:04.144857 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb042-76d7-4e61-8fb9-733abb783b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:04.145100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb042-76d7-4e61-8fb9-733abb783b01 admin admin] PATH_INFO: `/v3/projects/ec84bcdeb663457e9efe6a2393f8d0b8/users/1e48ce2c5f724798a7aabb4d637b558b/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:04.160574 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8eb042-76d7-4e61-8fb9-733abb783b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec84bcdeb663457e9efe6a2393f8d0b8, user_id=1e48ce2c5f724798a7aabb4d637b558b, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:04.163276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8eb042-76d7-4e61-8fb9-733abb783b01 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:04.177117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1037/2085] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:04 2022] PUT /identity/v3/projects/ec84bcdeb663457e9efe6a2393f8d0b8/users/1e48ce2c5f724798a7aabb4d637b558b/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:04.194117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22d078-2c05-4419-b98e-7e982328cebe None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:04.194654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22d078-2c05-4419-b98e-7e982328cebe None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:04.195131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22d078-2c05-4419-b98e-7e982328cebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:04.223188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-8c22d078-2c05-4419-b98e-7e982328cebe None None] MFA Rules not processed for user `1e48ce2c5f724798a7aabb4d637b558b`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:04.224387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8c22d078-2c05-4419-b98e-7e982328cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:04.298960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1049/2086] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:04.309872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb042-76d7-4e61-8fb9-733abb783b01 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:04.311570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2c8eb042-76d7-4e61-8fb9-733abb783b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:04.368860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb042-76d7-4e61-8fb9-733abb783b01 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:04.372583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7986ea-08de-4ff2-b8fd-1649b8bb4f9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:04.373225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7986ea-08de-4ff2-b8fd-1649b8bb4f9b service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:04.373508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7986ea-08de-4ff2-b8fd-1649b8bb4f9b service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:04.373781 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7986ea-08de-4ff2-b8fd-1649b8bb4f9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:04.382068 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7986ea-08de-4ff2-b8fd-1649b8bb4f9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:04.383538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7986ea-08de-4ff2-b8fd-1649b8bb4f9b service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:04.393707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1038/2087] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:04.412893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22d078-2c05-4419-b98e-7e982328cebe None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:04.474336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22d078-2c05-4419-b98e-7e982328cebe None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:04.479206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:04.480062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:04.480347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:04.480650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] PATH_INFO: `/v3/users/1e48ce2c5f724798a7aabb4d637b558b` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:04.481857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e48ce2c5f724798a7aabb4d637b558b)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:04.483828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:04.529892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e48ce2c5f724798a7aabb4d637b558b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:04.541397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e48ce2c5f724798a7aabb4d637b558b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:04.542095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e48ce2c5f724798a7aabb4d637b558b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:04.542749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e48ce2c5f724798a7aabb4d637b558b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:04.549344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e48ce2c5f724798a7aabb4d637b558b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:04.561703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1050/2088] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:04 2022] DELETE /identity/v3/users/1e48ce2c5f724798a7aabb4d637b558b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:04.566183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b75481-b328-4599-bd7c-7fbe461dd5d3 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:04.566512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b75481-b328-4599-bd7c-7fbe461dd5d3 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:04.566819 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b75481-b328-4599-bd7c-7fbe461dd5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:04.585808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-33b75481-b328-4599-bd7c-7fbe461dd5d3 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:04.587711 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-33b75481-b328-4599-bd7c-7fbe461dd5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:04.644639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1039/2089] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:04.655189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:04.656584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:04.720135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c8d58-c3bb-4201-bdba-0bf99f95effb admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:04.723799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b481b-954a-4b32-afb3-b545d13e95e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:04.724514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b481b-954a-4b32-afb3-b545d13e95e3 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:04.724800 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b481b-954a-4b32-afb3-b545d13e95e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:04.725072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b481b-954a-4b32-afb3-b545d13e95e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:04.734787 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b481b-954a-4b32-afb3-b545d13e95e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:04.736223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b481b-954a-4b32-afb3-b545d13e95e3 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:04.747411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1051/2090] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:05.019850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b75481-b328-4599-bd7c-7fbe461dd5d3 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:05.021262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-33b75481-b328-4599-bd7c-7fbe461dd5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:05.034783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b75481-b328-4599-bd7c-7fbe461dd5d3 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:05.039795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:05.040910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:05.041226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:05.041460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] PATH_INFO: `/v3/projects/ec84bcdeb663457e9efe6a2393f8d0b8` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:05.042842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec84bcdeb663457e9efe6a2393f8d0b8)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:05.044828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:05.094617 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec84bcdeb663457e9efe6a2393f8d0b8', 'request_id': 'req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:05.101309 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec84bcdeb663457e9efe6a2393f8d0b8', 'request_id': 'req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:05.107127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec84bcdeb663457e9efe6a2393f8d0b8', 'request_id': 'req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:05.118971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] The token cache is being invalidate because project ec84bcdeb663457e9efe6a2393f8d0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:05.119239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:05.120208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1d907b31-1f4f-42b2-b31b-2eda420f9dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:05.121844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1040/2091] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:05 2022] DELETE /identity/v3/projects/ec84bcdeb663457e9efe6a2393f8d0b8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:05.127064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2c296-a8e6-491e-b66c-60144bf67436 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:05.127493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2c296-a8e6-491e-b66c-60144bf67436 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:05.127708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2c296-a8e6-491e-b66c-60144bf67436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:05.145514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-23f2c296-a8e6-491e-b66c-60144bf67436 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:05.146860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-23f2c296-a8e6-491e-b66c-60144bf67436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:05.208167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1052/2092] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:05.218103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42f597-6dc1-45c8-accc-ff381bfb3cae None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:05.218433 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42f597-6dc1-45c8-accc-ff381bfb3cae None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:05.218715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42f597-6dc1-45c8-accc-ff381bfb3cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:05.237195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6d42f597-6dc1-45c8-accc-ff381bfb3cae None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:05.238417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6d42f597-6dc1-45c8-accc-ff381bfb3cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:05.247794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1041/2093] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:05.252200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2c296-a8e6-491e-b66c-60144bf67436 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:05.261718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2c296-a8e6-491e-b66c-60144bf67436 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:05.266335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6d30a-1ec3-4b01-8a79-4dbf6a45be09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:05.267007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6d30a-1ec3-4b01-8a79-4dbf6a45be09 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:05.267292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6d30a-1ec3-4b01-8a79-4dbf6a45be09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:05.267570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6d30a-1ec3-4b01-8a79-4dbf6a45be09 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:05.268303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6d30a-1ec3-4b01-8a79-4dbf6a45be09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:48:05.268612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6d30a-1ec3-4b01-8a79-4dbf6a45be09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:05.270213 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6d30a-1ec3-4b01-8a79-4dbf6a45be09 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:05.282053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1053/2094] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:48:05.286376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42f597-6dc1-45c8-accc-ff381bfb3cae None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:05.296021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42f597-6dc1-45c8-accc-ff381bfb3cae None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:05.302442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854abcd-9928-4f36-aac8-dab2b1abb5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:05.303081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854abcd-9928-4f36-aac8-dab2b1abb5ff admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:05.303396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854abcd-9928-4f36-aac8-dab2b1abb5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:05.303674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854abcd-9928-4f36-aac8-dab2b1abb5ff admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:05.304361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854abcd-9928-4f36-aac8-dab2b1abb5ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:05.306949 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854abcd-9928-4f36-aac8-dab2b1abb5ff admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:05.335630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1042/2095] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:48:05 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:05.336759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6d30a-1ec3-4b01-8a79-4dbf6a45be09 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:05.351162 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6d30a-1ec3-4b01-8a79-4dbf6a45be09 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:05.413637 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd7657-f18a-43b4-96af-57d26f8c9bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:05.414341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7657-f18a-43b4-96af-57d26f8c9bfb admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:05.414635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7657-f18a-43b4-96af-57d26f8c9bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:05.414913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7657-f18a-43b4-96af-57d26f8c9bfb admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:05.416151 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd7657-f18a-43b4-96af-57d26f8c9bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:05.418089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd7657-f18a-43b4-96af-57d26f8c9bfb admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:05.439645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1054/2096] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:48:05 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:48:05.443473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854abcd-9928-4f36-aac8-dab2b1abb5ff admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:05.456560 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854abcd-9928-4f36-aac8-dab2b1abb5ff admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:05.463545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05400a28-a777-4a61-b97a-8e01a53fc48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:05.464270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05400a28-a777-4a61-b97a-8e01a53fc48b admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:05.464670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05400a28-a777-4a61-b97a-8e01a53fc48b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:05.464867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05400a28-a777-4a61-b97a-8e01a53fc48b admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:05.475525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05400a28-a777-4a61-b97a-8e01a53fc48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:05.475525 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05400a28-a777-4a61-b97a-8e01a53fc48b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:05.483361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1043/2097] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:05.484378 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd7657-f18a-43b4-96af-57d26f8c9bfb admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:05.495916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd7657-f18a-43b4-96af-57d26f8c9bfb admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:05.500523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c781289-d21b-4d43-a92b-92a47b2a59b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:05.501174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781289-d21b-4d43-a92b-92a47b2a59b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:05.501457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781289-d21b-4d43-a92b-92a47b2a59b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:05.501740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c781289-d21b-4d43-a92b-92a47b2a59b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:05.502506 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c781289-d21b-4d43-a92b-92a47b2a59b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:05.504102 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c781289-d21b-4d43-a92b-92a47b2a59b4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:05.515928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1055/2098] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:48:05.520121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05400a28-a777-4a61-b97a-8e01a53fc48b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:05.530767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05400a28-a777-4a61-b97a-8e01a53fc48b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:05.535773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da58ec-7ee3-4c2c-9625-6fd908516d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:05.536692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da58ec-7ee3-4c2c-9625-6fd908516d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:05.536925 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da58ec-7ee3-4c2c-9625-6fd908516d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:05.537203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da58ec-7ee3-4c2c-9625-6fd908516d0b admin admin] PATH_INFO: `/v3/projects/c5087f1cbd764a11a7b4f74da8f3ec1b/users/913a8bf4fc2847cbb0d84f48fcb80220/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:05.552245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da58ec-7ee3-4c2c-9625-6fd908516d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5087f1cbd764a11a7b4f74da8f3ec1b, user_id=913a8bf4fc2847cbb0d84f48fcb80220, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:05.554969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da58ec-7ee3-4c2c-9625-6fd908516d0b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:05.568133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1044/2099] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:05 2022] PUT /identity/v3/projects/c5087f1cbd764a11a7b4f74da8f3ec1b/users/913a8bf4fc2847cbb0d84f48fcb80220/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:05.578933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8233-a4cc-48fd-b45e-0b41b2f5d110 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:05.579380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8233-a4cc-48fd-b45e-0b41b2f5d110 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:05.579855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c8233-a4cc-48fd-b45e-0b41b2f5d110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:05.609806 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b45c8233-a4cc-48fd-b45e-0b41b2f5d110 None None] MFA Rules not processed for user `913a8bf4fc2847cbb0d84f48fcb80220`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:05.612130 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b45c8233-a4cc-48fd-b45e-0b41b2f5d110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:05.677910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1056/2100] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:05.689159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da58ec-7ee3-4c2c-9625-6fd908516d0b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:05.690891 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-06da58ec-7ee3-4c2c-9625-6fd908516d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:05.745876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da58ec-7ee3-4c2c-9625-6fd908516d0b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:05.749704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aee83e-49dd-4d40-b494-b12c7ee546d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd346be1ef7604f1f87371f5d322fd010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:05.750361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aee83e-49dd-4d40-b494-b12c7ee546d0 service glance] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:05.750644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aee83e-49dd-4d40-b494-b12c7ee546d0 service glance] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:05.750911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aee83e-49dd-4d40-b494-b12c7ee546d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:05.759348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aee83e-49dd-4d40-b494-b12c7ee546d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:05.760783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aee83e-49dd-4d40-b494-b12c7ee546d0 service glance] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:05.769458 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1045/2101] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:09.661536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c8233-a4cc-48fd-b45e-0b41b2f5d110 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:09.663075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b45c8233-a4cc-48fd-b45e-0b41b2f5d110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:09.732639 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c8233-a4cc-48fd-b45e-0b41b2f5d110 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:09.738001 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:09.738915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:09.739785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:09.740077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] PATH_INFO: `/v3/users/ee9e8845d84e4ed291de260dad44308d` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:09.741470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9e8845d84e4ed291de260dad44308d)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:09.743549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:09.791696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9e8845d84e4ed291de260dad44308d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:09.803622 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9e8845d84e4ed291de260dad44308d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:09.804453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9e8845d84e4ed291de260dad44308d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:09.805082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9e8845d84e4ed291de260dad44308d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:09.812160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9e8845d84e4ed291de260dad44308d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:09.825748 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1057/2102] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:09 2022] DELETE /identity/v3/users/ee9e8845d84e4ed291de260dad44308d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:09.830433 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527c4ce-1728-4be8-a3ab-a3f095e0b0e7 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:09.831036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527c4ce-1728-4be8-a3ab-a3f095e0b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:09.831036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527c4ce-1728-4be8-a3ab-a3f095e0b0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:09.849362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-2527c4ce-1728-4be8-a3ab-a3f095e0b0e7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:09.850588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2527c4ce-1728-4be8-a3ab-a3f095e0b0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:09.911081 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1046/2103] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:09.921216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:09.922806 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:09.983651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c186b-f66f-4a90-8a05-8d0a7f350e6b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:09.987749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1f10d-bd2c-426f-ace9-0181a7b586b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:09.988415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1f10d-bd2c-426f-ace9-0181a7b586b6 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:09.988703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1f10d-bd2c-426f-ace9-0181a7b586b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:09.988984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1f10d-bd2c-426f-ace9-0181a7b586b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:09.999210 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1f10d-bd2c-426f-ace9-0181a7b586b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:10.000685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1f10d-bd2c-426f-ace9-0181a7b586b6 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:10.011613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1058/2104] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:10.284898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527c4ce-1728-4be8-a3ab-a3f095e0b0e7 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:10.286413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2527c4ce-1728-4be8-a3ab-a3f095e0b0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:10.299137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527c4ce-1728-4be8-a3ab-a3f095e0b0e7 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:10.304000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:10.304958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:10.305244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:10.305549 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] PATH_INFO: `/v3/projects/30f37fbad5cd43f6848efdd436546bab` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:10.307077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30f37fbad5cd43f6848efdd436546bab)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:10.309133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:10.361181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30f37fbad5cd43f6848efdd436546bab', 'request_id': 'req-4fa173c8-b166-4c7c-a017-38da633db9d4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:10.369910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30f37fbad5cd43f6848efdd436546bab', 'request_id': 'req-4fa173c8-b166-4c7c-a017-38da633db9d4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:10.375545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30f37fbad5cd43f6848efdd436546bab', 'request_id': 'req-4fa173c8-b166-4c7c-a017-38da633db9d4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:10.389290 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] The token cache is being invalidate because project 30f37fbad5cd43f6848efdd436546bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:10.389585 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:10.390254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4fa173c8-b166-4c7c-a017-38da633db9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:10.392037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1047/2105] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:10 2022] DELETE /identity/v3/projects/30f37fbad5cd43f6848efdd436546bab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:20.140296 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1f10d-bd2c-426f-ace9-0181a7b586b6 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:20.144495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a2b1f10d-bd2c-426f-ace9-0181a7b586b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:20.159866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1f10d-bd2c-426f-ace9-0181a7b586b6 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:20.224012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:20.225366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:20.225742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:20.226275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] PATH_INFO: `/v3/users/451f023a11a745e3aef0c23dd1e3a41c` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:20.229477 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=451f023a11a745e3aef0c23dd1e3a41c)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:20.232201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:20.283221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451f023a11a745e3aef0c23dd1e3a41c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:20.294901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451f023a11a745e3aef0c23dd1e3a41c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:20.295566 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451f023a11a745e3aef0c23dd1e3a41c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:20.296160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451f023a11a745e3aef0c23dd1e3a41c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:20.302629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451f023a11a745e3aef0c23dd1e3a41c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:20.317696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1059/2106] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:20 2022] DELETE /identity/v3/users/451f023a11a745e3aef0c23dd1e3a41c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:20.322238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25ae04-bbe7-4735-b56b-aa63a21207bf None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:20.322747 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25ae04-bbe7-4735-b56b-aa63a21207bf None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:20.322839 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25ae04-bbe7-4735-b56b-aa63a21207bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:20.340559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-cd25ae04-bbe7-4735-b56b-aa63a21207bf None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:20.341748 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-cd25ae04-bbe7-4735-b56b-aa63a21207bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:20.405704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1048/2107] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:20.416753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:20.418143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:20.485312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46826b82-ee29-4a11-83a7-baa1f28867e4 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:20.489103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf53c9-5693-4fdd-8079-35fa5cc4cf20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:20.489741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf53c9-5693-4fdd-8079-35fa5cc4cf20 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:20.490023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf53c9-5693-4fdd-8079-35fa5cc4cf20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:20.490297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf53c9-5693-4fdd-8079-35fa5cc4cf20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:20.499736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf53c9-5693-4fdd-8079-35fa5cc4cf20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:20.501177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf53c9-5693-4fdd-8079-35fa5cc4cf20 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:20.511512 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1060/2108] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:48:20.791034 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25ae04-bbe7-4735-b56b-aa63a21207bf None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:20.792504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-cd25ae04-bbe7-4735-b56b-aa63a21207bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:20.805265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25ae04-bbe7-4735-b56b-aa63a21207bf None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:20.815481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:20.816356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:20.816630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:20.816899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] PATH_INFO: `/v3/projects/ef77e5a7b74e485fb8f6f7a90cfa0f2d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:20.818272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef77e5a7b74e485fb8f6f7a90cfa0f2d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:20.820451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:20.873173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef77e5a7b74e485fb8f6f7a90cfa0f2d', 'request_id': 'req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:20.880631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef77e5a7b74e485fb8f6f7a90cfa0f2d', 'request_id': 'req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:20.886760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef77e5a7b74e485fb8f6f7a90cfa0f2d', 'request_id': 'req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:20.897547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] The token cache is being invalidate because project ef77e5a7b74e485fb8f6f7a90cfa0f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:20.897834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:20.898501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f7d5fabc-89dc-48ab-9b48-d971deb08a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:20.900328 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1049/2109] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:20 2022] DELETE /identity/v3/projects/ef77e5a7b74e485fb8f6f7a90cfa0f2d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:20.905227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c039-65ac-4d96-9f06-26bd37dc297c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:20.905515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c039-65ac-4d96-9f06-26bd37dc297c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:20.905793 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61c039-65ac-4d96-9f06-26bd37dc297c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:20.923876 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-0c61c039-65ac-4d96-9f06-26bd37dc297c None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:20.925011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0c61c039-65ac-4d96-9f06-26bd37dc297c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:20.996220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1061/2110] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:20.997243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e9b6-8f3a-49eb-b8d1-b2883cb99efc None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:20.997530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e9b6-8f3a-49eb-b8d1-b2883cb99efc None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:20.997807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845e9b6-8f3a-49eb-b8d1-b2883cb99efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:21.018639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-f845e9b6-8f3a-49eb-b8d1-b2883cb99efc None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:21.023991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f845e9b6-8f3a-49eb-b8d1-b2883cb99efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:21.032608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1050/2111] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:21.037003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61c039-65ac-4d96-9f06-26bd37dc297c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:21.048023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61c039-65ac-4d96-9f06-26bd37dc297c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:21.054064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b988038-1c85-4fce-ae6b-d165a1b6eebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:21.054970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b988038-1c85-4fce-ae6b-d165a1b6eebb admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:21.055239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b988038-1c85-4fce-ae6b-d165a1b6eebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:21.059725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b988038-1c85-4fce-ae6b-d165a1b6eebb admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:21.060697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b988038-1c85-4fce-ae6b-d165a1b6eebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:48:21.061078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b988038-1c85-4fce-ae6b-d165a1b6eebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:21.062967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b988038-1c85-4fce-ae6b-d165a1b6eebb admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:21.078370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1062/2112] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:48:21.080710 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845e9b6-8f3a-49eb-b8d1-b2883cb99efc None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:21.092922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845e9b6-8f3a-49eb-b8d1-b2883cb99efc None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:21.101129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1a60e-f2d2-4a1f-a3d1-b17f928e7643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:21.102063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1a60e-f2d2-4a1f-a3d1-b17f928e7643 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:21.103080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1a60e-f2d2-4a1f-a3d1-b17f928e7643 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:21.103523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1a60e-f2d2-4a1f-a3d1-b17f928e7643 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:21.104280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1a60e-f2d2-4a1f-a3d1-b17f928e7643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:21.106243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1a60e-f2d2-4a1f-a3d1-b17f928e7643 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:21.141828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1051/2113] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:48:21 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:21.143293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b988038-1c85-4fce-ae6b-d165a1b6eebb admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:21.153491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b988038-1c85-4fce-ae6b-d165a1b6eebb admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:21.209896 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f7e0-68f2-4de8-8576-51d66505bcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:21.210601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f7e0-68f2-4de8-8576-51d66505bcd9 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:21.210877 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f7e0-68f2-4de8-8576-51d66505bcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:21.211151 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f7e0-68f2-4de8-8576-51d66505bcd9 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:21.211851 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f7e0-68f2-4de8-8576-51d66505bcd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:21.214407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f7e0-68f2-4de8-8576-51d66505bcd9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:21.235496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1063/2114] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:48:21 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:48:21.239787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1a60e-f2d2-4a1f-a3d1-b17f928e7643 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:21.250743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1a60e-f2d2-4a1f-a3d1-b17f928e7643 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:21.260348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4146d51-b894-4c2d-a669-af73913d3359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:21.261023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4146d51-b894-4c2d-a669-af73913d3359 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:21.261306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4146d51-b894-4c2d-a669-af73913d3359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:21.261583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4146d51-b894-4c2d-a669-af73913d3359 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:21.262348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4146d51-b894-4c2d-a669-af73913d3359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:21.263947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4146d51-b894-4c2d-a669-af73913d3359 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:21.281181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1052/2115] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:21.283277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f7e0-68f2-4de8-8576-51d66505bcd9 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:21.295150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f7e0-68f2-4de8-8576-51d66505bcd9 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:21.302816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242566c3-e210-41c6-89fa-fd1c3c01e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:21.303815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242566c3-e210-41c6-89fa-fd1c3c01e35e admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:21.304195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242566c3-e210-41c6-89fa-fd1c3c01e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:21.304694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242566c3-e210-41c6-89fa-fd1c3c01e35e admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:21.305532 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242566c3-e210-41c6-89fa-fd1c3c01e35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:21.307631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242566c3-e210-41c6-89fa-fd1c3c01e35e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:21.318474 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1064/2116] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:21.323598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4146d51-b894-4c2d-a669-af73913d3359 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:21.335500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4146d51-b894-4c2d-a669-af73913d3359 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:21.345273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df52b6-f45b-4bd9-8bb1-ead70fe388a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:21.346188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df52b6-f45b-4bd9-8bb1-ead70fe388a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:21.346495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df52b6-f45b-4bd9-8bb1-ead70fe388a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:21.346774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df52b6-f45b-4bd9-8bb1-ead70fe388a2 admin admin] PATH_INFO: `/v3/projects/5fba11e8ade54d388361c4c936a43372/users/6d5f259e0b98457ea6b6b88d886c813d/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:21.366661 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df52b6-f45b-4bd9-8bb1-ead70fe388a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fba11e8ade54d388361c4c936a43372, user_id=6d5f259e0b98457ea6b6b88d886c813d, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:21.369523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df52b6-f45b-4bd9-8bb1-ead70fe388a2 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:21.388254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1053/2117] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:21 2022] PUT /identity/v3/projects/5fba11e8ade54d388361c4c936a43372/users/6d5f259e0b98457ea6b6b88d886c813d/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:21.393202 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cac13-f69b-4c02-91f6-35da43a635b0 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:21.393649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cac13-f69b-4c02-91f6-35da43a635b0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:21.393938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cac13-f69b-4c02-91f6-35da43a635b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:21.415710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-e06cac13-f69b-4c02-91f6-35da43a635b0 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:21.417452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e06cac13-f69b-4c02-91f6-35da43a635b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:21.494665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1065/2118] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:21.503199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df52b6-f45b-4bd9-8bb1-ead70fe388a2 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:21.504831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d3df52b6-f45b-4bd9-8bb1-ead70fe388a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:21.570791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df52b6-f45b-4bd9-8bb1-ead70fe388a2 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:21.575678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c62f88-5f58-4c20-9b0d-2d8b1f8d328d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:21.576196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c62f88-5f58-4c20-9b0d-2d8b1f8d328d service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:21.576478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c62f88-5f58-4c20-9b0d-2d8b1f8d328d service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:21.576752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c62f88-5f58-4c20-9b0d-2d8b1f8d328d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:21.589228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c62f88-5f58-4c20-9b0d-2d8b1f8d328d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:21.591165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c62f88-5f58-4c20-9b0d-2d8b1f8d328d service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:21.601666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1054/2119] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:24.122796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cac13-f69b-4c02-91f6-35da43a635b0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:24.124938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e06cac13-f69b-4c02-91f6-35da43a635b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:24.147264 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cac13-f69b-4c02-91f6-35da43a635b0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:24.155700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfb498-30bb-42e4-b203-3801f7d29344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:24.157537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfb498-30bb-42e4-b203-3801f7d29344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:24.158201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfb498-30bb-42e4-b203-3801f7d29344 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:24.158716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfb498-30bb-42e4-b203-3801f7d29344 admin admin] PATH_INFO: `/v3/users/aad828d8ff314a2d82f07fb6d84f36a8` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:24.160902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfb498-30bb-42e4-b203-3801f7d29344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad828d8ff314a2d82f07fb6d84f36a8)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:24.163527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfb498-30bb-42e4-b203-3801f7d29344 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:24.238021 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8adfb498-30bb-42e4-b203-3801f7d29344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad828d8ff314a2d82f07fb6d84f36a8'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:24.253015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8adfb498-30bb-42e4-b203-3801f7d29344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad828d8ff314a2d82f07fb6d84f36a8'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:24.253760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8adfb498-30bb-42e4-b203-3801f7d29344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad828d8ff314a2d82f07fb6d84f36a8'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:24.254702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8adfb498-30bb-42e4-b203-3801f7d29344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad828d8ff314a2d82f07fb6d84f36a8'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:24.262826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8adfb498-30bb-42e4-b203-3801f7d29344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad828d8ff314a2d82f07fb6d84f36a8'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:24.279945 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1066/2120] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:24 2022] DELETE /identity/v3/users/aad828d8ff314a2d82f07fb6d84f36a8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:24.505303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c62f88-5f58-4c20-9b0d-2d8b1f8d328d service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:24.517088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c62f88-5f58-4c20-9b0d-2d8b1f8d328d service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:24.610395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:24.611354 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:24.611950 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:24.612286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] PATH_INFO: `/v3/projects/6388da70b0dc48c1952570af4332dd6d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:24.625265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6388da70b0dc48c1952570af4332dd6d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:24.627729 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:24.735809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6388da70b0dc48c1952570af4332dd6d', 'request_id': 'req-074ff99b-875e-4ff1-b6d2-4ab042318738'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:24.753940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6388da70b0dc48c1952570af4332dd6d', 'request_id': 'req-074ff99b-875e-4ff1-b6d2-4ab042318738'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:24.768111 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6388da70b0dc48c1952570af4332dd6d', 'request_id': 'req-074ff99b-875e-4ff1-b6d2-4ab042318738'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:24.813256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] The token cache is being invalidate because project 6388da70b0dc48c1952570af4332dd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:24.815960 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:24.817013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074ff99b-875e-4ff1-b6d2-4ab042318738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:24.821773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1055/2121] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:24 2022] DELETE /identity/v3/projects/6388da70b0dc48c1952570af4332dd6d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:24.827921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add261de-a909-4a89-8d1c-1f924fae2b59 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:24.828244 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add261de-a909-4a89-8d1c-1f924fae2b59 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:24.828513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add261de-a909-4a89-8d1c-1f924fae2b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:24.896910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-add261de-a909-4a89-8d1c-1f924fae2b59 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:24.898143 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-add261de-a909-4a89-8d1c-1f924fae2b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:25.075851 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1067/2122] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:25.084094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427573b-1098-41d1-a83d-3b43d0556a6a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:25.084402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427573b-1098-41d1-a83d-3b43d0556a6a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:25.084717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427573b-1098-41d1-a83d-3b43d0556a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:25.140601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e427573b-1098-41d1-a83d-3b43d0556a6a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:25.141841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e427573b-1098-41d1-a83d-3b43d0556a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:25.163107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1056/2123] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:25.166833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add261de-a909-4a89-8d1c-1f924fae2b59 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:25.177559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add261de-a909-4a89-8d1c-1f924fae2b59 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:25.196903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692e65c-82d9-488d-8e9f-d9c0507e7c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:25.198500 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692e65c-82d9-488d-8e9f-d9c0507e7c38 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:25.198938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692e65c-82d9-488d-8e9f-d9c0507e7c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:25.199472 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692e65c-82d9-488d-8e9f-d9c0507e7c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:25.200397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692e65c-82d9-488d-8e9f-d9c0507e7c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:48:25.200959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692e65c-82d9-488d-8e9f-d9c0507e7c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:25.206211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692e65c-82d9-488d-8e9f-d9c0507e7c38 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:25.237383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1068/2124] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:48:25.239048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427573b-1098-41d1-a83d-3b43d0556a6a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:25.258870 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427573b-1098-41d1-a83d-3b43d0556a6a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:25.268728 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaebbf-5957-4312-b087-d6cf4ef1a43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:25.270235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaebbf-5957-4312-b087-d6cf4ef1a43a admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:25.270723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaebbf-5957-4312-b087-d6cf4ef1a43a admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:25.272530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaebbf-5957-4312-b087-d6cf4ef1a43a admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:25.273433 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaebbf-5957-4312-b087-d6cf4ef1a43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:25.277723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaebbf-5957-4312-b087-d6cf4ef1a43a admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:25.325599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1057/2125] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:48:25 2022] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:25.330740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692e65c-82d9-488d-8e9f-d9c0507e7c38 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:25.345435 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692e65c-82d9-488d-8e9f-d9c0507e7c38 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:25.420102 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab91cb-25a7-445b-a4a1-b9caa392c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:25.420779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab91cb-25a7-445b-a4a1-b9caa392c748 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:25.421059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab91cb-25a7-445b-a4a1-b9caa392c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:25.421333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab91cb-25a7-445b-a4a1-b9caa392c748 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:25.422104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab91cb-25a7-445b-a4a1-b9caa392c748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:25.424116 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab91cb-25a7-445b-a4a1-b9caa392c748 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:25.451650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1069/2126] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:48:25 2022] POST /identity/v3/users => generated 303 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:25.455686 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaebbf-5957-4312-b087-d6cf4ef1a43a admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:25.466899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaebbf-5957-4312-b087-d6cf4ef1a43a admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:25.471700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05022b99-3ba6-4018-855c-e7669c3bd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:25.472354 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05022b99-3ba6-4018-855c-e7669c3bd2af admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:25.472814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05022b99-3ba6-4018-855c-e7669c3bd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:25.473085 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05022b99-3ba6-4018-855c-e7669c3bd2af admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:25.473845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05022b99-3ba6-4018-855c-e7669c3bd2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:25.475465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05022b99-3ba6-4018-855c-e7669c3bd2af admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:25.486848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1058/2127] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:25.491051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab91cb-25a7-445b-a4a1-b9caa392c748 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:25.502251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab91cb-25a7-445b-a4a1-b9caa392c748 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:25.507084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d161b8-677c-4ff9-b908-798044124dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:25.508479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d161b8-677c-4ff9-b908-798044124dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:25.509303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d161b8-677c-4ff9-b908-798044124dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:25.509581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d161b8-677c-4ff9-b908-798044124dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:25.510696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d161b8-677c-4ff9-b908-798044124dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:25.512315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d161b8-677c-4ff9-b908-798044124dc8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:25.522383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1070/2128] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:25.527166 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05022b99-3ba6-4018-855c-e7669c3bd2af admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:25.538674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05022b99-3ba6-4018-855c-e7669c3bd2af admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:25.545397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836f54f-f275-482e-989a-3a29d434372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:25.547017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836f54f-f275-482e-989a-3a29d434372f admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:25.547302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836f54f-f275-482e-989a-3a29d434372f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:25.547575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836f54f-f275-482e-989a-3a29d434372f admin admin] PATH_INFO: `/v3/projects/1c70bf2630cf4baeb9f3052a4ae027d3/users/9fa34bf83ca0448f8c3b89989a3e7f3d/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:25.562994 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836f54f-f275-482e-989a-3a29d434372f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c70bf2630cf4baeb9f3052a4ae027d3, user_id=9fa34bf83ca0448f8c3b89989a3e7f3d, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:25.565626 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836f54f-f275-482e-989a-3a29d434372f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:25.581785 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1059/2129] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:25 2022] PUT /identity/v3/projects/1c70bf2630cf4baeb9f3052a4ae027d3/users/9fa34bf83ca0448f8c3b89989a3e7f3d/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:48:25.587713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d204c8-f1f5-42ec-8549-4ab64edaedff None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:25.588074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d204c8-f1f5-42ec-8549-4ab64edaedff None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:25.589169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d204c8-f1f5-42ec-8549-4ab64edaedff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:25.609526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-e5d204c8-f1f5-42ec-8549-4ab64edaedff None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:25.611014 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e5d204c8-f1f5-42ec-8549-4ab64edaedff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:25.679851 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1071/2130] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:25.691618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836f54f-f275-482e-989a-3a29d434372f admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:25.694801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a836f54f-f275-482e-989a-3a29d434372f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:25.775599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836f54f-f275-482e-989a-3a29d434372f admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:25.779682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32b621-c200-4f2c-a0fd-2e209184399c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:25.780714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b621-c200-4f2c-a0fd-2e209184399c service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:25.780835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b621-c200-4f2c-a0fd-2e209184399c service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:25.781044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b621-c200-4f2c-a0fd-2e209184399c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:25.794537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32b621-c200-4f2c-a0fd-2e209184399c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:25.796247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32b621-c200-4f2c-a0fd-2e209184399c service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:25.808984 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1060/2131] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:26.757583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d204c8-f1f5-42ec-8549-4ab64edaedff None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:26.759288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e5d204c8-f1f5-42ec-8549-4ab64edaedff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:26.788064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d204c8-f1f5-42ec-8549-4ab64edaedff None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:26.795376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:26.797828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:26.798388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:26.798810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] PATH_INFO: `/v3/users/73e7877dfb1341dd929c544d357d0ff7` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:26.800708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e7877dfb1341dd929c544d357d0ff7)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:26.803033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:26.921997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e7877dfb1341dd929c544d357d0ff7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:26.940045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e7877dfb1341dd929c544d357d0ff7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:26.941014 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e7877dfb1341dd929c544d357d0ff7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:26.942004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e7877dfb1341dd929c544d357d0ff7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:26.950850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e7877dfb1341dd929c544d357d0ff7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:26.992766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1072/2132] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:26 2022] DELETE /identity/v3/users/73e7877dfb1341dd929c544d357d0ff7 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:48:27.005102 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103769c-3d58-426e-8ecf-ebbe95d12d88 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:27.005890 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103769c-3d58-426e-8ecf-ebbe95d12d88 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:27.006367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103769c-3d58-426e-8ecf-ebbe95d12d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:27.068675 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-d103769c-3d58-426e-8ecf-ebbe95d12d88 None None] MFA Rules not processed for user `9fa34bf83ca0448f8c3b89989a3e7f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:27.070938 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d103769c-3d58-426e-8ecf-ebbe95d12d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:27.188301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:27.189892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:27.194395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1061/2133] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:27 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:27.332134 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5ec9b-8923-4332-9c60-aefa1775ad41 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:27.338538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103769c-3d58-426e-8ecf-ebbe95d12d88 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:27.340767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d103769c-3d58-426e-8ecf-ebbe95d12d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:27.376571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc696ab-d70b-4515-b0dd-9311e709c012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:27.377753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc696ab-d70b-4515-b0dd-9311e709c012 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:27.378044 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc696ab-d70b-4515-b0dd-9311e709c012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:27.378392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc696ab-d70b-4515-b0dd-9311e709c012 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:27.379079 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc696ab-d70b-4515-b0dd-9311e709c012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:27.385063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc696ab-d70b-4515-b0dd-9311e709c012 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:27.397877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103769c-3d58-426e-8ecf-ebbe95d12d88 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:27.434201 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:27.436468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:27.440680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:27.441172 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] PATH_INFO: `/v3/projects/3594a317448848a484e9f4ca47e4f33b` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:27.444717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3594a317448848a484e9f4ca47e4f33b)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:27.448132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1073/2134] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:48:27 2022] POST /identity/v3/projects => generated 405 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:27.449084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc696ab-d70b-4515-b0dd-9311e709c012 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:27.449849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:27.537543 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3594a317448848a484e9f4ca47e4f33b', 'request_id': 'req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:27.550033 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3594a317448848a484e9f4ca47e4f33b', 'request_id': 'req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:27.569410 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3594a317448848a484e9f4ca47e4f33b', 'request_id': 'req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:27.584626 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] The token cache is being invalidate because project 3594a317448848a484e9f4ca47e4f33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:27.585208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:27.586061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:27.586450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc696ab-d70b-4515-b0dd-9311e709c012 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:27.589704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1062/2135] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:27 2022] DELETE /identity/v3/projects/3594a317448848a484e9f4ca47e4f33b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:48:27.594732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:27.596966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:27.691959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2fc1-c73f-4601-9623-4ef2525cde90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:27.692649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2fc1-c73f-4601-9623-4ef2525cde90 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:27.692932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2fc1-c73f-4601-9623-4ef2525cde90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:27.693205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b2fc1-c73f-4601-9623-4ef2525cde90 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:27.693905 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2fc1-c73f-4601-9623-4ef2525cde90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:27.696064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7b2fc1-c73f-4601-9623-4ef2525cde90 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:27.731173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1074/2136] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:48:27 2022] POST /identity/v3/users => generated 309 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:27.732893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2fc1-c73f-4601-9623-4ef2525cde90 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:27.733845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7fbf-5765-4574-8fb1-7c8e8734f2fc admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:27.734834 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9b7b2fc1-c73f-4601-9623-4ef2525cde90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:27.741844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:27.743694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:27.744092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:27.744645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] PATH_INFO: `/v3/users/7d4625838678488087a02021c94e7ef8` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:27.746132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d4625838678488087a02021c94e7ef8)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:27.750067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:27.766177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b2fc1-c73f-4601-9623-4ef2525cde90 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:27.780897 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa4c89-6adf-425d-96aa-da5c5c435bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:27.781636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4c89-6adf-425d-96aa-da5c5c435bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:27.781921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4c89-6adf-425d-96aa-da5c5c435bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:27.782192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa4c89-6adf-425d-96aa-da5c5c435bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:27.782958 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa4c89-6adf-425d-96aa-da5c5c435bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:27.784581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa4c89-6adf-425d-96aa-da5c5c435bd3 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:27.810799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1075/2137] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:27.812883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa4c89-6adf-425d-96aa-da5c5c435bd3 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:27.834483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa4c89-6adf-425d-96aa-da5c5c435bd3 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:27.835903 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d4625838678488087a02021c94e7ef8'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:27.847149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ab49d-500e-4fe9-b2e6-d4c2a709b59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:27.848059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ab49d-500e-4fe9-b2e6-d4c2a709b59e admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:27.848345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ab49d-500e-4fe9-b2e6-d4c2a709b59e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:27.850036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ab49d-500e-4fe9-b2e6-d4c2a709b59e admin admin] PATH_INFO: `/v3/projects/2c7525c750264d4ba927728ed6bbcee4/users/938ff5a84215488083fab97a6a176670/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:27.863223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d4625838678488087a02021c94e7ef8'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:27.866929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d4625838678488087a02021c94e7ef8'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:27.867697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d4625838678488087a02021c94e7ef8'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:27.883366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d4625838678488087a02021c94e7ef8'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:27.888111 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ab49d-500e-4fe9-b2e6-d4c2a709b59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7525c750264d4ba927728ed6bbcee4, user_id=938ff5a84215488083fab97a6a176670, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:27.891633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ab49d-500e-4fe9-b2e6-d4c2a709b59e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:27.907240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1063/2138] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:27 2022] DELETE /identity/v3/users/7d4625838678488087a02021c94e7ef8 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:27.913775 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1076/2139] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:27 2022] PUT /identity/v3/projects/2c7525c750264d4ba927728ed6bbcee4/users/938ff5a84215488083fab97a6a176670/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:48:27.918419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:27.920107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:28.017630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269581f4-76d8-46cc-a27b-f9645be6eafb admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:28.111059 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd0f9b-a227-49d4-8823-8c4c3f00ef2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:28.112292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0f9b-a227-49d4-8823-8c4c3f00ef2b admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:28.113317 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0f9b-a227-49d4-8823-8c4c3f00ef2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:28.114370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd0f9b-a227-49d4-8823-8c4c3f00ef2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:28.115539 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd0f9b-a227-49d4-8823-8c4c3f00ef2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:28.117488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd0f9b-a227-49d4-8823-8c4c3f00ef2b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:28.132046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1064/2140] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:28.137486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ab49d-500e-4fe9-b2e6-d4c2a709b59e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:28.166227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ab49d-500e-4fe9-b2e6-d4c2a709b59e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:28.172778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877c0d-e00b-4565-8a85-7551926c2bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:28.175995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877c0d-e00b-4565-8a85-7551926c2bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:28.177037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877c0d-e00b-4565-8a85-7551926c2bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:28.177522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877c0d-e00b-4565-8a85-7551926c2bfa admin admin] PATH_INFO: `/v3/projects/2c7525c750264d4ba927728ed6bbcee4/users/938ff5a84215488083fab97a6a176670/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:28.181231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed877c0d-e00b-4565-8a85-7551926c2bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7525c750264d4ba927728ed6bbcee4, user_id=938ff5a84215488083fab97a6a176670, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:28.186624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed877c0d-e00b-4565-8a85-7551926c2bfa admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:28.205303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1077/2141] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:28 2022] PUT /identity/v3/projects/2c7525c750264d4ba927728ed6bbcee4/users/938ff5a84215488083fab97a6a176670/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:28.386933 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474c7d1-aa42-46fe-bf40-ef6ec189dca4 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:28.387224 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474c7d1-aa42-46fe-bf40-ef6ec189dca4 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:28.387509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474c7d1-aa42-46fe-bf40-ef6ec189dca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:28.438898 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877c0d-e00b-4565-8a85-7551926c2bfa admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:28.439576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b474c7d1-aa42-46fe-bf40-ef6ec189dca4 None None] MFA Rules not processed for user `6d5f259e0b98457ea6b6b88d886c813d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:28.440475 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b474c7d1-aa42-46fe-bf40-ef6ec189dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:28.451504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ed877c0d-e00b-4565-8a85-7551926c2bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:28.586632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1065/2142] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:28.588334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474c7d1-aa42-46fe-bf40-ef6ec189dca4 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:28.592780 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b474c7d1-aa42-46fe-bf40-ef6ec189dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:28.613491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877c0d-e00b-4565-8a85-7551926c2bfa admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:28.619120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:28.620112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:28.620752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:28.620752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] PATH_INFO: `/v3/projects/c1aa4f0d03ed416a9dd9c60254648c77` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:28.621998 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1aa4f0d03ed416a9dd9c60254648c77)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:28.624118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:28.703983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1aa4f0d03ed416a9dd9c60254648c77', 'request_id': 'req-c08e9c76-8d71-4747-8ceb-c0429aaa056a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:28.705441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474c7d1-aa42-46fe-bf40-ef6ec189dca4 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:28.715661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1aa4f0d03ed416a9dd9c60254648c77', 'request_id': 'req-c08e9c76-8d71-4747-8ceb-c0429aaa056a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:28.730720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1aa4f0d03ed416a9dd9c60254648c77', 'request_id': 'req-c08e9c76-8d71-4747-8ceb-c0429aaa056a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:28.749669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] The token cache is being invalidate because project c1aa4f0d03ed416a9dd9c60254648c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:28.750057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:28.750843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c08e9c76-8d71-4747-8ceb-c0429aaa056a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:28.753830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1078/2143] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:28 2022] DELETE /identity/v3/projects/c1aa4f0d03ed416a9dd9c60254648c77 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:28.762367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0958-5d2e-4a7b-bd30-2acfc735ddb2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:28.763090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0958-5d2e-4a7b-bd30-2acfc735ddb2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:28.763585 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0958-5d2e-4a7b-bd30-2acfc735ddb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:28.797704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-e97c0958-5d2e-4a7b-bd30-2acfc735ddb2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:28.799837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e97c0958-5d2e-4a7b-bd30-2acfc735ddb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:28.829089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6163fc4-4b69-4b7a-8dc1-6bf0e8ff9ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:28.830017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6163fc4-4b69-4b7a-8dc1-6bf0e8ff9ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:28.850839 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6163fc4-4b69-4b7a-8dc1-6bf0e8ff9ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:28.851356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6163fc4-4b69-4b7a-8dc1-6bf0e8ff9ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:28.853466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6163fc4-4b69-4b7a-8dc1-6bf0e8ff9ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:28.856082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6163fc4-4b69-4b7a-8dc1-6bf0e8ff9ec6 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:28.892843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1066/2144] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:48:28 2022] POST /identity/v3/projects => generated 385 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:28.897516 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6163fc4-4b69-4b7a-8dc1-6bf0e8ff9ec6 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:28.900797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c6163fc4-4b69-4b7a-8dc1-6bf0e8ff9ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:28.927573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1079/2145] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:28.927573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dc058-f87a-45c4-8851-51c968a357d2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:28.927573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dc058-f87a-45c4-8851-51c968a357d2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:28.927573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dc058-f87a-45c4-8851-51c968a357d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:28.970080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-cb4dc058-f87a-45c4-8851-51c968a357d2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:28.972100 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-cb4dc058-f87a-45c4-8851-51c968a357d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:29.011330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6163fc4-4b69-4b7a-8dc1-6bf0e8ff9ec6 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.019185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001b772-75b2-40a1-92d4-7e317a4495aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.021247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b772-75b2-40a1-92d4-7e317a4495aa admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.021676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b772-75b2-40a1-92d4-7e317a4495aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.022230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001b772-75b2-40a1-92d4-7e317a4495aa admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.023113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001b772-75b2-40a1-92d4-7e317a4495aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.026583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001b772-75b2-40a1-92d4-7e317a4495aa admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.054719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1067/2146] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:48:28 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:29.057839 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001b772-75b2-40a1-92d4-7e317a4495aa admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:29.072982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001b772-75b2-40a1-92d4-7e317a4495aa admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.074138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1080/2147] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:29.076012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1e783-381e-4412-8737-eb3db5b1f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.076905 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1e783-381e-4412-8737-eb3db5b1f492 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.077019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1e783-381e-4412-8737-eb3db5b1f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.077239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1e783-381e-4412-8737-eb3db5b1f492 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.078273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1e783-381e-4412-8737-eb3db5b1f492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.079429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dc058-f87a-45c4-8851-51c968a357d2 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:29.080078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1e783-381e-4412-8737-eb3db5b1f492 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.093810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dc058-f87a-45c4-8851-51c968a357d2 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.097357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1068/2148] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:29.098475 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1e783-381e-4412-8737-eb3db5b1f492 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:29.100539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78324d-50cc-481c-ad44-0eefaee7253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.101544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78324d-50cc-481c-ad44-0eefaee7253d admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.102002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78324d-50cc-481c-ad44-0eefaee7253d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.103007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78324d-50cc-481c-ad44-0eefaee7253d admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.104153 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78324d-50cc-481c-ad44-0eefaee7253d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:48:29.105086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78324d-50cc-481c-ad44-0eefaee7253d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.107515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78324d-50cc-481c-ad44-0eefaee7253d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.109813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1e783-381e-4412-8737-eb3db5b1f492 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.119430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2824e6a-2da8-4436-b0e7-57b2adade282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.121585 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2824e6a-2da8-4436-b0e7-57b2adade282 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.122299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2824e6a-2da8-4436-b0e7-57b2adade282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.122631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2824e6a-2da8-4436-b0e7-57b2adade282 admin admin] PATH_INFO: `/v3/projects/64b1f483c1724e648f27877d52889290/users/e00d2543ce3e4345b2dea72887a924c1/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.144757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1081/2149] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:48:29.144961 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2824e6a-2da8-4436-b0e7-57b2adade282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b1f483c1724e648f27877d52889290, user_id=e00d2543ce3e4345b2dea72887a924c1, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.146205 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2824e6a-2da8-4436-b0e7-57b2adade282 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.147243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78324d-50cc-481c-ad44-0eefaee7253d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:29.158264 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78324d-50cc-481c-ad44-0eefaee7253d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.163848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1069/2150] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:29 2022] PUT /identity/v3/projects/64b1f483c1724e648f27877d52889290/users/e00d2543ce3e4345b2dea72887a924c1/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:29.171877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2824e6a-2da8-4436-b0e7-57b2adade282 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:29.228994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77d2f-349b-4cc3-bc07-a652604eea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.239922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77d2f-349b-4cc3-bc07-a652604eea5a admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.240204 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77d2f-349b-4cc3-bc07-a652604eea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.240571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f77d2f-349b-4cc3-bc07-a652604eea5a admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.241446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f77d2f-349b-4cc3-bc07-a652604eea5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.244160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f77d2f-349b-4cc3-bc07-a652604eea5a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.257594 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2824e6a-2da8-4436-b0e7-57b2adade282 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.264640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9318a18-484a-49a6-a484-6c437a71f1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.265473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9318a18-484a-49a6-a484-6c437a71f1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.267049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9318a18-484a-49a6-a484-6c437a71f1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.267049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9318a18-484a-49a6-a484-6c437a71f1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.267049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9318a18-484a-49a6-a484-6c437a71f1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.268476 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9318a18-484a-49a6-a484-6c437a71f1d6 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.280949 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1070/2151] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:29.282844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd8f29-f941-4d48-aa6e-bab6fcd99aec None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.283576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd8f29-f941-4d48-aa6e-bab6fcd99aec None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.284058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd8f29-f941-4d48-aa6e-bab6fcd99aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.285745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1082/2152] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:48:29 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:48:29.286667 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77d2f-349b-4cc3-bc07-a652604eea5a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:29.326620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a5dd8f29-f941-4d48-aa6e-bab6fcd99aec None None] MFA Rules not processed for user `938ff5a84215488083fab97a6a176670`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:29.329520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a5dd8f29-f941-4d48-aa6e-bab6fcd99aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:29.386178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f77d2f-349b-4cc3-bc07-a652604eea5a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.396786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af49e84-b793-4893-b14e-7304708e294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.398335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af49e84-b793-4893-b14e-7304708e294a admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.398933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af49e84-b793-4893-b14e-7304708e294a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.399556 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af49e84-b793-4893-b14e-7304708e294a admin admin] PATH_INFO: `/v3/projects/64b1f483c1724e648f27877d52889290/users/e00d2543ce3e4345b2dea72887a924c1/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.402785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af49e84-b793-4893-b14e-7304708e294a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b1f483c1724e648f27877d52889290, user_id=e00d2543ce3e4345b2dea72887a924c1, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.407091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af49e84-b793-4893-b14e-7304708e294a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.429877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1071/2153] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:29.429877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd8f29-f941-4d48-aa6e-bab6fcd99aec None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:29.434460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1083/2154] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:29 2022] PUT /identity/v3/projects/64b1f483c1724e648f27877d52889290/users/e00d2543ce3e4345b2dea72887a924c1/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:29.451121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd8f29-f941-4d48-aa6e-bab6fcd99aec None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.532874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca13a7c-3fb3-46ac-971d-2eefb34c2cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.533792 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca13a7c-3fb3-46ac-971d-2eefb34c2cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.534074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca13a7c-3fb3-46ac-971d-2eefb34c2cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.534442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca13a7c-3fb3-46ac-971d-2eefb34c2cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.535263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca13a7c-3fb3-46ac-971d-2eefb34c2cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.537336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca13a7c-3fb3-46ac-971d-2eefb34c2cf0 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.563979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1072/2155] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:48:29 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:29.569460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af49e84-b793-4893-b14e-7304708e294a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:29.580747 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af49e84-b793-4893-b14e-7304708e294a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.588540 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ff08e-5f3a-46d5-be73-62b96b04ae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.589468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ff08e-5f3a-46d5-be73-62b96b04ae1b admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.589821 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ff08e-5f3a-46d5-be73-62b96b04ae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.590513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ff08e-5f3a-46d5-be73-62b96b04ae1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.591205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ff08e-5f3a-46d5-be73-62b96b04ae1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.593432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ff08e-5f3a-46d5-be73-62b96b04ae1b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.610247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1084/2156] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:29.611395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca13a7c-3fb3-46ac-971d-2eefb34c2cf0 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:29.623821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca13a7c-3fb3-46ac-971d-2eefb34c2cf0 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.638552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45d265-b635-409b-9b14-65f247c3c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.639156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45d265-b635-409b-9b14-65f247c3c61e admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.639435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45d265-b635-409b-9b14-65f247c3c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.639709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45d265-b635-409b-9b14-65f247c3c61e admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.642630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45d265-b635-409b-9b14-65f247c3c61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.644289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45d265-b635-409b-9b14-65f247c3c61e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.664686 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1073/2157] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:29.669509 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ff08e-5f3a-46d5-be73-62b96b04ae1b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:29.682103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ff08e-5f3a-46d5-be73-62b96b04ae1b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.689101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b78ea-9bc9-4600-abbe-45418a31eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.691321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b78ea-9bc9-4600-abbe-45418a31eca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.691751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b78ea-9bc9-4600-abbe-45418a31eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.692199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b78ea-9bc9-4600-abbe-45418a31eca6 admin admin] PATH_INFO: `/v3/projects/200660e3d79b47f0b10171fce264db97/users/6afdc4c5c6934ccaab84c5545d6b3e5d/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.716164 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b78ea-9bc9-4600-abbe-45418a31eca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200660e3d79b47f0b10171fce264db97, user_id=6afdc4c5c6934ccaab84c5545d6b3e5d, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.720064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b78ea-9bc9-4600-abbe-45418a31eca6 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.738058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1085/2158] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:29 2022] PUT /identity/v3/projects/200660e3d79b47f0b10171fce264db97/users/6afdc4c5c6934ccaab84c5545d6b3e5d/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:29.749185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18d7f1-113b-4380-ae35-c073d4a89d7c None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.749472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18d7f1-113b-4380-ae35-c073d4a89d7c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.749748 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18d7f1-113b-4380-ae35-c073d4a89d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.782787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-8e18d7f1-113b-4380-ae35-c073d4a89d7c None None] MFA Rules not processed for user `6afdc4c5c6934ccaab84c5545d6b3e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:29.784578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8e18d7f1-113b-4380-ae35-c073d4a89d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:29.881799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1074/2159] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:29.894212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b78ea-9bc9-4600-abbe-45418a31eca6 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:29.896102 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-182b78ea-9bc9-4600-abbe-45418a31eca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:29.966567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b78ea-9bc9-4600-abbe-45418a31eca6 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:29.971233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7385179-43ae-41f8-a99b-b29ab52b7a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:29.971786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385179-43ae-41f8-a99b-b29ab52b7a9c service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:29.972064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385179-43ae-41f8-a99b-b29ab52b7a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:29.972341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385179-43ae-41f8-a99b-b29ab52b7a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:29.982138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7385179-43ae-41f8-a99b-b29ab52b7a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:29.983628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7385179-43ae-41f8-a99b-b29ab52b7a9c service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:29.995669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1086/2160] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:31.085494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18d7f1-113b-4380-ae35-c073d4a89d7c None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:31.088238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8e18d7f1-113b-4380-ae35-c073d4a89d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:31.169526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18d7f1-113b-4380-ae35-c073d4a89d7c None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:31.177680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:31.178620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:31.178969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:31.179313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] PATH_INFO: `/v3/users/9fa34bf83ca0448f8c3b89989a3e7f3d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:31.180844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa34bf83ca0448f8c3b89989a3e7f3d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:31.182862 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:31.233470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa34bf83ca0448f8c3b89989a3e7f3d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.246948 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa34bf83ca0448f8c3b89989a3e7f3d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.248399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa34bf83ca0448f8c3b89989a3e7f3d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.249390 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa34bf83ca0448f8c3b89989a3e7f3d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.256926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa34bf83ca0448f8c3b89989a3e7f3d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.270842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1075/2161] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:31 2022] DELETE /identity/v3/users/9fa34bf83ca0448f8c3b89989a3e7f3d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:31.479237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7385179-43ae-41f8-a99b-b29ab52b7a9c service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:31.492208 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7385179-43ae-41f8-a99b-b29ab52b7a9c service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:31.556873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:31.557830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:31.558205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:31.558568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] PATH_INFO: `/v3/projects/1c70bf2630cf4baeb9f3052a4ae027d3` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:31.559891 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c70bf2630cf4baeb9f3052a4ae027d3)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:31.562046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:31.626978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c70bf2630cf4baeb9f3052a4ae027d3', 'request_id': 'req-9c46bdcd-fe8f-45f5-8a70-97d639b53469'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.640862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c70bf2630cf4baeb9f3052a4ae027d3', 'request_id': 'req-9c46bdcd-fe8f-45f5-8a70-97d639b53469'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.651602 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c70bf2630cf4baeb9f3052a4ae027d3', 'request_id': 'req-9c46bdcd-fe8f-45f5-8a70-97d639b53469'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.663964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] The token cache is being invalidate because project 1c70bf2630cf4baeb9f3052a4ae027d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:31.664609 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.666083 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.668434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1087/2162] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:31 2022] DELETE /identity/v3/projects/1c70bf2630cf4baeb9f3052a4ae027d3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:31.672340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:31.673639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:31.687498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577debb-7b08-4608-81ff-90082304461d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:31.856623 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b1369-75bf-4b34-92a5-fa707fe1e5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:31.858693 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1369-75bf-4b34-92a5-fa707fe1e5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:31.859001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1369-75bf-4b34-92a5-fa707fe1e5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:31.859231 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1369-75bf-4b34-92a5-fa707fe1e5bb admin admin] PATH_INFO: `/v3/users/938ff5a84215488083fab97a6a176670` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:31.865437 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b1369-75bf-4b34-92a5-fa707fe1e5bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=938ff5a84215488083fab97a6a176670)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:31.871207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b1369-75bf-4b34-92a5-fa707fe1e5bb admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:31.970760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f62b1369-75bf-4b34-92a5-fa707fe1e5bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938ff5a84215488083fab97a6a176670'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.983938 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f62b1369-75bf-4b34-92a5-fa707fe1e5bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938ff5a84215488083fab97a6a176670'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.984907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f62b1369-75bf-4b34-92a5-fa707fe1e5bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938ff5a84215488083fab97a6a176670'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.985652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f62b1369-75bf-4b34-92a5-fa707fe1e5bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938ff5a84215488083fab97a6a176670'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:31.995490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f62b1369-75bf-4b34-92a5-fa707fe1e5bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938ff5a84215488083fab97a6a176670'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:32.016263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1076/2163] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:31 2022] DELETE /identity/v3/users/938ff5a84215488083fab97a6a176670 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:32.249656 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:32.251154 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:32.270128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46bdcd-fe8f-45f5-8a70-97d639b53469 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:32.359605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:32.360765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:32.361056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:32.361592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] PATH_INFO: `/v3/projects/2c7525c750264d4ba927728ed6bbcee4` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:32.363216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7525c750264d4ba927728ed6bbcee4)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:32.365446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:32.455372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7525c750264d4ba927728ed6bbcee4', 'request_id': 'req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:32.463428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7525c750264d4ba927728ed6bbcee4', 'request_id': 'req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:32.474260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7525c750264d4ba927728ed6bbcee4', 'request_id': 'req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:32.525349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] The token cache is being invalidate because project 2c7525c750264d4ba927728ed6bbcee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:32.526021 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:32.529812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-ae8a4df4-8d81-41dc-a9fc-f37eb9ee8624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:32.531994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1088/2164] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:32 2022] DELETE /identity/v3/projects/2c7525c750264d4ba927728ed6bbcee4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:32.537052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724ecbd-fdf0-45a3-8001-e8602d9a73dd None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:32.537928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724ecbd-fdf0-45a3-8001-e8602d9a73dd None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:32.538443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724ecbd-fdf0-45a3-8001-e8602d9a73dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:32.575608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7724ecbd-fdf0-45a3-8001-e8602d9a73dd None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:32.576863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7724ecbd-fdf0-45a3-8001-e8602d9a73dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:32.676872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1077/2165] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:32.677873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eb36b-1987-40f8-abb0-e668b54120dd None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:32.678497 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eb36b-1987-40f8-abb0-e668b54120dd None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:32.678808 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40eb36b-1987-40f8-abb0-e668b54120dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:32.715804 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f40eb36b-1987-40f8-abb0-e668b54120dd None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:32.717961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f40eb36b-1987-40f8-abb0-e668b54120dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:32.744604 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1089/2166] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:32.746325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724ecbd-fdf0-45a3-8001-e8602d9a73dd None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:32.760320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724ecbd-fdf0-45a3-8001-e8602d9a73dd None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:32.778937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8e436-5e90-4b57-b6c5-c7971afae085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:32.781895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8e436-5e90-4b57-b6c5-c7971afae085 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:32.782366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8e436-5e90-4b57-b6c5-c7971afae085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:32.784285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8e436-5e90-4b57-b6c5-c7971afae085 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:32.788856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8e436-5e90-4b57-b6c5-c7971afae085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:48:32.789296 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8e436-5e90-4b57-b6c5-c7971afae085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:32.794664 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8e436-5e90-4b57-b6c5-c7971afae085 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:32.817904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1078/2167] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:48:32.818525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eb36b-1987-40f8-abb0-e668b54120dd None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:32.842832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40eb36b-1987-40f8-abb0-e668b54120dd None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:32.849336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a1545-3e45-4abf-9be1-94c64e7a727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:32.850124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1545-3e45-4abf-9be1-94c64e7a727a admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:32.850680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1545-3e45-4abf-9be1-94c64e7a727a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:32.851005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a1545-3e45-4abf-9be1-94c64e7a727a admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:32.851763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a1545-3e45-4abf-9be1-94c64e7a727a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:32.856440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a1545-3e45-4abf-9be1-94c64e7a727a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:32.891253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1090/2168] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:48:32 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:48:32.900477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8e436-5e90-4b57-b6c5-c7971afae085 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:32.915215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8e436-5e90-4b57-b6c5-c7971afae085 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:33.074956 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273b1d-39da-415b-8686-b3cfaedda771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:33.075997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273b1d-39da-415b-8686-b3cfaedda771 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:33.076443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273b1d-39da-415b-8686-b3cfaedda771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:33.076901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273b1d-39da-415b-8686-b3cfaedda771 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:33.078074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59273b1d-39da-415b-8686-b3cfaedda771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:33.080406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59273b1d-39da-415b-8686-b3cfaedda771 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:33.130370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1079/2169] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:48:32 2022] POST /identity/v3/users => generated 287 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:48:33.135607 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a1545-3e45-4abf-9be1-94c64e7a727a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:33.149907 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a1545-3e45-4abf-9be1-94c64e7a727a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:33.163161 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e400c-08e3-47c2-be44-81e2d791abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:33.163913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e400c-08e3-47c2-be44-81e2d791abfa admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:33.164207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e400c-08e3-47c2-be44-81e2d791abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:33.164490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e400c-08e3-47c2-be44-81e2d791abfa admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:33.165777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e400c-08e3-47c2-be44-81e2d791abfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:33.172393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e400c-08e3-47c2-be44-81e2d791abfa admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:33.202233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1091/2170] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:33.203606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273b1d-39da-415b-8686-b3cfaedda771 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:33.220504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273b1d-39da-415b-8686-b3cfaedda771 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:33.228764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca98fe0-c7a4-4260-8023-c0bb587002e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:33.229750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98fe0-c7a4-4260-8023-c0bb587002e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:33.230117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98fe0-c7a4-4260-8023-c0bb587002e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:33.231259 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca98fe0-c7a4-4260-8023-c0bb587002e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:33.233360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca98fe0-c7a4-4260-8023-c0bb587002e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:33.237418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca98fe0-c7a4-4260-8023-c0bb587002e3 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:33.272211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1080/2171] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:33.279624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e400c-08e3-47c2-be44-81e2d791abfa admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:33.300671 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e400c-08e3-47c2-be44-81e2d791abfa admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:33.313353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea0f15-7754-48e9-a68c-2eb91cbe99e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:33.315843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0f15-7754-48e9-a68c-2eb91cbe99e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:33.316813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0f15-7754-48e9-a68c-2eb91cbe99e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:33.317203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0f15-7754-48e9-a68c-2eb91cbe99e2 admin admin] PATH_INFO: `/v3/projects/5505ee2c16a94e10af4b45c3ea8e0032/users/cf1cc753646b4dfa80ab940adfeab835/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:33.361631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea0f15-7754-48e9-a68c-2eb91cbe99e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5505ee2c16a94e10af4b45c3ea8e0032, user_id=cf1cc753646b4dfa80ab940adfeab835, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:33.364779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea0f15-7754-48e9-a68c-2eb91cbe99e2 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:33.401820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1092/2172] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:33 2022] PUT /identity/v3/projects/5505ee2c16a94e10af4b45c3ea8e0032/users/cf1cc753646b4dfa80ab940adfeab835/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:33.412055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1ca6-57ca-4ca6-8584-234baa3d8e31 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:33.412486 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1ca6-57ca-4ca6-8584-234baa3d8e31 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:33.412887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1ca6-57ca-4ca6-8584-234baa3d8e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:33.471210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-db3f1ca6-57ca-4ca6-8584-234baa3d8e31 None None] MFA Rules not processed for user `cf1cc753646b4dfa80ab940adfeab835`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:33.473520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-db3f1ca6-57ca-4ca6-8584-234baa3d8e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:33.606479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1081/2173] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:33.610095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea0f15-7754-48e9-a68c-2eb91cbe99e2 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:33.698862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea0f15-7754-48e9-a68c-2eb91cbe99e2 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:33.704710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de432d47-444f-4d6c-a692-1b6f7850488e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:33.705509 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de432d47-444f-4d6c-a692-1b6f7850488e admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:33.706033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de432d47-444f-4d6c-a692-1b6f7850488e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:33.706539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de432d47-444f-4d6c-a692-1b6f7850488e admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:33.707441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de432d47-444f-4d6c-a692-1b6f7850488e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:33.710165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de432d47-444f-4d6c-a692-1b6f7850488e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:33.739712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1093/2174] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:48:33 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:33.744182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1ca6-57ca-4ca6-8584-234baa3d8e31 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:33.757469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1ca6-57ca-4ca6-8584-234baa3d8e31 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:33.845024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257e7f9-0fae-47b1-b93e-e1178c3af2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:33.845951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e7f9-0fae-47b1-b93e-e1178c3af2ee admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:33.846453 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e7f9-0fae-47b1-b93e-e1178c3af2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:33.846875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e7f9-0fae-47b1-b93e-e1178c3af2ee admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:33.848439 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257e7f9-0fae-47b1-b93e-e1178c3af2ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:33.851004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257e7f9-0fae-47b1-b93e-e1178c3af2ee admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:33.892595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1082/2175] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:48:33 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:33.898900 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de432d47-444f-4d6c-a692-1b6f7850488e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:33.912125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de432d47-444f-4d6c-a692-1b6f7850488e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:33.918009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d537b-fd66-4595-8bc6-7a60026fe80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:33.918785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d537b-fd66-4595-8bc6-7a60026fe80a admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:33.920048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d537b-fd66-4595-8bc6-7a60026fe80a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:33.920048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d537b-fd66-4595-8bc6-7a60026fe80a admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:33.920586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d537b-fd66-4595-8bc6-7a60026fe80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:33.924659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d537b-fd66-4595-8bc6-7a60026fe80a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:33.944561 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1094/2176] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:33.945730 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257e7f9-0fae-47b1-b93e-e1178c3af2ee admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:33.964349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257e7f9-0fae-47b1-b93e-e1178c3af2ee admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:33.980434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb656d-dcb3-46ce-862f-6127adea1bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:33.981705 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb656d-dcb3-46ce-862f-6127adea1bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:33.987047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb656d-dcb3-46ce-862f-6127adea1bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:33.988396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb656d-dcb3-46ce-862f-6127adea1bd6 admin admin] PATH_INFO: `/v3/projects/fe554f2b393c4679945e879e873f91e7/users/830c750d7a6d481ea841af6682533c73/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:34.032887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb656d-dcb3-46ce-862f-6127adea1bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe554f2b393c4679945e879e873f91e7, user_id=830c750d7a6d481ea841af6682533c73, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:34.035633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb656d-dcb3-46ce-862f-6127adea1bd6 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:34.058066 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1083/2177] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:33 2022] PUT /identity/v3/projects/fe554f2b393c4679945e879e873f91e7/users/830c750d7a6d481ea841af6682533c73/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:34.059644 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d537b-fd66-4595-8bc6-7a60026fe80a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:34.084664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d537b-fd66-4595-8bc6-7a60026fe80a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:34.170591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c3224-92ea-4d69-9aab-e9e2998faa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:34.171276 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3224-92ea-4d69-9aab-e9e2998faa1e admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:34.171564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3224-92ea-4d69-9aab-e9e2998faa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:34.171846 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c3224-92ea-4d69-9aab-e9e2998faa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:34.172783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c3224-92ea-4d69-9aab-e9e2998faa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:34.175053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c3224-92ea-4d69-9aab-e9e2998faa1e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:34.191559 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1095/2178] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:34.195414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb656d-dcb3-46ce-862f-6127adea1bd6 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:34.208679 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb656d-dcb3-46ce-862f-6127adea1bd6 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:34.220932 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d17e0-3ebd-4c46-92bf-0312df82e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:34.221974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d17e0-3ebd-4c46-92bf-0312df82e38d admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:34.222263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d17e0-3ebd-4c46-92bf-0312df82e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:34.222569 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d17e0-3ebd-4c46-92bf-0312df82e38d admin admin] PATH_INFO: `/v3/projects/fe554f2b393c4679945e879e873f91e7/users/830c750d7a6d481ea841af6682533c73/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:34.225745 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d17e0-3ebd-4c46-92bf-0312df82e38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe554f2b393c4679945e879e873f91e7, user_id=830c750d7a6d481ea841af6682533c73, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:34.228638 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d17e0-3ebd-4c46-92bf-0312df82e38d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:34.240123 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1084/2179] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:34 2022] PUT /identity/v3/projects/fe554f2b393c4679945e879e873f91e7/users/830c750d7a6d481ea841af6682533c73/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:34.251326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e5403-5f7f-44f6-bcf3-e685af03c286 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:34.251621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e5403-5f7f-44f6-bcf3-e685af03c286 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:34.251900 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e5403-5f7f-44f6-bcf3-e685af03c286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:34.285352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-a58e5403-5f7f-44f6-bcf3-e685af03c286 None None] MFA Rules not processed for user `830c750d7a6d481ea841af6682533c73`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:34.287049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a58e5403-5f7f-44f6-bcf3-e685af03c286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:34.391315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1096/2180] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:34.404708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d17e0-3ebd-4c46-92bf-0312df82e38d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:34.406589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f61d17e0-3ebd-4c46-92bf-0312df82e38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:34.485021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d17e0-3ebd-4c46-92bf-0312df82e38d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:34.490878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62acdd8-bd42-4daa-8e19-b79d5e73829d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:34.491837 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62acdd8-bd42-4daa-8e19-b79d5e73829d service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:34.492220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62acdd8-bd42-4daa-8e19-b79d5e73829d service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:34.492570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62acdd8-bd42-4daa-8e19-b79d5e73829d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:34.504659 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62acdd8-bd42-4daa-8e19-b79d5e73829d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:34.506280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62acdd8-bd42-4daa-8e19-b79d5e73829d service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:34.518703 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1085/2181] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:34.614233 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e5403-5f7f-44f6-bcf3-e685af03c286 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:34.624268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e5403-5f7f-44f6-bcf3-e685af03c286 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:34.652073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d651066-57ba-4700-ae20-b85c8d3acd02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:34.652884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d651066-57ba-4700-ae20-b85c8d3acd02 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:34.656392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d651066-57ba-4700-ae20-b85c8d3acd02 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:34.658026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d651066-57ba-4700-ae20-b85c8d3acd02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:34.767365 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d651066-57ba-4700-ae20-b85c8d3acd02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:34.769102 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d651066-57ba-4700-ae20-b85c8d3acd02 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:34.795695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1097/2182] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:35.399808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01604-e371-413e-bd50-990206c3d33e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:35.400275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01604-e371-413e-bd50-990206c3d33e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:35.400457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f01604-e371-413e-bd50-990206c3d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:35.429298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c4f01604-e371-413e-bd50-990206c3d33e None None] MFA Rules not processed for user `e00d2543ce3e4345b2dea72887a924c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:35.431313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c4f01604-e371-413e-bd50-990206c3d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:35.502406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1086/2183] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:35.514654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d651066-57ba-4700-ae20-b85c8d3acd02 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:35.516010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8d651066-57ba-4700-ae20-b85c8d3acd02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:35.575059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d651066-57ba-4700-ae20-b85c8d3acd02 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:35.578835 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51798b-d236-4ee0-b352-64e7c44c84d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd346be1ef7604f1f87371f5d322fd010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:35.579492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51798b-d236-4ee0-b352-64e7c44c84d8 service glance] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:35.579776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51798b-d236-4ee0-b352-64e7c44c84d8 service glance] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:35.580157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51798b-d236-4ee0-b352-64e7c44c84d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:35.581981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-cf51798b-d236-4ee0-b352-64e7c44c84d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:35.641730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51798b-d236-4ee0-b352-64e7c44c84d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:35.643116 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51798b-d236-4ee0-b352-64e7c44c84d8 service glance] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:35.652034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1098/2184] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:35.746684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2db06-410c-4aa0-9b1d-4beec41eec07 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:35.746972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2db06-410c-4aa0-9b1d-4beec41eec07 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:35.747247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2db06-410c-4aa0-9b1d-4beec41eec07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:35.766857 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-32a2db06-410c-4aa0-9b1d-4beec41eec07 None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:35.768724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-32a2db06-410c-4aa0-9b1d-4beec41eec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:35.838482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1087/2185] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:48:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:35.885303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51798b-d236-4ee0-b352-64e7c44c84d8 service glance] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:35.886726 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-cf51798b-d236-4ee0-b352-64e7c44c84d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:35.955065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51798b-d236-4ee0-b352-64e7c44c84d8 service glance] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:35.959969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075810df-205f-4417-bae1-9ae22cfd2f49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:35.960612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075810df-205f-4417-bae1-9ae22cfd2f49 service swift] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:35.960892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075810df-205f-4417-bae1-9ae22cfd2f49 service swift] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:35.961163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075810df-205f-4417-bae1-9ae22cfd2f49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:35.970451 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075810df-205f-4417-bae1-9ae22cfd2f49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:35.972103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075810df-205f-4417-bae1-9ae22cfd2f49 service swift] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:35.981634 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1099/2186] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:48:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:48:45.570877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2db06-410c-4aa0-9b1d-4beec41eec07 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:45.573034 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-32a2db06-410c-4aa0-9b1d-4beec41eec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:45.734287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2db06-410c-4aa0-9b1d-4beec41eec07 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:45.740067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f795678-4bc6-48f2-8e97-80c2a4951274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:45.740941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f795678-4bc6-48f2-8e97-80c2a4951274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:45.741264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f795678-4bc6-48f2-8e97-80c2a4951274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:45.741545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f795678-4bc6-48f2-8e97-80c2a4951274 admin admin] PATH_INFO: `/v3/users/6afdc4c5c6934ccaab84c5545d6b3e5d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:45.742788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f795678-4bc6-48f2-8e97-80c2a4951274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afdc4c5c6934ccaab84c5545d6b3e5d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:45.745655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f795678-4bc6-48f2-8e97-80c2a4951274 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:45.803325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4f795678-4bc6-48f2-8e97-80c2a4951274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afdc4c5c6934ccaab84c5545d6b3e5d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:45.822737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4f795678-4bc6-48f2-8e97-80c2a4951274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afdc4c5c6934ccaab84c5545d6b3e5d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:45.823630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4f795678-4bc6-48f2-8e97-80c2a4951274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afdc4c5c6934ccaab84c5545d6b3e5d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:45.824288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4f795678-4bc6-48f2-8e97-80c2a4951274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afdc4c5c6934ccaab84c5545d6b3e5d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:45.835752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4f795678-4bc6-48f2-8e97-80c2a4951274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afdc4c5c6934ccaab84c5545d6b3e5d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:45.862402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1088/2187] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:45 2022] DELETE /identity/v3/users/6afdc4c5c6934ccaab84c5545d6b3e5d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:45.865185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501302a-048d-4fc5-adc7-ab6d19956fa2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:45.865717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501302a-048d-4fc5-adc7-ab6d19956fa2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:45.865717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501302a-048d-4fc5-adc7-ab6d19956fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:45.899678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6ba92-d0bb-498e-bc3a-9ca5d33e6146 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:45.900606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6ba92-d0bb-498e-bc3a-9ca5d33e6146 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:45.901464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6ba92-d0bb-498e-bc3a-9ca5d33e6146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:45.904640 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f501302a-048d-4fc5-adc7-ab6d19956fa2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:45.906201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f501302a-048d-4fc5-adc7-ab6d19956fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:45.922187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c4b6ba92-d0bb-498e-bc3a-9ca5d33e6146 None None] MFA Rules not processed for user `6d5f259e0b98457ea6b6b88d886c813d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:45.924165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c4b6ba92-d0bb-498e-bc3a-9ca5d33e6146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:45.983737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1100/2188] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:45.995741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501302a-048d-4fc5-adc7-ab6d19956fa2 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:45.998635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f501302a-048d-4fc5-adc7-ab6d19956fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:46.019682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1089/2189] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:46.134715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501302a-048d-4fc5-adc7-ab6d19956fa2 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:46.147548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a867260-f0c4-471a-a31e-e7445cce5dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:46.147548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867260-f0c4-471a-a31e-e7445cce5dec service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:46.147548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867260-f0c4-471a-a31e-e7445cce5dec service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:46.147548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a867260-f0c4-471a-a31e-e7445cce5dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:46.151892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a867260-f0c4-471a-a31e-e7445cce5dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:46.153327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a867260-f0c4-471a-a31e-e7445cce5dec service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:46.164118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1101/2190] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:46.837165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6ba92-d0bb-498e-bc3a-9ca5d33e6146 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:46.839480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c4b6ba92-d0bb-498e-bc3a-9ca5d33e6146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:46.862200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6ba92-d0bb-498e-bc3a-9ca5d33e6146 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:46.871763 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:46.872534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:46.873030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:46.873407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] PATH_INFO: `/v3/projects/200660e3d79b47f0b10171fce264db97` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:46.875120 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=200660e3d79b47f0b10171fce264db97)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:46.876807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:46.932468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200660e3d79b47f0b10171fce264db97', 'request_id': 'req-d0cbbd2a-552d-4b1a-978d-3a507c399967'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:46.942426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200660e3d79b47f0b10171fce264db97', 'request_id': 'req-d0cbbd2a-552d-4b1a-978d-3a507c399967'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:46.949064 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200660e3d79b47f0b10171fce264db97', 'request_id': 'req-d0cbbd2a-552d-4b1a-978d-3a507c399967'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:46.962020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] The token cache is being invalidate because project 200660e3d79b47f0b10171fce264db97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:46.962355 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:46.963242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d0cbbd2a-552d-4b1a-978d-3a507c399967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:46.969880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1090/2191] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:46 2022] DELETE /identity/v3/projects/200660e3d79b47f0b10171fce264db97 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:46.971141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f998-4b26-4ac9-a987-e01e9ffea73b None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:46.971583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f998-4b26-4ac9-a987-e01e9ffea73b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:46.971762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959f998-4b26-4ac9-a987-e01e9ffea73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:47.024758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-0959f998-4b26-4ac9-a987-e01e9ffea73b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:47.039404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0959f998-4b26-4ac9-a987-e01e9ffea73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:47.133125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1102/2192] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:47.134911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e0e38-3eef-4be1-8610-f455f751659d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:47.135236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e0e38-3eef-4be1-8610-f455f751659d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:47.135469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e0e38-3eef-4be1-8610-f455f751659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:47.160249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7b0e0e38-3eef-4be1-8610-f455f751659d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:47.161373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7b0e0e38-3eef-4be1-8610-f455f751659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:47.171793 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1091/2193] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:47.175934 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f998-4b26-4ac9-a987-e01e9ffea73b None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:47.186631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959f998-4b26-4ac9-a987-e01e9ffea73b None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:47.191455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42943c36-1375-41b9-932e-d7fbcd5f5ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:47.192121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42943c36-1375-41b9-932e-d7fbcd5f5ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:47.192406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42943c36-1375-41b9-932e-d7fbcd5f5ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:47.192680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42943c36-1375-41b9-932e-d7fbcd5f5ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:47.193412 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42943c36-1375-41b9-932e-d7fbcd5f5ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:48:47.193717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42943c36-1375-41b9-932e-d7fbcd5f5ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:47.195345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42943c36-1375-41b9-932e-d7fbcd5f5ce7 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:47.216772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1103/2194] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:48:47.218564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e0e38-3eef-4be1-8610-f455f751659d None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:47.232184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e0e38-3eef-4be1-8610-f455f751659d None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:47.239465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaa2b5-ca10-4592-a85c-d9c2432db2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:47.240375 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaa2b5-ca10-4592-a85c-d9c2432db2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:47.240887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaa2b5-ca10-4592-a85c-d9c2432db2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:47.241329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aaa2b5-ca10-4592-a85c-d9c2432db2e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:47.243383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaa2b5-ca10-4592-a85c-d9c2432db2e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:47.246602 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aaa2b5-ca10-4592-a85c-d9c2432db2e2 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:47.287110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1092/2195] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:48:47 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:48:47.302297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42943c36-1375-41b9-932e-d7fbcd5f5ce7 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:47.315484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42943c36-1375-41b9-932e-d7fbcd5f5ce7 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:47.396615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77552bf8-8d13-4614-8c1e-ddd4a65809ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:47.397448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77552bf8-8d13-4614-8c1e-ddd4a65809ef admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:47.397740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77552bf8-8d13-4614-8c1e-ddd4a65809ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:47.398020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77552bf8-8d13-4614-8c1e-ddd4a65809ef admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:47.399594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77552bf8-8d13-4614-8c1e-ddd4a65809ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:47.402089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77552bf8-8d13-4614-8c1e-ddd4a65809ef admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:47.440817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaa2b5-ca10-4592-a85c-d9c2432db2e2 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:47.452513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1104/2196] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:48:47 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:48:47.455927 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aaa2b5-ca10-4592-a85c-d9c2432db2e2 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:47.463231 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e178ff-37d7-4a54-9a35-6afd28672ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:47.464329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e178ff-37d7-4a54-9a35-6afd28672ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:47.464770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e178ff-37d7-4a54-9a35-6afd28672ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:47.465252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e178ff-37d7-4a54-9a35-6afd28672ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:47.466720 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e178ff-37d7-4a54-9a35-6afd28672ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:47.468883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e178ff-37d7-4a54-9a35-6afd28672ff5 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:47.486769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77552bf8-8d13-4614-8c1e-ddd4a65809ef admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:47.488550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1093/2197] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:47.499253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77552bf8-8d13-4614-8c1e-ddd4a65809ef admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:47.506277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6174d5-f31d-4efc-ac7f-68189367b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:47.506996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6174d5-f31d-4efc-ac7f-68189367b03f admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:47.507280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6174d5-f31d-4efc-ac7f-68189367b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:47.508047 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6174d5-f31d-4efc-ac7f-68189367b03f admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:47.509126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6174d5-f31d-4efc-ac7f-68189367b03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:47.511752 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6174d5-f31d-4efc-ac7f-68189367b03f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:47.536296 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1105/2198] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:48:47.541776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e178ff-37d7-4a54-9a35-6afd28672ff5 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:47.553274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e178ff-37d7-4a54-9a35-6afd28672ff5 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:47.559694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11b63c-7be2-4ff7-be01-96bc85c01442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:47.560710 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11b63c-7be2-4ff7-be01-96bc85c01442 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:47.561340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11b63c-7be2-4ff7-be01-96bc85c01442 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:47.561340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11b63c-7be2-4ff7-be01-96bc85c01442 admin admin] PATH_INFO: `/v3/projects/c1e7c6697dfc4562b4c1d46ee21964a5/users/1e8303a1f1584ae2aae774eaf31481f0/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:47.580009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11b63c-7be2-4ff7-be01-96bc85c01442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e7c6697dfc4562b4c1d46ee21964a5, user_id=1e8303a1f1584ae2aae774eaf31481f0, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:47.582873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11b63c-7be2-4ff7-be01-96bc85c01442 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:47.597313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1094/2199] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:47 2022] PUT /identity/v3/projects/c1e7c6697dfc4562b4c1d46ee21964a5/users/1e8303a1f1584ae2aae774eaf31481f0/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:47.607985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e94b5-2c4a-4668-9f8b-cb7cdfe2e027 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:47.608266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e94b5-2c4a-4668-9f8b-cb7cdfe2e027 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:47.608528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e94b5-2c4a-4668-9f8b-cb7cdfe2e027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:47.642975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-ad5e94b5-2c4a-4668-9f8b-cb7cdfe2e027 None None] MFA Rules not processed for user `1e8303a1f1584ae2aae774eaf31481f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:47.644419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ad5e94b5-2c4a-4668-9f8b-cb7cdfe2e027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:47.720826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1106/2200] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:47.723592 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11b63c-7be2-4ff7-be01-96bc85c01442 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:47.725296 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-5c11b63c-7be2-4ff7-be01-96bc85c01442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:47.780690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11b63c-7be2-4ff7-be01-96bc85c01442 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:47.784277 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0558a-8967-4b63-ad69-963fb1fed420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:47.784906 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0558a-8967-4b63-ad69-963fb1fed420 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:47.785185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0558a-8967-4b63-ad69-963fb1fed420 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:47.785461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0558a-8967-4b63-ad69-963fb1fed420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:47.794215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0558a-8967-4b63-ad69-963fb1fed420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:47.795652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0558a-8967-4b63-ad69-963fb1fed420 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:47.804229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1095/2201] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:48.350982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e94b5-2c4a-4668-9f8b-cb7cdfe2e027 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:48.352364 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ad5e94b5-2c4a-4668-9f8b-cb7cdfe2e027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:48.422097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e94b5-2c4a-4668-9f8b-cb7cdfe2e027 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:48.426846 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:48.427711 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:48.427996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:48.428272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] PATH_INFO: `/v3/users/913a8bf4fc2847cbb0d84f48fcb80220` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:48.429468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=913a8bf4fc2847cbb0d84f48fcb80220)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:48.431984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:48.482811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '913a8bf4fc2847cbb0d84f48fcb80220'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:48.494333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '913a8bf4fc2847cbb0d84f48fcb80220'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:48.495132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '913a8bf4fc2847cbb0d84f48fcb80220'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:48.495730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '913a8bf4fc2847cbb0d84f48fcb80220'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:48.502499 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '913a8bf4fc2847cbb0d84f48fcb80220'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:48.518635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1107/2202] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:48:48 2022] DELETE /identity/v3/users/913a8bf4fc2847cbb0d84f48fcb80220 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:48.523140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32cf78-e1c5-45f3-9b5d-5a04482c91ea None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:48.523603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32cf78-e1c5-45f3-9b5d-5a04482c91ea None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:48.523726 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32cf78-e1c5-45f3-9b5d-5a04482c91ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:48.542645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6d32cf78-e1c5-45f3-9b5d-5a04482c91ea None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:48.543944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6d32cf78-e1c5-45f3-9b5d-5a04482c91ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:48.612476 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1096/2203] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:48.623039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:48.624712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:48.683380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a60b32-1602-461c-b79a-138da40c5a9f admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:48.687304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495785c-3b2c-4950-9aad-0c35b56b58e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:48.688200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495785c-3b2c-4950-9aad-0c35b56b58e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:48.688516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495785c-3b2c-4950-9aad-0c35b56b58e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:48.688738 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495785c-3b2c-4950-9aad-0c35b56b58e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:48.698912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495785c-3b2c-4950-9aad-0c35b56b58e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:48.700350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495785c-3b2c-4950-9aad-0c35b56b58e7 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:48.710101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1108/2204] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:48.988772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32cf78-e1c5-45f3-9b5d-5a04482c91ea None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:48.990177 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6d32cf78-e1c5-45f3-9b5d-5a04482c91ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:49.001945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32cf78-e1c5-45f3-9b5d-5a04482c91ea None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:49.006608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:49.007461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.007738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.008007 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] PATH_INFO: `/v3/projects/c5087f1cbd764a11a7b4f74da8f3ec1b` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.010084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5087f1cbd764a11a7b4f74da8f3ec1b)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:49.012241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:49.063815 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5087f1cbd764a11a7b4f74da8f3ec1b', 'request_id': 'req-ea6caed3-d2e2-413d-99e5-a720a29d8c20'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:49.073049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5087f1cbd764a11a7b4f74da8f3ec1b', 'request_id': 'req-ea6caed3-d2e2-413d-99e5-a720a29d8c20'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:49.079908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5087f1cbd764a11a7b4f74da8f3ec1b', 'request_id': 'req-ea6caed3-d2e2-413d-99e5-a720a29d8c20'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:49.093073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] The token cache is being invalidate because project c5087f1cbd764a11a7b4f74da8f3ec1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:48:49.093465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:49.094019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ea6caed3-d2e2-413d-99e5-a720a29d8c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:48:49.095870 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1097/2205] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:48:48 2022] DELETE /identity/v3/projects/c5087f1cbd764a11a7b4f74da8f3ec1b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:49.100618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389130-5f4d-488b-a8a5-c03125b8ed83 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.100909 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389130-5f4d-488b-a8a5-c03125b8ed83 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.101190 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08389130-5f4d-488b-a8a5-c03125b8ed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.131332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-08389130-5f4d-488b-a8a5-c03125b8ed83 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:49.132580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-08389130-5f4d-488b-a8a5-c03125b8ed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:49.165502 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8eac9-ab4c-4551-9d1b-458c0dd32e77 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.166363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8eac9-ab4c-4551-9d1b-458c0dd32e77 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.166363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8eac9-ab4c-4551-9d1b-458c0dd32e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.184584 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-1cc8eac9-ab4c-4551-9d1b-458c0dd32e77 None None] MFA Rules not processed for user `1e8303a1f1584ae2aae774eaf31481f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:49.185808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1cc8eac9-ab4c-4551-9d1b-458c0dd32e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:49.199084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1109/2206] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:49.207908 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09699d44-1ec8-41a9-ba0b-9888d9259539 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.208240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09699d44-1ec8-41a9-ba0b-9888d9259539 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.208487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09699d44-1ec8-41a9-ba0b-9888d9259539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.227727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-09699d44-1ec8-41a9-ba0b-9888d9259539 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:49.229217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-09699d44-1ec8-41a9-ba0b-9888d9259539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:49.239438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1110/2207] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:49.243913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09699d44-1ec8-41a9-ba0b-9888d9259539 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:49.250598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1098/2208] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:48:49.257342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09699d44-1ec8-41a9-ba0b-9888d9259539 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:49.263848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5758a3-0e9b-4f5e-bdee-836578147754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:49.264515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5758a3-0e9b-4f5e-bdee-836578147754 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.264800 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5758a3-0e9b-4f5e-bdee-836578147754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.265104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5758a3-0e9b-4f5e-bdee-836578147754 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.265843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5758a3-0e9b-4f5e-bdee-836578147754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:48:49.266151 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5758a3-0e9b-4f5e-bdee-836578147754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:49.268123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5758a3-0e9b-4f5e-bdee-836578147754 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:49.281602 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1111/2209] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:48:49.285889 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8eac9-ab4c-4551-9d1b-458c0dd32e77 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:49.298263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8eac9-ab4c-4551-9d1b-458c0dd32e77 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:49.303227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c742ad-1788-4571-82c9-a63d8f82000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:49.304004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c742ad-1788-4571-82c9-a63d8f82000a admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.304287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c742ad-1788-4571-82c9-a63d8f82000a admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.304566 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c742ad-1788-4571-82c9-a63d8f82000a admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.305258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c742ad-1788-4571-82c9-a63d8f82000a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:49.308369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c742ad-1788-4571-82c9-a63d8f82000a admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:49.346394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1099/2210] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:48:49 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:48:49.348859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5758a3-0e9b-4f5e-bdee-836578147754 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:49.359636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5758a3-0e9b-4f5e-bdee-836578147754 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:49.415457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92aa54-334a-4a13-8577-50d3b0e98a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:49.416136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92aa54-334a-4a13-8577-50d3b0e98a24 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.416428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92aa54-334a-4a13-8577-50d3b0e98a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.416742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92aa54-334a-4a13-8577-50d3b0e98a24 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.418066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92aa54-334a-4a13-8577-50d3b0e98a24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:49.420055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92aa54-334a-4a13-8577-50d3b0e98a24 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:49.443545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1112/2211] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:48:49 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:48:49.444630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c742ad-1788-4571-82c9-a63d8f82000a admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:49.455589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c742ad-1788-4571-82c9-a63d8f82000a admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:49.460381 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e6e59-68b9-4562-aeb9-3e3d3934ed65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:49.461038 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e6e59-68b9-4562-aeb9-3e3d3934ed65 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.461322 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e6e59-68b9-4562-aeb9-3e3d3934ed65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.461595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e6e59-68b9-4562-aeb9-3e3d3934ed65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.462391 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e6e59-68b9-4562-aeb9-3e3d3934ed65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:49.464170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e6e59-68b9-4562-aeb9-3e3d3934ed65 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:49.474653 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1100/2212] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:48:49.478838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92aa54-334a-4a13-8577-50d3b0e98a24 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:49.489048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92aa54-334a-4a13-8577-50d3b0e98a24 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:49.494811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1cb61-be49-40f7-b260-c66e2a044b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:49.495511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1cb61-be49-40f7-b260-c66e2a044b10 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.495801 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1cb61-be49-40f7-b260-c66e2a044b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.496075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1cb61-be49-40f7-b260-c66e2a044b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.496807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1cb61-be49-40f7-b260-c66e2a044b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:49.498433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1cb61-be49-40f7-b260-c66e2a044b10 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:49.508298 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1113/2213] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:48:49.512506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e6e59-68b9-4562-aeb9-3e3d3934ed65 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:49.522370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e6e59-68b9-4562-aeb9-3e3d3934ed65 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:49.528488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a67187-42c9-42f6-b007-7eb3b445ea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:49.529386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a67187-42c9-42f6-b007-7eb3b445ea0a admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.529678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a67187-42c9-42f6-b007-7eb3b445ea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.529955 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a67187-42c9-42f6-b007-7eb3b445ea0a admin admin] PATH_INFO: `/v3/projects/71b09f9f20b340b5a615b24e05312703/users/e0156ed87a5b4efca7ef5056429db1a0/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.548006 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a67187-42c9-42f6-b007-7eb3b445ea0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b09f9f20b340b5a615b24e05312703, user_id=e0156ed87a5b4efca7ef5056429db1a0, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:49.550748 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a67187-42c9-42f6-b007-7eb3b445ea0a admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:49.564842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1101/2214] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:48:49 2022] PUT /identity/v3/projects/71b09f9f20b340b5a615b24e05312703/users/e0156ed87a5b4efca7ef5056429db1a0/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:48:49.570094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a2979-678f-4063-a118-3354ee0220d1 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.570423 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a2979-678f-4063-a118-3354ee0220d1 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.570715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a2979-678f-4063-a118-3354ee0220d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.590360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c46a2979-678f-4063-a118-3354ee0220d1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:49.591582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c46a2979-678f-4063-a118-3354ee0220d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:49.672860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1114/2215] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:49.684079 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a67187-42c9-42f6-b007-7eb3b445ea0a admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:49.685911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-16a67187-42c9-42f6-b007-7eb3b445ea0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:49.786076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a67187-42c9-42f6-b007-7eb3b445ea0a admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:49.798911 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb45021-f359-43e7-89e9-8443b8180a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:49.799707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb45021-f359-43e7-89e9-8443b8180a61 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:49.799823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb45021-f359-43e7-89e9-8443b8180a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:49.800090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb45021-f359-43e7-89e9-8443b8180a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:49.818610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb45021-f359-43e7-89e9-8443b8180a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:49.819958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb45021-f359-43e7-89e9-8443b8180a61 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:49.837028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1102/2216] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:50.066202 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c6b71-6b5e-4f7b-9305-a1591f00b9ba None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:50.066968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c6b71-6b5e-4f7b-9305-a1591f00b9ba None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:50.067310 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c6b71-6b5e-4f7b-9305-a1591f00b9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:50.099173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-564c6b71-6b5e-4f7b-9305-a1591f00b9ba None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:50.100381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-564c6b71-6b5e-4f7b-9305-a1591f00b9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:50.190099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1115/2217] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:48:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:50.204639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb45021-f359-43e7-89e9-8443b8180a61 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:50.206112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6fb45021-f359-43e7-89e9-8443b8180a61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:50.332693 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb45021-f359-43e7-89e9-8443b8180a61 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:50.342135 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048b381-0343-4646-b607-38e0d2276aa7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:50.343191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b381-0343-4646-b607-38e0d2276aa7 service swift] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:50.343758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b381-0343-4646-b607-38e0d2276aa7 service swift] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:50.345074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048b381-0343-4646-b607-38e0d2276aa7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:50.356411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048b381-0343-4646-b607-38e0d2276aa7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:50.358910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048b381-0343-4646-b607-38e0d2276aa7 service swift] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:50.373096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1103/2218] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:48:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:48:51.377455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488582a1-1670-47b8-b5de-174f2c7025c2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:51.377935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488582a1-1670-47b8-b5de-174f2c7025c2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:51.378037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488582a1-1670-47b8-b5de-174f2c7025c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:51.407809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-488582a1-1670-47b8-b5de-174f2c7025c2 None None] MFA Rules not processed for user `e0156ed87a5b4efca7ef5056429db1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:51.412877 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-488582a1-1670-47b8-b5de-174f2c7025c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:51.505422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1116/2219] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:48:51.517916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048b381-0343-4646-b607-38e0d2276aa7 service swift] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:48:51.519976 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b048b381-0343-4646-b607-38e0d2276aa7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:51.591643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048b381-0343-4646-b607-38e0d2276aa7 service swift] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:48:51.595651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd60907-f937-4a21-b0fc-7b6726815ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:48:51.596293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd60907-f937-4a21-b0fc-7b6726815ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:51.596601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd60907-f937-4a21-b0fc-7b6726815ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:51.596871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd60907-f937-4a21-b0fc-7b6726815ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:51.607467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd60907-f937-4a21-b0fc-7b6726815ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:48:51.608924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd60907-f937-4a21-b0fc-7b6726815ac3 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:48:51.620134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1104/2220] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:48:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:48:55.155106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c7309-2001-4c9d-84b9-cbb20dc7a9d2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:48:55.155764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c7309-2001-4c9d-84b9-cbb20dc7a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:48:55.155764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c7309-2001-4c9d-84b9-cbb20dc7a9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:48:55.173839 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-650c7309-2001-4c9d-84b9-cbb20dc7a9d2 None None] MFA Rules not processed for user `e0156ed87a5b4efca7ef5056429db1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:48:55.175074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-650c7309-2001-4c9d-84b9-cbb20dc7a9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:48:55.181975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1117/2221] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:48:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:20.682718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893b780-1246-48e9-a4c2-31e78622d311 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:20.683389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893b780-1246-48e9-a4c2-31e78622d311 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:20.683389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893b780-1246-48e9-a4c2-31e78622d311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:20.701270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c893b780-1246-48e9-a4c2-31e78622d311 None None] MFA Rules not processed for user `7b896317d96a40d6a137db0dcf5f98f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:20.702494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c893b780-1246-48e9-a4c2-31e78622d311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:20.756576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1105/2222] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:49:26.649336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c7309-2001-4c9d-84b9-cbb20dc7a9d2 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:26.650906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-650c7309-2001-4c9d-84b9-cbb20dc7a9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:26.763684 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c7309-2001-4c9d-84b9-cbb20dc7a9d2 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:26.769320 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e9080-4c6a-4edf-9efb-47fe44f2b81c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fac310b740a40718191e905723222ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:26.770015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e9080-4c6a-4edf-9efb-47fe44f2b81c service placement] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:26.770303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e9080-4c6a-4edf-9efb-47fe44f2b81c service placement] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:26.770774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e9080-4c6a-4edf-9efb-47fe44f2b81c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:26.772565 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ae9e9080-4c6a-4edf-9efb-47fe44f2b81c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:26.786492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e9080-4c6a-4edf-9efb-47fe44f2b81c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:26.788115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e9080-4c6a-4edf-9efb-47fe44f2b81c service placement] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:26.799951 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1118/2223] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:27.603591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893b780-1246-48e9-a4c2-31e78622d311 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:27.605579 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c893b780-1246-48e9-a4c2-31e78622d311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:27.618760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893b780-1246-48e9-a4c2-31e78622d311 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:27.623300 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:27.624145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:27.624420 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:27.624689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] PATH_INFO: `/v3/users/cf1cc753646b4dfa80ab940adfeab835` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:27.625849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf1cc753646b4dfa80ab940adfeab835)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:27.627792 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:27.673477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf1cc753646b4dfa80ab940adfeab835'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:27.685813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf1cc753646b4dfa80ab940adfeab835'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:27.686023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf1cc753646b4dfa80ab940adfeab835'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:27.686658 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf1cc753646b4dfa80ab940adfeab835'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:27.693255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf1cc753646b4dfa80ab940adfeab835'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:27.706501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1106/2224] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:49:27 2022] DELETE /identity/v3/users/cf1cc753646b4dfa80ab940adfeab835 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:27.710921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c1177-0692-419b-bb55-02cbc7846578 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:27.711387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c1177-0692-419b-bb55-02cbc7846578 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:27.711483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c1177-0692-419b-bb55-02cbc7846578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:27.731077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-085c1177-0692-419b-bb55-02cbc7846578 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:27.732288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-085c1177-0692-419b-bb55-02cbc7846578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:27.789729 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1119/2225] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:27.799208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:27.800647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:27.859157 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3bead8-6011-41b3-bf42-929d4122be38 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:27.863153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626afa6d-e5c4-45b0-820b-bcc3f443570b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:27.863797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626afa6d-e5c4-45b0-820b-bcc3f443570b service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:27.864075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626afa6d-e5c4-45b0-820b-bcc3f443570b service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:27.864347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626afa6d-e5c4-45b0-820b-bcc3f443570b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:27.874453 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626afa6d-e5c4-45b0-820b-bcc3f443570b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:27.875894 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626afa6d-e5c4-45b0-820b-bcc3f443570b service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:27.887055 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1107/2226] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:28.385373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c1177-0692-419b-bb55-02cbc7846578 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:28.386927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-085c1177-0692-419b-bb55-02cbc7846578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:28.398218 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c1177-0692-419b-bb55-02cbc7846578 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:28.404712 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:28.405579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:28.405867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:28.406145 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] PATH_INFO: `/v3/projects/5505ee2c16a94e10af4b45c3ea8e0032` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:28.407460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5505ee2c16a94e10af4b45c3ea8e0032)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:28.409375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:28.455741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5505ee2c16a94e10af4b45c3ea8e0032', 'request_id': 'req-8543c91f-306a-446a-944b-68a8771be7da'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:28.462895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5505ee2c16a94e10af4b45c3ea8e0032', 'request_id': 'req-8543c91f-306a-446a-944b-68a8771be7da'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:28.471883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5505ee2c16a94e10af4b45c3ea8e0032', 'request_id': 'req-8543c91f-306a-446a-944b-68a8771be7da'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:28.488392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] The token cache is being invalidate because project 5505ee2c16a94e10af4b45c3ea8e0032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:49:28.488666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:28.489299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:28.493371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1120/2227] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:49:28 2022] DELETE /identity/v3/projects/5505ee2c16a94e10af4b45c3ea8e0032 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:28.497535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626afa6d-e5c4-45b0-820b-bcc3f443570b service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:28.507603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626afa6d-e5c4-45b0-820b-bcc3f443570b service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:28.567846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588ee49-f5d7-49e4-bef9-9f5db227ae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:28.568812 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588ee49-f5d7-49e4-bef9-9f5db227ae90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:28.569090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588ee49-f5d7-49e4-bef9-9f5db227ae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:28.569359 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588ee49-f5d7-49e4-bef9-9f5db227ae90 admin admin] PATH_INFO: `/v3/users/830c750d7a6d481ea841af6682533c73` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:28.570595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588ee49-f5d7-49e4-bef9-9f5db227ae90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=830c750d7a6d481ea841af6682533c73)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:28.572555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588ee49-f5d7-49e4-bef9-9f5db227ae90 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:28.629852 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c588ee49-f5d7-49e4-bef9-9f5db227ae90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830c750d7a6d481ea841af6682533c73'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:28.643561 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c588ee49-f5d7-49e4-bef9-9f5db227ae90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830c750d7a6d481ea841af6682533c73'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:28.644298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c588ee49-f5d7-49e4-bef9-9f5db227ae90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830c750d7a6d481ea841af6682533c73'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:28.644910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c588ee49-f5d7-49e4-bef9-9f5db227ae90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830c750d7a6d481ea841af6682533c73'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:28.653154 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c588ee49-f5d7-49e4-bef9-9f5db227ae90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830c750d7a6d481ea841af6682533c73'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:28.667848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1108/2228] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:49:28 2022] DELETE /identity/v3/users/830c750d7a6d481ea841af6682533c73 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:28.959399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:28.962654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:28.984225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543c91f-306a-446a-944b-68a8771be7da admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:29.042426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:29.043282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.043567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.043844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] PATH_INFO: `/v3/projects/fe554f2b393c4679945e879e873f91e7` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.045024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe554f2b393c4679945e879e873f91e7)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:29.046965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:29.092823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe554f2b393c4679945e879e873f91e7', 'request_id': 'req-0be50c37-5587-4b93-b875-a5a1d49efd59'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:29.098761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe554f2b393c4679945e879e873f91e7', 'request_id': 'req-0be50c37-5587-4b93-b875-a5a1d49efd59'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:29.105615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe554f2b393c4679945e879e873f91e7', 'request_id': 'req-0be50c37-5587-4b93-b875-a5a1d49efd59'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:29.115861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] The token cache is being invalidate because project fe554f2b393c4679945e879e873f91e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:49:29.116144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:29.116768 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0be50c37-5587-4b93-b875-a5a1d49efd59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:29.118317 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1121/2229] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:49:28 2022] DELETE /identity/v3/projects/fe554f2b393c4679945e879e873f91e7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:29.125103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d2927-425b-4bc1-ad52-4ec8f272612e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.125392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d2927-425b-4bc1-ad52-4ec8f272612e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.125669 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d2927-425b-4bc1-ad52-4ec8f272612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.153199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-037d2927-425b-4bc1-ad52-4ec8f272612e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:29.154374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-037d2927-425b-4bc1-ad52-4ec8f272612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:29.211060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1109/2230] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:29.219195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69f960-de52-4c78-ab4d-acd5541c0f07 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.219552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69f960-de52-4c78-ab4d-acd5541c0f07 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.219894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69f960-de52-4c78-ab4d-acd5541c0f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.237964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-ec69f960-de52-4c78-ab4d-acd5541c0f07 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:29.239174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ec69f960-de52-4c78-ab4d-acd5541c0f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:29.247536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1122/2231] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:29.251554 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d2927-425b-4bc1-ad52-4ec8f272612e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:29.261201 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d2927-425b-4bc1-ad52-4ec8f272612e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:29.266274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c873ee6-90db-4510-a657-847ca6d1b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:29.266945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c873ee6-90db-4510-a657-847ca6d1b678 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.267229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c873ee6-90db-4510-a657-847ca6d1b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.267501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c873ee6-90db-4510-a657-847ca6d1b678 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.268221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c873ee6-90db-4510-a657-847ca6d1b678 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:49:29.268522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c873ee6-90db-4510-a657-847ca6d1b678 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:29.270104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c873ee6-90db-4510-a657-847ca6d1b678 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:29.284893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1110/2232] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:49:29.285902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69f960-de52-4c78-ab4d-acd5541c0f07 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:29.295852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69f960-de52-4c78-ab4d-acd5541c0f07 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:29.300507 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3f2b9-fb39-45fb-b96c-4caf72c0c95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:29.301159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3f2b9-fb39-45fb-b96c-4caf72c0c95e admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.301444 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3f2b9-fb39-45fb-b96c-4caf72c0c95e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.301721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3f2b9-fb39-45fb-b96c-4caf72c0c95e admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.302462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3f2b9-fb39-45fb-b96c-4caf72c0c95e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:29.304364 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3f2b9-fb39-45fb-b96c-4caf72c0c95e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:29.330514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1123/2233] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:49:29 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:49:29.334633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c873ee6-90db-4510-a657-847ca6d1b678 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:29.345589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c873ee6-90db-4510-a657-847ca6d1b678 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:29.410260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82011d-4402-4465-a429-cfd9990ade1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:29.410950 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82011d-4402-4465-a429-cfd9990ade1d admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.411230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82011d-4402-4465-a429-cfd9990ade1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.411501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82011d-4402-4465-a429-cfd9990ade1d admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.412189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82011d-4402-4465-a429-cfd9990ade1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:29.414153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82011d-4402-4465-a429-cfd9990ade1d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:29.434327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1111/2234] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:49:29 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:49:29.438523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3f2b9-fb39-45fb-b96c-4caf72c0c95e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:29.449457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3f2b9-fb39-45fb-b96c-4caf72c0c95e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:29.454073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2a3f4-bb91-4020-bd26-cd79fd7d3638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:29.454757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2a3f4-bb91-4020-bd26-cd79fd7d3638 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.455038 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2a3f4-bb91-4020-bd26-cd79fd7d3638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.455309 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2a3f4-bb91-4020-bd26-cd79fd7d3638 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.456029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2a3f4-bb91-4020-bd26-cd79fd7d3638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:29.457617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2a3f4-bb91-4020-bd26-cd79fd7d3638 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:29.469371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1124/2235] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:49:29.473394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82011d-4402-4465-a429-cfd9990ade1d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:29.483980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82011d-4402-4465-a429-cfd9990ade1d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:29.488942 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d61c5-b9d6-4c62-b310-82da8377c00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:29.489600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d61c5-b9d6-4c62-b310-82da8377c00a admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.489883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d61c5-b9d6-4c62-b310-82da8377c00a admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.490158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d61c5-b9d6-4c62-b310-82da8377c00a admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.490930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d61c5-b9d6-4c62-b310-82da8377c00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:29.492530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d61c5-b9d6-4c62-b310-82da8377c00a admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:29.503481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1112/2236] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:49:29.507579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2a3f4-bb91-4020-bd26-cd79fd7d3638 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:29.518723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2a3f4-bb91-4020-bd26-cd79fd7d3638 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:29.523454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d837f-de23-40bb-a5e4-78dd7ff6c1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:29.524363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d837f-de23-40bb-a5e4-78dd7ff6c1a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.524642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d837f-de23-40bb-a5e4-78dd7ff6c1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.524917 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d837f-de23-40bb-a5e4-78dd7ff6c1a5 admin admin] PATH_INFO: `/v3/projects/373a07f9682841f6901ecb4c218065b0/users/a47e5b980c434f45829279569dcb2fbe/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.540630 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d837f-de23-40bb-a5e4-78dd7ff6c1a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373a07f9682841f6901ecb4c218065b0, user_id=a47e5b980c434f45829279569dcb2fbe, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:29.543953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d837f-de23-40bb-a5e4-78dd7ff6c1a5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:29.556393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1125/2237] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:49:29 2022] PUT /identity/v3/projects/373a07f9682841f6901ecb4c218065b0/users/a47e5b980c434f45829279569dcb2fbe/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:29.567143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01791-df4e-488c-8e1c-f4cafa14fab8 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.567436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01791-df4e-488c-8e1c-f4cafa14fab8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.567760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01791-df4e-488c-8e1c-f4cafa14fab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.594194 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-67c01791-df4e-488c-8e1c-f4cafa14fab8 None None] MFA Rules not processed for user `a47e5b980c434f45829279569dcb2fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:29.595411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-67c01791-df4e-488c-8e1c-f4cafa14fab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:29.659720 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1113/2238] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:29.664155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d837f-de23-40bb-a5e4-78dd7ff6c1a5 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:29.724199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d837f-de23-40bb-a5e4-78dd7ff6c1a5 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:29.728862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4293e0-b3ac-4831-9f21-41cb770c2bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:29.729541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4293e0-b3ac-4831-9f21-41cb770c2bfd admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.729821 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4293e0-b3ac-4831-9f21-41cb770c2bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.730094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4293e0-b3ac-4831-9f21-41cb770c2bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.730864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4293e0-b3ac-4831-9f21-41cb770c2bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:29.732763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4293e0-b3ac-4831-9f21-41cb770c2bfd admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:29.761149 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1126/2239] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:49:29 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:49:29.764836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01791-df4e-488c-8e1c-f4cafa14fab8 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:29.775788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c01791-df4e-488c-8e1c-f4cafa14fab8 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:29.839132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dbdaa-1d21-4ec1-a99e-0212eb2212fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:29.839926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dbdaa-1d21-4ec1-a99e-0212eb2212fd admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.840217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dbdaa-1d21-4ec1-a99e-0212eb2212fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.840495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dbdaa-1d21-4ec1-a99e-0212eb2212fd admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.841225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dbdaa-1d21-4ec1-a99e-0212eb2212fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:29.843897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dbdaa-1d21-4ec1-a99e-0212eb2212fd admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:29.871103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1114/2240] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:49:29 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:49:29.872331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4293e0-b3ac-4831-9f21-41cb770c2bfd admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:29.882713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4293e0-b3ac-4831-9f21-41cb770c2bfd admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:29.890270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104347f3-572f-49b7-84ff-06edebc9ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:29.890965 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104347f3-572f-49b7-84ff-06edebc9ed1c admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.891251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104347f3-572f-49b7-84ff-06edebc9ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.891539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104347f3-572f-49b7-84ff-06edebc9ed1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.892257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104347f3-572f-49b7-84ff-06edebc9ed1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:29.893867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104347f3-572f-49b7-84ff-06edebc9ed1c admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:29.905176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1127/2241] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:49:29.909235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dbdaa-1d21-4ec1-a99e-0212eb2212fd admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:29.919595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dbdaa-1d21-4ec1-a99e-0212eb2212fd admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:29.924413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b0df6-1ee9-4a20-9ab5-7ab7c47a2eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:29.925313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0df6-1ee9-4a20-9ab5-7ab7c47a2eea admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:29.925614 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0df6-1ee9-4a20-9ab5-7ab7c47a2eea admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:29.925861 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b0df6-1ee9-4a20-9ab5-7ab7c47a2eea admin admin] PATH_INFO: `/v3/projects/9b2522587a964785bbc5bb1676398f1f/users/708527cc44794e9c8cc50f8c43e1c539/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:29.942249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b0df6-1ee9-4a20-9ab5-7ab7c47a2eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2522587a964785bbc5bb1676398f1f, user_id=708527cc44794e9c8cc50f8c43e1c539, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:29.944967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b0df6-1ee9-4a20-9ab5-7ab7c47a2eea admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:29.958432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1115/2242] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:49:29 2022] PUT /identity/v3/projects/9b2522587a964785bbc5bb1676398f1f/users/708527cc44794e9c8cc50f8c43e1c539/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:29.962767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104347f3-572f-49b7-84ff-06edebc9ed1c admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:29.975128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104347f3-572f-49b7-84ff-06edebc9ed1c admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:30.031842 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfb062-8b48-4e12-be67-54eccd5238ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:30.032511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfb062-8b48-4e12-be67-54eccd5238ac admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:30.032788 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfb062-8b48-4e12-be67-54eccd5238ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:30.033059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfb062-8b48-4e12-be67-54eccd5238ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:30.033927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfb062-8b48-4e12-be67-54eccd5238ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:30.035653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfb062-8b48-4e12-be67-54eccd5238ac admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:30.046321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1128/2243] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:49:30.050891 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b0df6-1ee9-4a20-9ab5-7ab7c47a2eea admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:30.065543 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b0df6-1ee9-4a20-9ab5-7ab7c47a2eea admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:30.070470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b6142-4a0f-4312-a981-f9de651d151b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:30.071379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b6142-4a0f-4312-a981-f9de651d151b admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:30.071657 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b6142-4a0f-4312-a981-f9de651d151b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:30.071934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b6142-4a0f-4312-a981-f9de651d151b admin admin] PATH_INFO: `/v3/projects/9b2522587a964785bbc5bb1676398f1f/users/708527cc44794e9c8cc50f8c43e1c539/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:30.075171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b6142-4a0f-4312-a981-f9de651d151b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2522587a964785bbc5bb1676398f1f, user_id=708527cc44794e9c8cc50f8c43e1c539, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:30.078577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b6142-4a0f-4312-a981-f9de651d151b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:30.093027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1116/2244] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:49:30 2022] PUT /identity/v3/projects/9b2522587a964785bbc5bb1676398f1f/users/708527cc44794e9c8cc50f8c43e1c539/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:30.106359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5d1f-950a-4c06-a670-3f00c1f3d371 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:30.106651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5d1f-950a-4c06-a670-3f00c1f3d371 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:30.106932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f5d1f-950a-4c06-a670-3f00c1f3d371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:30.145783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-768f5d1f-950a-4c06-a670-3f00c1f3d371 None None] MFA Rules not processed for user `708527cc44794e9c8cc50f8c43e1c539`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:30.147090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-768f5d1f-950a-4c06-a670-3f00c1f3d371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:30.239283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1129/2245] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:30.254972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b6142-4a0f-4312-a981-f9de651d151b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:30.256811 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6f4b6142-4a0f-4312-a981-f9de651d151b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:30.354750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b6142-4a0f-4312-a981-f9de651d151b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:30.358448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273a39-4223-4f90-a5e4-f0817a29d491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:30.359251 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273a39-4223-4f90-a5e4-f0817a29d491 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:30.359659 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273a39-4223-4f90-a5e4-f0817a29d491 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:30.359941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273a39-4223-4f90-a5e4-f0817a29d491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:30.371263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273a39-4223-4f90-a5e4-f0817a29d491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:30.372745 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273a39-4223-4f90-a5e4-f0817a29d491 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:30.383844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1117/2246] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:30.818762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f5d1f-950a-4c06-a670-3f00c1f3d371 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:30.880335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f5d1f-950a-4c06-a670-3f00c1f3d371 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:30.884950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:30.886251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:30.886558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:30.886833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] PATH_INFO: `/v3/users/a47e5b980c434f45829279569dcb2fbe` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:30.888019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47e5b980c434f45829279569dcb2fbe)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:30.889926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:30.939115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47e5b980c434f45829279569dcb2fbe'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:30.950473 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47e5b980c434f45829279569dcb2fbe'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:30.951226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47e5b980c434f45829279569dcb2fbe'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:30.951844 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47e5b980c434f45829279569dcb2fbe'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:30.959141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47e5b980c434f45829279569dcb2fbe'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:30.975099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1130/2247] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:49:30 2022] DELETE /identity/v3/users/a47e5b980c434f45829279569dcb2fbe => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:30.980370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12605f34-2990-4837-8b40-b9ffdb9af57f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:30.980839 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12605f34-2990-4837-8b40-b9ffdb9af57f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:30.980946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12605f34-2990-4837-8b40-b9ffdb9af57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:31.009297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-12605f34-2990-4837-8b40-b9ffdb9af57f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:31.010666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-12605f34-2990-4837-8b40-b9ffdb9af57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:31.071853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1118/2248] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:31.081490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:31.083204 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:31.143888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51678a0-448e-475f-b846-cfde755c7444 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:31.148020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b40f4-3381-46e3-8d64-f91c8e7c3f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:31.148671 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b40f4-3381-46e3-8d64-f91c8e7c3f8c service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:31.148954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b40f4-3381-46e3-8d64-f91c8e7c3f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:31.149254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b40f4-3381-46e3-8d64-f91c8e7c3f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:31.158979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b40f4-3381-46e3-8d64-f91c8e7c3f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:31.160410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b40f4-3381-46e3-8d64-f91c8e7c3f8c service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:31.170391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1131/2249] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:31.498054 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12605f34-2990-4837-8b40-b9ffdb9af57f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:31.499478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-12605f34-2990-4837-8b40-b9ffdb9af57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:31.512446 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12605f34-2990-4837-8b40-b9ffdb9af57f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:31.517255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:31.518225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:31.518640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:31.518918 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] PATH_INFO: `/v3/projects/373a07f9682841f6901ecb4c218065b0` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:31.520112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373a07f9682841f6901ecb4c218065b0)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:31.522061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:31.574742 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373a07f9682841f6901ecb4c218065b0', 'request_id': 'req-074447fe-056b-4e07-bc5d-d138e59c7b16'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:31.584512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373a07f9682841f6901ecb4c218065b0', 'request_id': 'req-074447fe-056b-4e07-bc5d-d138e59c7b16'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:31.590628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373a07f9682841f6901ecb4c218065b0', 'request_id': 'req-074447fe-056b-4e07-bc5d-d138e59c7b16'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:31.601376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] The token cache is being invalidate because project 373a07f9682841f6901ecb4c218065b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:49:31.601665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:31.602290 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:31.603898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1119/2250] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:49:31 2022] DELETE /identity/v3/projects/373a07f9682841f6901ecb4c218065b0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:31.608847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b40f4-3381-46e3-8d64-f91c8e7c3f8c service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:31.618457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b40f4-3381-46e3-8d64-f91c8e7c3f8c service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:31.682418 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764f926-268e-4b23-97a0-d31e873ce146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:31.683196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f926-268e-4b23-97a0-d31e873ce146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:31.683475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f926-268e-4b23-97a0-d31e873ce146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:31.683748 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764f926-268e-4b23-97a0-d31e873ce146 admin admin] PATH_INFO: `/v3/users/708527cc44794e9c8cc50f8c43e1c539` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:31.684923 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764f926-268e-4b23-97a0-d31e873ce146 admin admin] RBAC: Authorizing `identity:delete_user(user_id=708527cc44794e9c8cc50f8c43e1c539)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:31.686856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764f926-268e-4b23-97a0-d31e873ce146 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:31.733306 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0764f926-268e-4b23-97a0-d31e873ce146 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708527cc44794e9c8cc50f8c43e1c539'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:31.748876 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0764f926-268e-4b23-97a0-d31e873ce146 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708527cc44794e9c8cc50f8c43e1c539'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:31.749650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0764f926-268e-4b23-97a0-d31e873ce146 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708527cc44794e9c8cc50f8c43e1c539'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:31.750516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0764f926-268e-4b23-97a0-d31e873ce146 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708527cc44794e9c8cc50f8c43e1c539'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:31.759516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0764f926-268e-4b23-97a0-d31e873ce146 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708527cc44794e9c8cc50f8c43e1c539'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:31.777727 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1132/2251] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:49:31 2022] DELETE /identity/v3/users/708527cc44794e9c8cc50f8c43e1c539 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:32.278766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:32.283129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:32.299857 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074447fe-056b-4e07-bc5d-d138e59c7b16 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:32.407529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:32.408405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:32.408774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:32.408938 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] PATH_INFO: `/v3/projects/9b2522587a964785bbc5bb1676398f1f` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:32.410140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2522587a964785bbc5bb1676398f1f)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:32.412608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:32.459322 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2522587a964785bbc5bb1676398f1f', 'request_id': 'req-5fafc110-808d-4a4b-834d-3c86d65541cc'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:32.467003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2522587a964785bbc5bb1676398f1f', 'request_id': 'req-5fafc110-808d-4a4b-834d-3c86d65541cc'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:32.472492 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2522587a964785bbc5bb1676398f1f', 'request_id': 'req-5fafc110-808d-4a4b-834d-3c86d65541cc'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:32.484183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] The token cache is being invalidate because project 9b2522587a964785bbc5bb1676398f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:49:32.484405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:32.485039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-5fafc110-808d-4a4b-834d-3c86d65541cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:32.486853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1120/2252] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:49:32 2022] DELETE /identity/v3/projects/9b2522587a964785bbc5bb1676398f1f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:32.491735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921ed2a-3b71-4908-b802-c28618950636 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:32.492219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921ed2a-3b71-4908-b802-c28618950636 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:32.492319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921ed2a-3b71-4908-b802-c28618950636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:32.510759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-a921ed2a-3b71-4908-b802-c28618950636 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:32.512016 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a921ed2a-3b71-4908-b802-c28618950636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:32.568995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1133/2253] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:32.577850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eec82-df32-4ac4-b20d-46d35a32106d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:32.578272 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eec82-df32-4ac4-b20d-46d35a32106d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:32.578577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eec82-df32-4ac4-b20d-46d35a32106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:32.599909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b12eec82-df32-4ac4-b20d-46d35a32106d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:32.599909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b12eec82-df32-4ac4-b20d-46d35a32106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:32.609224 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1121/2254] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:32.613725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921ed2a-3b71-4908-b802-c28618950636 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:32.624710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921ed2a-3b71-4908-b802-c28618950636 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:32.634342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5fc91-81e9-46f2-b5a8-9787d91301a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:32.635004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5fc91-81e9-46f2-b5a8-9787d91301a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:32.635315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5fc91-81e9-46f2-b5a8-9787d91301a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:32.635597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5fc91-81e9-46f2-b5a8-9787d91301a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:32.636332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5fc91-81e9-46f2-b5a8-9787d91301a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:49:32.636635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5fc91-81e9-46f2-b5a8-9787d91301a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:32.638229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5fc91-81e9-46f2-b5a8-9787d91301a9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:32.650041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1134/2255] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:49:32.654619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eec82-df32-4ac4-b20d-46d35a32106d None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:32.665256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eec82-df32-4ac4-b20d-46d35a32106d None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:32.672508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa836bc-fa6b-424b-a408-902578e01178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:32.673094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa836bc-fa6b-424b-a408-902578e01178 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:32.673378 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa836bc-fa6b-424b-a408-902578e01178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:32.673647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa836bc-fa6b-424b-a408-902578e01178 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:32.674367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa836bc-fa6b-424b-a408-902578e01178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:32.676330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa836bc-fa6b-424b-a408-902578e01178 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:32.714138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1122/2256] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:49:32 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:49:32.719088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5fc91-81e9-46f2-b5a8-9787d91301a9 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:32.731785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5fc91-81e9-46f2-b5a8-9787d91301a9 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:32.804660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fbd1c-5389-48a4-9a6a-81bf24d67b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:32.805626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fbd1c-5389-48a4-9a6a-81bf24d67b9b admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:32.805976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fbd1c-5389-48a4-9a6a-81bf24d67b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:32.806231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fbd1c-5389-48a4-9a6a-81bf24d67b9b admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:32.807147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fbd1c-5389-48a4-9a6a-81bf24d67b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:32.809446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fbd1c-5389-48a4-9a6a-81bf24d67b9b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:32.837976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1135/2257] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:49:32 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:49:32.843851 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa836bc-fa6b-424b-a408-902578e01178 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:32.856255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa836bc-fa6b-424b-a408-902578e01178 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:32.861863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c226a-e45d-4e97-affe-e9fcaaf281e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:32.863101 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c226a-e45d-4e97-affe-e9fcaaf281e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:32.863387 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c226a-e45d-4e97-affe-e9fcaaf281e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:32.863688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c226a-e45d-4e97-affe-e9fcaaf281e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:32.864410 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c226a-e45d-4e97-affe-e9fcaaf281e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:32.866027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c226a-e45d-4e97-affe-e9fcaaf281e1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:32.878084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1123/2258] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:49:32.882915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fbd1c-5389-48a4-9a6a-81bf24d67b9b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:32.896223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fbd1c-5389-48a4-9a6a-81bf24d67b9b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:32.901792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b808110-06a2-42e1-b4ba-f3e8546360bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:32.902744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b808110-06a2-42e1-b4ba-f3e8546360bc admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:32.903031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b808110-06a2-42e1-b4ba-f3e8546360bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:32.903310 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b808110-06a2-42e1-b4ba-f3e8546360bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:32.904055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b808110-06a2-42e1-b4ba-f3e8546360bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:32.905689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b808110-06a2-42e1-b4ba-f3e8546360bc admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:32.918131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1136/2259] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:49:32.921909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c226a-e45d-4e97-affe-e9fcaaf281e1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:32.933546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c226a-e45d-4e97-affe-e9fcaaf281e1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:32.938326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf60272-7f2d-45a9-ab1e-5631439c5c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:32.939265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf60272-7f2d-45a9-ab1e-5631439c5c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:32.939704 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf60272-7f2d-45a9-ab1e-5631439c5c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:32.939983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf60272-7f2d-45a9-ab1e-5631439c5c5b admin admin] PATH_INFO: `/v3/projects/83e1b90fc1944c8fa0b130d54a0e42ea/users/b8a7a51ac6b64df4b2fa6f18a38489bb/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:32.959463 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf60272-7f2d-45a9-ab1e-5631439c5c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e1b90fc1944c8fa0b130d54a0e42ea, user_id=b8a7a51ac6b64df4b2fa6f18a38489bb, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:32.962962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf60272-7f2d-45a9-ab1e-5631439c5c5b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:32.985124 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1124/2260] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:49:32 2022] PUT /identity/v3/projects/83e1b90fc1944c8fa0b130d54a0e42ea/users/b8a7a51ac6b64df4b2fa6f18a38489bb/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:49:32.996017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730cbe8-97a1-4a8b-8397-4af4934340fe None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:32.996507 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730cbe8-97a1-4a8b-8397-4af4934340fe None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:32.996790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730cbe8-97a1-4a8b-8397-4af4934340fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:33.032321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2730cbe8-97a1-4a8b-8397-4af4934340fe None None] MFA Rules not processed for user `b8a7a51ac6b64df4b2fa6f18a38489bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:33.034620 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2730cbe8-97a1-4a8b-8397-4af4934340fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:33.141260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1137/2261] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:49:33.146230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf60272-7f2d-45a9-ab1e-5631439c5c5b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:33.224191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf60272-7f2d-45a9-ab1e-5631439c5c5b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:33.229659 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4eae8-621c-43e4-bba0-8455d95975f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:33.230501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4eae8-621c-43e4-bba0-8455d95975f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:33.230844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4eae8-621c-43e4-bba0-8455d95975f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:33.231187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4eae8-621c-43e4-bba0-8455d95975f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:33.231947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4eae8-621c-43e4-bba0-8455d95975f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:33.233914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4eae8-621c-43e4-bba0-8455d95975f7 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:33.273131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1125/2262] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:49:33 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:49:33.274280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730cbe8-97a1-4a8b-8397-4af4934340fe None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:33.291654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730cbe8-97a1-4a8b-8397-4af4934340fe None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:33.358994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd4d41-146c-4b23-bcd4-2a29a2e15844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:33.359678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4d41-146c-4b23-bcd4-2a29a2e15844 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:33.359999 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4d41-146c-4b23-bcd4-2a29a2e15844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:33.360274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4d41-146c-4b23-bcd4-2a29a2e15844 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:33.360977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd4d41-146c-4b23-bcd4-2a29a2e15844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:33.363226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd4d41-146c-4b23-bcd4-2a29a2e15844 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:33.392900 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1138/2263] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:49:33 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:49:33.402343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4eae8-621c-43e4-bba0-8455d95975f7 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:33.421089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4eae8-621c-43e4-bba0-8455d95975f7 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:33.427655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17885720-ea55-42f8-95ff-53dac3dcaded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:33.428644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885720-ea55-42f8-95ff-53dac3dcaded admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:33.428992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885720-ea55-42f8-95ff-53dac3dcaded admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:33.429324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17885720-ea55-42f8-95ff-53dac3dcaded admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:33.430131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17885720-ea55-42f8-95ff-53dac3dcaded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:33.431942 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17885720-ea55-42f8-95ff-53dac3dcaded admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:33.450216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1126/2264] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:49:33.451316 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd4d41-146c-4b23-bcd4-2a29a2e15844 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:33.467996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd4d41-146c-4b23-bcd4-2a29a2e15844 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:33.473212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518e726-efcf-4286-a8db-29b677e071f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:33.474278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e726-efcf-4286-a8db-29b677e071f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:33.474757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e726-efcf-4286-a8db-29b677e071f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:33.475850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e726-efcf-4286-a8db-29b677e071f9 admin admin] PATH_INFO: `/v3/projects/850d13d9b8da4ea0936fad7b1a1061e0/users/d95070bfab02469e94d9f8fcf6dfe8f3/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:33.492576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518e726-efcf-4286-a8db-29b677e071f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=850d13d9b8da4ea0936fad7b1a1061e0, user_id=d95070bfab02469e94d9f8fcf6dfe8f3, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:33.496853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518e726-efcf-4286-a8db-29b677e071f9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:33.513069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1139/2265] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:49:33 2022] PUT /identity/v3/projects/850d13d9b8da4ea0936fad7b1a1061e0/users/d95070bfab02469e94d9f8fcf6dfe8f3/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:49:33.517146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17885720-ea55-42f8-95ff-53dac3dcaded admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:33.533257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17885720-ea55-42f8-95ff-53dac3dcaded admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:33.591521 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a40bbc-a2c4-4023-80b9-8d63af208776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:33.592242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40bbc-a2c4-4023-80b9-8d63af208776 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:33.592507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40bbc-a2c4-4023-80b9-8d63af208776 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:33.592782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40bbc-a2c4-4023-80b9-8d63af208776 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:33.593511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a40bbc-a2c4-4023-80b9-8d63af208776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:33.595181 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a40bbc-a2c4-4023-80b9-8d63af208776 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:33.609366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1127/2266] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:49:33.610557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518e726-efcf-4286-a8db-29b677e071f9 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:33.621916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518e726-efcf-4286-a8db-29b677e071f9 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:33.629898 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49b9d8-e6d5-43ba-8c9f-cf21e84a0251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:33.630818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49b9d8-e6d5-43ba-8c9f-cf21e84a0251 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:33.631267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49b9d8-e6d5-43ba-8c9f-cf21e84a0251 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:33.631549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49b9d8-e6d5-43ba-8c9f-cf21e84a0251 admin admin] PATH_INFO: `/v3/projects/850d13d9b8da4ea0936fad7b1a1061e0/users/d95070bfab02469e94d9f8fcf6dfe8f3/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:33.633568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49b9d8-e6d5-43ba-8c9f-cf21e84a0251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=850d13d9b8da4ea0936fad7b1a1061e0, user_id=d95070bfab02469e94d9f8fcf6dfe8f3, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:33.637755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49b9d8-e6d5-43ba-8c9f-cf21e84a0251 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:33.648283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1140/2267] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:49:33 2022] PUT /identity/v3/projects/850d13d9b8da4ea0936fad7b1a1061e0/users/d95070bfab02469e94d9f8fcf6dfe8f3/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:49:33.659674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0f627-17cb-4fff-aa5e-3457c2c9e577 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:33.659966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0f627-17cb-4fff-aa5e-3457c2c9e577 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:33.660246 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0f627-17cb-4fff-aa5e-3457c2c9e577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:33.686980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-3cb0f627-17cb-4fff-aa5e-3457c2c9e577 None None] MFA Rules not processed for user `d95070bfab02469e94d9f8fcf6dfe8f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:33.688201 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3cb0f627-17cb-4fff-aa5e-3457c2c9e577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:33.755261 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1128/2268] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:33.767010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49b9d8-e6d5-43ba-8c9f-cf21e84a0251 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:33.768686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-5c49b9d8-e6d5-43ba-8c9f-cf21e84a0251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:33.826594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49b9d8-e6d5-43ba-8c9f-cf21e84a0251 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:33.838401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c803b81-c2ac-4902-8981-f1eed6640c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:33.839379 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c803b81-c2ac-4902-8981-f1eed6640c43 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:33.839667 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c803b81-c2ac-4902-8981-f1eed6640c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:33.839940 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c803b81-c2ac-4902-8981-f1eed6640c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:33.911838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c803b81-c2ac-4902-8981-f1eed6640c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:33.913333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c803b81-c2ac-4902-8981-f1eed6640c43 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:33.922396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1141/2269] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:36.470101 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0f627-17cb-4fff-aa5e-3457c2c9e577 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:36.554476 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0f627-17cb-4fff-aa5e-3457c2c9e577 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:36.562286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:36.563759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:36.564050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:36.565148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] PATH_INFO: `/v3/users/b8a7a51ac6b64df4b2fa6f18a38489bb` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:36.567320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a7a51ac6b64df4b2fa6f18a38489bb)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:36.571050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:36.634078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a7a51ac6b64df4b2fa6f18a38489bb'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:36.646021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a7a51ac6b64df4b2fa6f18a38489bb'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:36.646851 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a7a51ac6b64df4b2fa6f18a38489bb'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:36.647457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a7a51ac6b64df4b2fa6f18a38489bb'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:36.655047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a7a51ac6b64df4b2fa6f18a38489bb'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:36.668875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1129/2270] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:49:36 2022] DELETE /identity/v3/users/b8a7a51ac6b64df4b2fa6f18a38489bb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:36.673830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22b787-fcfc-44b9-b135-49bacbabe612 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:36.674374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22b787-fcfc-44b9-b135-49bacbabe612 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:36.674560 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22b787-fcfc-44b9-b135-49bacbabe612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:36.691993 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7f22b787-fcfc-44b9-b135-49bacbabe612 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:36.693325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7f22b787-fcfc-44b9-b135-49bacbabe612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:36.755456 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1142/2271] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:36.765198 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:36.766639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:36.827367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451dd5ba-12dc-40ca-9840-26dd3575b069 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:36.831202 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87895-a958-4b86-810b-e19553096f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:36.831991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87895-a958-4b86-810b-e19553096f85 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:36.832277 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87895-a958-4b86-810b-e19553096f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:36.832552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87895-a958-4b86-810b-e19553096f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:36.843091 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87895-a958-4b86-810b-e19553096f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:36.844560 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87895-a958-4b86-810b-e19553096f85 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:36.855095 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1130/2272] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:37.113228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22b787-fcfc-44b9-b135-49bacbabe612 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:37.114746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7f22b787-fcfc-44b9-b135-49bacbabe612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:37.128242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22b787-fcfc-44b9-b135-49bacbabe612 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:37.133065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:37.133921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:37.134203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:37.134505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] PATH_INFO: `/v3/projects/83e1b90fc1944c8fa0b130d54a0e42ea` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:37.137785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e1b90fc1944c8fa0b130d54a0e42ea)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:37.139769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:37.188653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e1b90fc1944c8fa0b130d54a0e42ea', 'request_id': 'req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.194925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e1b90fc1944c8fa0b130d54a0e42ea', 'request_id': 'req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.203302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e1b90fc1944c8fa0b130d54a0e42ea', 'request_id': 'req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.213673 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] The token cache is being invalidate because project 83e1b90fc1944c8fa0b130d54a0e42ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:49:37.214122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.214892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.216693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1143/2273] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:49:37 2022] DELETE /identity/v3/projects/83e1b90fc1944c8fa0b130d54a0e42ea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:37.220520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87895-a958-4b86-810b-e19553096f85 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:37.231567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87895-a958-4b86-810b-e19553096f85 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:37.289180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c34801-fbc0-4998-9cce-313beeb75c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:37.290088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c34801-fbc0-4998-9cce-313beeb75c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:37.290529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c34801-fbc0-4998-9cce-313beeb75c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:37.290808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c34801-fbc0-4998-9cce-313beeb75c9e admin admin] PATH_INFO: `/v3/users/d95070bfab02469e94d9f8fcf6dfe8f3` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:37.292605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c34801-fbc0-4998-9cce-313beeb75c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95070bfab02469e94d9f8fcf6dfe8f3)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:37.294578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c34801-fbc0-4998-9cce-313beeb75c9e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:37.349072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-57c34801-fbc0-4998-9cce-313beeb75c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95070bfab02469e94d9f8fcf6dfe8f3'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.362102 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-57c34801-fbc0-4998-9cce-313beeb75c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95070bfab02469e94d9f8fcf6dfe8f3'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.363159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-57c34801-fbc0-4998-9cce-313beeb75c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95070bfab02469e94d9f8fcf6dfe8f3'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.368153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-57c34801-fbc0-4998-9cce-313beeb75c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95070bfab02469e94d9f8fcf6dfe8f3'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.375680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-57c34801-fbc0-4998-9cce-313beeb75c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95070bfab02469e94d9f8fcf6dfe8f3'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.388621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1131/2274] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:49:37 2022] DELETE /identity/v3/users/d95070bfab02469e94d9f8fcf6dfe8f3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:49:37.646221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:37.647672 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:37.660809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9527c7-4fa5-45dd-b07f-60d1c6f5e240 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:37.717764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:37.718774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:37.719062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:37.719343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] PATH_INFO: `/v3/projects/850d13d9b8da4ea0936fad7b1a1061e0` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:37.720533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=850d13d9b8da4ea0936fad7b1a1061e0)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:37.722499 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:37.768175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850d13d9b8da4ea0936fad7b1a1061e0', 'request_id': 'req-87e1925c-8ddc-4bfd-9b61-e75e394be34a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.774423 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850d13d9b8da4ea0936fad7b1a1061e0', 'request_id': 'req-87e1925c-8ddc-4bfd-9b61-e75e394be34a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.782838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850d13d9b8da4ea0936fad7b1a1061e0', 'request_id': 'req-87e1925c-8ddc-4bfd-9b61-e75e394be34a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.793817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] The token cache is being invalidate because project 850d13d9b8da4ea0936fad7b1a1061e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:49:37.794091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.794751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-87e1925c-8ddc-4bfd-9b61-e75e394be34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:37.796272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1144/2275] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:49:37 2022] DELETE /identity/v3/projects/850d13d9b8da4ea0936fad7b1a1061e0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:37.801026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb5bb0-2b83-4eee-b4cf-d9a862cc3ef3 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:37.801501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb5bb0-2b83-4eee-b4cf-d9a862cc3ef3 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:37.801598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb5bb0-2b83-4eee-b4cf-d9a862cc3ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:37.819397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-4ddb5bb0-2b83-4eee-b4cf-d9a862cc3ef3 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:37.820579 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4ddb5bb0-2b83-4eee-b4cf-d9a862cc3ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:37.880289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1132/2276] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:37.888427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf23b5f-8812-4eee-8a3b-e7fe3a56bba2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:37.888742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf23b5f-8812-4eee-8a3b-e7fe3a56bba2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:37.889033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf23b5f-8812-4eee-8a3b-e7fe3a56bba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:37.908259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-cdf23b5f-8812-4eee-8a3b-e7fe3a56bba2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:37.909472 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-cdf23b5f-8812-4eee-8a3b-e7fe3a56bba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:37.921577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1145/2277] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:49:37.923174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb5bb0-2b83-4eee-b4cf-d9a862cc3ef3 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:37.933982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb5bb0-2b83-4eee-b4cf-d9a862cc3ef3 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:37.938918 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f02dd0-2793-4020-83ce-ad437137322a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:37.939589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02dd0-2793-4020-83ce-ad437137322a admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:37.939897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02dd0-2793-4020-83ce-ad437137322a admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:37.940172 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02dd0-2793-4020-83ce-ad437137322a admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:37.941311 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f02dd0-2793-4020-83ce-ad437137322a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:49:37.941620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f02dd0-2793-4020-83ce-ad437137322a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:37.943297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f02dd0-2793-4020-83ce-ad437137322a admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:37.955567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1133/2278] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:49:37.960027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf23b5f-8812-4eee-8a3b-e7fe3a56bba2 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:37.969855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf23b5f-8812-4eee-8a3b-e7fe3a56bba2 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:37.975145 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aec7e0-7c20-41de-9ae2-5c1e8598d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:37.975797 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aec7e0-7c20-41de-9ae2-5c1e8598d589 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:37.976078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aec7e0-7c20-41de-9ae2-5c1e8598d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:37.976491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aec7e0-7c20-41de-9ae2-5c1e8598d589 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:37.977308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aec7e0-7c20-41de-9ae2-5c1e8598d589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:37.979317 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aec7e0-7c20-41de-9ae2-5c1e8598d589 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:38.009560 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1146/2279] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:49:37 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:49:38.013897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f02dd0-2793-4020-83ce-ad437137322a admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:38.024187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f02dd0-2793-4020-83ce-ad437137322a admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:38.093542 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66bec6-a07b-41e6-8eae-217dbb4ef530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:38.094150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66bec6-a07b-41e6-8eae-217dbb4ef530 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:38.094483 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66bec6-a07b-41e6-8eae-217dbb4ef530 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:38.094766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66bec6-a07b-41e6-8eae-217dbb4ef530 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:38.095478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66bec6-a07b-41e6-8eae-217dbb4ef530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:38.097520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66bec6-a07b-41e6-8eae-217dbb4ef530 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:38.118968 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1134/2280] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:49:38 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:49:38.123344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aec7e0-7c20-41de-9ae2-5c1e8598d589 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:38.139487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aec7e0-7c20-41de-9ae2-5c1e8598d589 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:38.144313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3928feb-4fc1-40d7-8feb-62973f22a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:38.145058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3928feb-4fc1-40d7-8feb-62973f22a3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:38.145414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3928feb-4fc1-40d7-8feb-62973f22a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:38.145761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3928feb-4fc1-40d7-8feb-62973f22a3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:38.146633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3928feb-4fc1-40d7-8feb-62973f22a3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:38.148368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3928feb-4fc1-40d7-8feb-62973f22a3b0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:38.160005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1147/2281] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:49:38.164501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66bec6-a07b-41e6-8eae-217dbb4ef530 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:38.176009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66bec6-a07b-41e6-8eae-217dbb4ef530 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:38.181045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb147a8-132a-45f1-ae50-30111a2ad79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:38.181709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb147a8-132a-45f1-ae50-30111a2ad79f admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:38.182537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb147a8-132a-45f1-ae50-30111a2ad79f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:38.182816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb147a8-132a-45f1-ae50-30111a2ad79f admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:38.183820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb147a8-132a-45f1-ae50-30111a2ad79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:38.185428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb147a8-132a-45f1-ae50-30111a2ad79f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:38.196538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1135/2282] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:49:38.201212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3928feb-4fc1-40d7-8feb-62973f22a3b0 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:38.212954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3928feb-4fc1-40d7-8feb-62973f22a3b0 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:38.218074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2254c-8694-4d86-8ebe-0313b23cc6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:38.219144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2254c-8694-4d86-8ebe-0313b23cc6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:38.219531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2254c-8694-4d86-8ebe-0313b23cc6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:38.219914 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2254c-8694-4d86-8ebe-0313b23cc6b2 admin admin] PATH_INFO: `/v3/projects/b51d996b9ed14ea88c75127592d833f2/users/47288be7f25648a89fb27862ae343026/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:38.236505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2254c-8694-4d86-8ebe-0313b23cc6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51d996b9ed14ea88c75127592d833f2, user_id=47288be7f25648a89fb27862ae343026, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:38.239611 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2254c-8694-4d86-8ebe-0313b23cc6b2 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:38.255409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1148/2283] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:49:38 2022] PUT /identity/v3/projects/b51d996b9ed14ea88c75127592d833f2/users/47288be7f25648a89fb27862ae343026/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:49:38.267098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca7617-e640-409f-a402-af78d4daf9b7 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:38.267650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca7617-e640-409f-a402-af78d4daf9b7 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:38.269188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca7617-e640-409f-a402-af78d4daf9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:38.301703 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a1ca7617-e640-409f-a402-af78d4daf9b7 None None] MFA Rules not processed for user `47288be7f25648a89fb27862ae343026`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:38.303112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a1ca7617-e640-409f-a402-af78d4daf9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:38.429709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1136/2284] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:38.440804 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2254c-8694-4d86-8ebe-0313b23cc6b2 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:38.442703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-daf2254c-8694-4d86-8ebe-0313b23cc6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:38.529087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2254c-8694-4d86-8ebe-0313b23cc6b2 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:38.533771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dad91-74bd-49bf-b7da-12d5c0335b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:38.534470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dad91-74bd-49bf-b7da-12d5c0335b59 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:38.534760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dad91-74bd-49bf-b7da-12d5c0335b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:38.535041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dad91-74bd-49bf-b7da-12d5c0335b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:38.546812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dad91-74bd-49bf-b7da-12d5c0335b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:38.549420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dad91-74bd-49bf-b7da-12d5c0335b59 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:38.564246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1149/2285] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:41.621065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca7617-e640-409f-a402-af78d4daf9b7 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:41.683838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca7617-e640-409f-a402-af78d4daf9b7 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:41.688164 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:41.689037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:41.689312 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:41.689579 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] PATH_INFO: `/v3/users/47288be7f25648a89fb27862ae343026` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:41.690779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47288be7f25648a89fb27862ae343026)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:41.692692 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:41.740558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47288be7f25648a89fb27862ae343026'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:41.752872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47288be7f25648a89fb27862ae343026'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:41.753564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47288be7f25648a89fb27862ae343026'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:41.754173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47288be7f25648a89fb27862ae343026'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:41.761120 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47288be7f25648a89fb27862ae343026'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:41.774132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1137/2286] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:49:41 2022] DELETE /identity/v3/users/47288be7f25648a89fb27862ae343026 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:41.779981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698d51b-e75c-4efa-9234-57bde272a43b None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:41.780580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698d51b-e75c-4efa-9234-57bde272a43b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:41.780894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698d51b-e75c-4efa-9234-57bde272a43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:41.797393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b698d51b-e75c-4efa-9234-57bde272a43b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:41.798746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b698d51b-e75c-4efa-9234-57bde272a43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:41.862678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1150/2287] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:41.872495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:41.873926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:41.930291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa6684-012d-4fd6-bca8-2c31799eaa94 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:41.934910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cebc6-3014-4644-a3e6-b5f8afaf9e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:41.935514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cebc6-3014-4644-a3e6-b5f8afaf9e3b service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:41.935798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cebc6-3014-4644-a3e6-b5f8afaf9e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:41.936074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cebc6-3014-4644-a3e6-b5f8afaf9e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:41.945058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cebc6-3014-4644-a3e6-b5f8afaf9e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:41.946522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cebc6-3014-4644-a3e6-b5f8afaf9e3b service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:41.956699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1138/2288] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:42.220804 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698d51b-e75c-4efa-9234-57bde272a43b None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:42.222248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b698d51b-e75c-4efa-9234-57bde272a43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:42.235610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698d51b-e75c-4efa-9234-57bde272a43b None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:42.240524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:42.241393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:42.241678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:42.241950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] PATH_INFO: `/v3/projects/b51d996b9ed14ea88c75127592d833f2` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:42.243193 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51d996b9ed14ea88c75127592d833f2)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:42.245686 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:42.292496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51d996b9ed14ea88c75127592d833f2', 'request_id': 'req-aa7bf708-c718-4351-9f00-8cdd5345fac9'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:42.298480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51d996b9ed14ea88c75127592d833f2', 'request_id': 'req-aa7bf708-c718-4351-9f00-8cdd5345fac9'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:42.305613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51d996b9ed14ea88c75127592d833f2', 'request_id': 'req-aa7bf708-c718-4351-9f00-8cdd5345fac9'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:42.315672 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] The token cache is being invalidate because project b51d996b9ed14ea88c75127592d833f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:49:42.315962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:42.316628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aa7bf708-c718-4351-9f00-8cdd5345fac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:42.318152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1151/2289] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:49:42 2022] DELETE /identity/v3/projects/b51d996b9ed14ea88c75127592d833f2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:42.324357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba826c-9085-434c-930c-8f6470b63d15 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:42.324825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba826c-9085-434c-930c-8f6470b63d15 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:42.325141 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba826c-9085-434c-930c-8f6470b63d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:42.343295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-f8ba826c-9085-434c-930c-8f6470b63d15 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:42.344483 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f8ba826c-9085-434c-930c-8f6470b63d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:42.407308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1139/2290] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:42.410080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ae8dc-3336-44d7-af24-42e06c2c39ad None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:42.410402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ae8dc-3336-44d7-af24-42e06c2c39ad None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:42.410685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ae8dc-3336-44d7-af24-42e06c2c39ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:42.429396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-847ae8dc-3336-44d7-af24-42e06c2c39ad None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:42.430621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-847ae8dc-3336-44d7-af24-42e06c2c39ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:42.439652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1152/2291] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:42.443667 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba826c-9085-434c-930c-8f6470b63d15 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:42.454045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba826c-9085-434c-930c-8f6470b63d15 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:42.458641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f711c0-0798-49c2-9e13-14dd5005e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:42.459409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f711c0-0798-49c2-9e13-14dd5005e047 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:42.459741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f711c0-0798-49c2-9e13-14dd5005e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:42.460034 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f711c0-0798-49c2-9e13-14dd5005e047 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:42.460945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f711c0-0798-49c2-9e13-14dd5005e047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:49:42.461247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f711c0-0798-49c2-9e13-14dd5005e047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:42.462859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f711c0-0798-49c2-9e13-14dd5005e047 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:42.474813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1140/2292] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:49:42.479176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ae8dc-3336-44d7-af24-42e06c2c39ad None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:42.488765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ae8dc-3336-44d7-af24-42e06c2c39ad None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:42.493538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4b937-3ce3-4e9b-b929-3e56a1a34bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:42.494227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4b937-3ce3-4e9b-b929-3e56a1a34bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:42.495438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4b937-3ce3-4e9b-b929-3e56a1a34bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:42.495438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4b937-3ce3-4e9b-b929-3e56a1a34bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:42.495980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4b937-3ce3-4e9b-b929-3e56a1a34bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:42.497889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4b937-3ce3-4e9b-b929-3e56a1a34bb9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:42.524147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1153/2293] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:49:42 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:49:42.528318 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f711c0-0798-49c2-9e13-14dd5005e047 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:42.539618 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f711c0-0798-49c2-9e13-14dd5005e047 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:42.603256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79e75f-89a4-4534-96ed-cc11d23e63d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:42.604634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79e75f-89a4-4534-96ed-cc11d23e63d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:42.604929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79e75f-89a4-4534-96ed-cc11d23e63d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:42.605211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79e75f-89a4-4534-96ed-cc11d23e63d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:42.605913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79e75f-89a4-4534-96ed-cc11d23e63d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:42.607914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79e75f-89a4-4534-96ed-cc11d23e63d1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:42.643688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1141/2294] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:49:42 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:49:42.644165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4b937-3ce3-4e9b-b929-3e56a1a34bb9 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:42.658118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4b937-3ce3-4e9b-b929-3e56a1a34bb9 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:42.663460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0704e73-21f8-49fc-be35-d54d50b926dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:42.664258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704e73-21f8-49fc-be35-d54d50b926dd admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:42.664761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704e73-21f8-49fc-be35-d54d50b926dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:42.665108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0704e73-21f8-49fc-be35-d54d50b926dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:42.665938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0704e73-21f8-49fc-be35-d54d50b926dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:42.668063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0704e73-21f8-49fc-be35-d54d50b926dd admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:42.688343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1154/2295] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:49:42.689308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79e75f-89a4-4534-96ed-cc11d23e63d1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:42.700064 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79e75f-89a4-4534-96ed-cc11d23e63d1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:42.704782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e37b89-6502-4749-b02f-f198a6375ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:42.705422 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e37b89-6502-4749-b02f-f198a6375ffb admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:42.705708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e37b89-6502-4749-b02f-f198a6375ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:42.706013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e37b89-6502-4749-b02f-f198a6375ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:42.706778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e37b89-6502-4749-b02f-f198a6375ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:42.708382 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e37b89-6502-4749-b02f-f198a6375ffb admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:42.718563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1142/2296] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:49:42.722726 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0704e73-21f8-49fc-be35-d54d50b926dd admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:42.733297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0704e73-21f8-49fc-be35-d54d50b926dd admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:42.738585 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b42a91-6b9b-4c22-aa2b-0a0323906aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:42.739469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b42a91-6b9b-4c22-aa2b-0a0323906aac admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:42.739751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b42a91-6b9b-4c22-aa2b-0a0323906aac admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:42.740025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b42a91-6b9b-4c22-aa2b-0a0323906aac admin admin] PATH_INFO: `/v3/projects/bb6cbdbd05e44aa4b5a6c3f07abd7ce8/users/d9fb04d1f80a48b499f305181032de1f/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:42.758474 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b42a91-6b9b-4c22-aa2b-0a0323906aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6cbdbd05e44aa4b5a6c3f07abd7ce8, user_id=d9fb04d1f80a48b499f305181032de1f, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:42.761841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b42a91-6b9b-4c22-aa2b-0a0323906aac admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:42.775056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1155/2297] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:49:42 2022] PUT /identity/v3/projects/bb6cbdbd05e44aa4b5a6c3f07abd7ce8/users/d9fb04d1f80a48b499f305181032de1f/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:42.785772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c936b8-b4e6-49a1-8f8e-be463ff2b3b9 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:42.786047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c936b8-b4e6-49a1-8f8e-be463ff2b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:42.786346 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c936b8-b4e6-49a1-8f8e-be463ff2b3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:42.814253 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b4c936b8-b4e6-49a1-8f8e-be463ff2b3b9 None None] MFA Rules not processed for user `d9fb04d1f80a48b499f305181032de1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:42.815533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b4c936b8-b4e6-49a1-8f8e-be463ff2b3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:42.878683 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1143/2298] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:42.889748 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b42a91-6b9b-4c22-aa2b-0a0323906aac admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:42.891673 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f4b42a91-6b9b-4c22-aa2b-0a0323906aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:42.948353 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b42a91-6b9b-4c22-aa2b-0a0323906aac admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:42.952043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658a337-7442-4316-8784-29a22b7e0428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:42.952688 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a337-7442-4316-8784-29a22b7e0428 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:42.952973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a337-7442-4316-8784-29a22b7e0428 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:42.953257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a337-7442-4316-8784-29a22b7e0428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:42.961740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658a337-7442-4316-8784-29a22b7e0428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:42.963433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658a337-7442-4316-8784-29a22b7e0428 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:42.972597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1156/2299] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:46.067186 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3847-2ccb-4c35-86a9-d56de3c3b206 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:46.067675 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3847-2ccb-4c35-86a9-d56de3c3b206 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:46.067769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b3847-2ccb-4c35-86a9-d56de3c3b206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:46.130934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c73b3847-2ccb-4c35-86a9-d56de3c3b206 None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:46.132145 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c73b3847-2ccb-4c35-86a9-d56de3c3b206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:46.179195 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658a337-7442-4316-8784-29a22b7e0428 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:46.180760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a658a337-7442-4316-8784-29a22b7e0428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:46.247497 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1144/2300] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:46.269006 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b3847-2ccb-4c35-86a9-d56de3c3b206 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:46.271305 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c73b3847-2ccb-4c35-86a9-d56de3c3b206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:46.281953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658a337-7442-4316-8784-29a22b7e0428 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:46.287902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2995d62-a6be-4e99-84a5-687c4ad3d46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:46.289457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995d62-a6be-4e99-84a5-687c4ad3d46c service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:46.290210 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995d62-a6be-4e99-84a5-687c4ad3d46c service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:46.290677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2995d62-a6be-4e99-84a5-687c4ad3d46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:46.293369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a2995d62-a6be-4e99-84a5-687c4ad3d46c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:46.361690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2995d62-a6be-4e99-84a5-687c4ad3d46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:46.363436 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2995d62-a6be-4e99-84a5-687c4ad3d46c service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:46.373179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1157/2301] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:46.395491 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b3847-2ccb-4c35-86a9-d56de3c3b206 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:46.403136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7ab37-7251-4931-9e75-4d4a72b21228 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:46.403913 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7ab37-7251-4931-9e75-4d4a72b21228 service swift] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:46.404295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7ab37-7251-4931-9e75-4d4a72b21228 service swift] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:46.404645 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7ab37-7251-4931-9e75-4d4a72b21228 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:46.415241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7ab37-7251-4931-9e75-4d4a72b21228 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:46.417620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7ab37-7251-4931-9e75-4d4a72b21228 service swift] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:46.426270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1145/2302] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:49:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:49:46.955787 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e02df-a5fb-4cd2-90ca-c53769404e7f None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:46.956066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e02df-a5fb-4cd2-90ca-c53769404e7f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:46.956524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e02df-a5fb-4cd2-90ca-c53769404e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:46.976043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d83e02df-a5fb-4cd2-90ca-c53769404e7f None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:46.977525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d83e02df-a5fb-4cd2-90ca-c53769404e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:46.986022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1158/2303] 10.222.0.61 () {58 vars in 967 bytes} [Sat May 14 15:49:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:47.002269 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7ab37-7251-4931-9e75-4d4a72b21228 service swift] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:47.014078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7ab37-7251-4931-9e75-4d4a72b21228 service swift] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:47.019687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a4b3-1ac3-414b-9f1c-e9bb440c7f4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:47.020450 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a4b3-1ac3-414b-9f1c-e9bb440c7f4a service swift] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:47.020734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a4b3-1ac3-414b-9f1c-e9bb440c7f4a service swift] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:47.021009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a4b3-1ac3-414b-9f1c-e9bb440c7f4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:47.030206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45a4b3-1ac3-414b-9f1c-e9bb440c7f4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:47.031800 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45a4b3-1ac3-414b-9f1c-e9bb440c7f4a service swift] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:47.040980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1146/2304] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:49:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:49:47.295046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67bfb9-6999-4f0e-97e2-6f4b6777caad None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:47.295609 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67bfb9-6999-4f0e-97e2-6f4b6777caad None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:47.295717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67bfb9-6999-4f0e-97e2-6f4b6777caad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:47.315451 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-6f67bfb9-6999-4f0e-97e2-6f4b6777caad None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:47.316569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6f67bfb9-6999-4f0e-97e2-6f4b6777caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:47.325122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1159/2305] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:49:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:47.339490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a4b3-1ac3-414b-9f1c-e9bb440c7f4a service swift] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:47.350540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a4b3-1ac3-414b-9f1c-e9bb440c7f4a service swift] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:47.356490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3f5df-4c24-4f19-8740-360cd8eaafff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:47.357370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f5df-4c24-4f19-8740-360cd8eaafff service swift] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:47.357835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f5df-4c24-4f19-8740-360cd8eaafff service swift] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:47.358291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3f5df-4c24-4f19-8740-360cd8eaafff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:47.368314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3f5df-4c24-4f19-8740-360cd8eaafff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:47.370535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3f5df-4c24-4f19-8740-360cd8eaafff service swift] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:47.379533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1147/2306] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:49:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:49:47.490051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518700-2843-4e08-a85b-c0a186da2d97 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:47.490348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518700-2843-4e08-a85b-c0a186da2d97 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:47.490856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518700-2843-4e08-a85b-c0a186da2d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:47.511755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-58518700-2843-4e08-a85b-c0a186da2d97 None None] MFA Rules not processed for user `e0156ed87a5b4efca7ef5056429db1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:47.513024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-58518700-2843-4e08-a85b-c0a186da2d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:47.595236 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1160/2307] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:47.788274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff2c44-aead-479c-84bd-30da01809cf8 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:47.788568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff2c44-aead-479c-84bd-30da01809cf8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:47.788846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff2c44-aead-479c-84bd-30da01809cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:47.808928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c7ff2c44-aead-479c-84bd-30da01809cf8 None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:47.810129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c7ff2c44-aead-479c-84bd-30da01809cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:47.822855 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1148/2308] 10.222.0.61 () {58 vars in 967 bytes} [Sat May 14 15:49:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:47.849116 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58518700-2843-4e08-a85b-c0a186da2d97 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:47.863845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58518700-2843-4e08-a85b-c0a186da2d97 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:47.872269 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4587a37-9e43-4391-bdb8-008972d6b64f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:47.873194 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587a37-9e43-4391-bdb8-008972d6b64f service swift] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:47.873702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587a37-9e43-4391-bdb8-008972d6b64f service swift] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:47.874219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4587a37-9e43-4391-bdb8-008972d6b64f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:47.886632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4587a37-9e43-4391-bdb8-008972d6b64f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:47.889971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4587a37-9e43-4391-bdb8-008972d6b64f service swift] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:47.903778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1161/2309] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:49:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:49:50.433334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff2c44-aead-479c-84bd-30da01809cf8 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:50.434768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c7ff2c44-aead-479c-84bd-30da01809cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:50.501828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ff2c44-aead-479c-84bd-30da01809cf8 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:50.506459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:50.507323 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:50.507600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:50.507867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] PATH_INFO: `/v3/users/1e8303a1f1584ae2aae774eaf31481f0` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:50.509089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8303a1f1584ae2aae774eaf31481f0)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:50.511196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:50.562712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8303a1f1584ae2aae774eaf31481f0'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:50.580083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8303a1f1584ae2aae774eaf31481f0'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:50.580931 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8303a1f1584ae2aae774eaf31481f0'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:50.581745 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8303a1f1584ae2aae774eaf31481f0'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:50.588833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8303a1f1584ae2aae774eaf31481f0'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:50.601454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1149/2310] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:49:50 2022] DELETE /identity/v3/users/1e8303a1f1584ae2aae774eaf31481f0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:50.606474 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eadd6-321f-48c8-8489-772568fc08d1 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:50.606992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eadd6-321f-48c8-8489-772568fc08d1 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:50.607260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eadd6-321f-48c8-8489-772568fc08d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:50.626013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4d7eadd6-321f-48c8-8489-772568fc08d1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:50.627347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4d7eadd6-321f-48c8-8489-772568fc08d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:50.693337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1162/2311] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:50.703809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:50.705308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:50.776308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a40e20-d239-4c71-ab54-d3e6ae558c1b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:50.780408 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fedf8-c997-402f-a1e8-fa0df9539335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:50.781126 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fedf8-c997-402f-a1e8-fa0df9539335 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:50.781488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fedf8-c997-402f-a1e8-fa0df9539335 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:50.781833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fedf8-c997-402f-a1e8-fa0df9539335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:50.793183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fedf8-c997-402f-a1e8-fa0df9539335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:50.795138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fedf8-c997-402f-a1e8-fa0df9539335 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:50.806980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1150/2312] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:51.011699 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eadd6-321f-48c8-8489-772568fc08d1 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:51.013140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4d7eadd6-321f-48c8-8489-772568fc08d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:51.036520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eadd6-321f-48c8-8489-772568fc08d1 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:51.042609 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:51.043592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:51.044091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:51.044424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] PATH_INFO: `/v3/projects/c1e7c6697dfc4562b4c1d46ee21964a5` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:51.045677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e7c6697dfc4562b4c1d46ee21964a5)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:51.047716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:51.096410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'request_id': 'req-2566d31e-17d1-4a28-9f04-703a6cc23df2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:51.102627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'request_id': 'req-2566d31e-17d1-4a28-9f04-703a6cc23df2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:51.110294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e7c6697dfc4562b4c1d46ee21964a5', 'request_id': 'req-2566d31e-17d1-4a28-9f04-703a6cc23df2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:51.122031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] The token cache is being invalidate because project c1e7c6697dfc4562b4c1d46ee21964a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:49:51.122440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:51.123138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-2566d31e-17d1-4a28-9f04-703a6cc23df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:49:51.124899 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1163/2313] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:49:51 2022] DELETE /identity/v3/projects/c1e7c6697dfc4562b4c1d46ee21964a5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:51.129734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b07291-25a5-4a76-bca4-7d36c92dec0b None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:51.130018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b07291-25a5-4a76-bca4-7d36c92dec0b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:51.130298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b07291-25a5-4a76-bca4-7d36c92dec0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:51.147908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-08b07291-25a5-4a76-bca4-7d36c92dec0b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:51.149663 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-08b07291-25a5-4a76-bca4-7d36c92dec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:51.215608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1151/2314] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:51.224367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1d8b-8957-4655-ba19-d1cca3f287f6 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:51.225269 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1d8b-8957-4655-ba19-d1cca3f287f6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:51.225784 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1d8b-8957-4655-ba19-d1cca3f287f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:51.251688 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-945e1d8b-8957-4655-ba19-d1cca3f287f6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:51.254937 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-945e1d8b-8957-4655-ba19-d1cca3f287f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:51.277938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1164/2315] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:51.279194 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b07291-25a5-4a76-bca4-7d36c92dec0b None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:51.291562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b07291-25a5-4a76-bca4-7d36c92dec0b None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:51.298899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead806e2-76aa-480e-830b-871fbd4397a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:51.299832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead806e2-76aa-480e-830b-871fbd4397a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:51.300311 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead806e2-76aa-480e-830b-871fbd4397a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:51.300583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead806e2-76aa-480e-830b-871fbd4397a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:51.301325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead806e2-76aa-480e-830b-871fbd4397a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:49:51.301628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead806e2-76aa-480e-830b-871fbd4397a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:51.303316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead806e2-76aa-480e-830b-871fbd4397a1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:51.326759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1152/2316] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:49:51.331261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e1d8b-8957-4655-ba19-d1cca3f287f6 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:51.345886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e1d8b-8957-4655-ba19-d1cca3f287f6 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:51.359890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6337a-d70d-4733-84be-0e9d4130e6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:51.361991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6337a-d70d-4733-84be-0e9d4130e6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:51.362481 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6337a-d70d-4733-84be-0e9d4130e6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:51.363114 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6337a-d70d-4733-84be-0e9d4130e6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:51.363913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6337a-d70d-4733-84be-0e9d4130e6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:51.366678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6337a-d70d-4733-84be-0e9d4130e6f5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:51.404003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1165/2317] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:49:51 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:49:51.405229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead806e2-76aa-480e-830b-871fbd4397a1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:51.416887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead806e2-76aa-480e-830b-871fbd4397a1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:51.481848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cea637-e3f4-46b6-8a83-9b4578738d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:51.482571 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cea637-e3f4-46b6-8a83-9b4578738d36 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:51.483044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cea637-e3f4-46b6-8a83-9b4578738d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:51.483374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cea637-e3f4-46b6-8a83-9b4578738d36 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:51.484327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cea637-e3f4-46b6-8a83-9b4578738d36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:51.486593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cea637-e3f4-46b6-8a83-9b4578738d36 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:51.511331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1153/2318] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:49:51 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:49:51.515220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6337a-d70d-4733-84be-0e9d4130e6f5 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:51.526973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6337a-d70d-4733-84be-0e9d4130e6f5 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:51.532447 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b2eff-0c55-4ae4-a631-a591a96038f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:51.533297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b2eff-0c55-4ae4-a631-a591a96038f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:51.536830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b2eff-0c55-4ae4-a631-a591a96038f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:51.536830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b2eff-0c55-4ae4-a631-a591a96038f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:51.536830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b2eff-0c55-4ae4-a631-a591a96038f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:51.536830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b2eff-0c55-4ae4-a631-a591a96038f8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:51.548108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1166/2319] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:49:51.552052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cea637-e3f4-46b6-8a83-9b4578738d36 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:51.563749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cea637-e3f4-46b6-8a83-9b4578738d36 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:51.571244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd107b7-dd72-4a77-ac0e-b481097d7c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:51.572004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd107b7-dd72-4a77-ac0e-b481097d7c88 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:51.572475 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd107b7-dd72-4a77-ac0e-b481097d7c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:51.572878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd107b7-dd72-4a77-ac0e-b481097d7c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:51.573755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd107b7-dd72-4a77-ac0e-b481097d7c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:51.576580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd107b7-dd72-4a77-ac0e-b481097d7c88 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:51.587379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1154/2320] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:49:51.592084 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b2eff-0c55-4ae4-a631-a591a96038f8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:51.604094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b2eff-0c55-4ae4-a631-a591a96038f8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:51.609600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ebfc5-84cb-4b17-a086-ba0760b70e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:51.611313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ebfc5-84cb-4b17-a086-ba0760b70e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:51.611764 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ebfc5-84cb-4b17-a086-ba0760b70e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:51.612046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ebfc5-84cb-4b17-a086-ba0760b70e06 admin admin] PATH_INFO: `/v3/projects/7a3a2b5dee7a404a8445c8aa434b5a43/users/568f6783dd4d43398a70a9ffa58ff660/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:51.628178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ebfc5-84cb-4b17-a086-ba0760b70e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3a2b5dee7a404a8445c8aa434b5a43, user_id=568f6783dd4d43398a70a9ffa58ff660, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:51.631078 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ebfc5-84cb-4b17-a086-ba0760b70e06 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:51.646070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1167/2321] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:49:51 2022] PUT /identity/v3/projects/7a3a2b5dee7a404a8445c8aa434b5a43/users/568f6783dd4d43398a70a9ffa58ff660/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:49:51.651836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266c14-79cd-4b10-a292-02d5fb2373a2 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:51.652740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266c14-79cd-4b10-a292-02d5fb2373a2 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:51.653213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0266c14-79cd-4b10-a292-02d5fb2373a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:51.674348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e0266c14-79cd-4b10-a292-02d5fb2373a2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:51.676461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e0266c14-79cd-4b10-a292-02d5fb2373a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:51.782539 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1155/2322] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:51.794979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ebfc5-84cb-4b17-a086-ba0760b70e06 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:51.796756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a50ebfc5-84cb-4b17-a086-ba0760b70e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:51.862051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ebfc5-84cb-4b17-a086-ba0760b70e06 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:51.866142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea64c6f-c8ac-4b72-a57b-f53c258810e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:51.866926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea64c6f-c8ac-4b72-a57b-f53c258810e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:51.867286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea64c6f-c8ac-4b72-a57b-f53c258810e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:51.867633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea64c6f-c8ac-4b72-a57b-f53c258810e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:51.877676 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea64c6f-c8ac-4b72-a57b-f53c258810e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:51.879512 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea64c6f-c8ac-4b72-a57b-f53c258810e0 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:51.890453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1168/2323] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:49:57.892041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eebeb-6d9c-49e1-be76-feaa982cbacb None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:57.892530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eebeb-6d9c-49e1-be76-feaa982cbacb None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:57.892725 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eebeb-6d9c-49e1-be76-feaa982cbacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:57.919900 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a02eebeb-6d9c-49e1-be76-feaa982cbacb None None] MFA Rules not processed for user `568f6783dd4d43398a70a9ffa58ff660`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:49:57.921341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a02eebeb-6d9c-49e1-be76-feaa982cbacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:49:57.985311 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1156/2324] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:49:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:49:57.990049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea64c6f-c8ac-4b72-a57b-f53c258810e0 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:58.000334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea64c6f-c8ac-4b72-a57b-f53c258810e0 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:58.005057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d235719-6040-42f3-a89d-a0c9d759bd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:58.005779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d235719-6040-42f3-a89d-a0c9d759bd30 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:58.006129 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d235719-6040-42f3-a89d-a0c9d759bd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:58.006518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d235719-6040-42f3-a89d-a0c9d759bd30 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:58.007283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d235719-6040-42f3-a89d-a0c9d759bd30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:58.009420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d235719-6040-42f3-a89d-a0c9d759bd30 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:58.036008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1169/2325] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:49:57 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:49:58.040140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02eebeb-6d9c-49e1-be76-feaa982cbacb None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:58.054446 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02eebeb-6d9c-49e1-be76-feaa982cbacb None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:58.116503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ce04-03b9-4e75-b545-5b4ad90ffb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:58.117196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ce04-03b9-4e75-b545-5b4ad90ffb16 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:58.117463 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ce04-03b9-4e75-b545-5b4ad90ffb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:58.117783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ce04-03b9-4e75-b545-5b4ad90ffb16 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:58.118506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5ce04-03b9-4e75-b545-5b4ad90ffb16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:58.121157 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5ce04-03b9-4e75-b545-5b4ad90ffb16 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:58.142089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1157/2326] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:49:58 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:49:58.146107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d235719-6040-42f3-a89d-a0c9d759bd30 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:58.156990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d235719-6040-42f3-a89d-a0c9d759bd30 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:58.161675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717324a-9361-4628-b31b-fea05e837f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:58.162365 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717324a-9361-4628-b31b-fea05e837f64 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:58.162819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717324a-9361-4628-b31b-fea05e837f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:58.163253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717324a-9361-4628-b31b-fea05e837f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:58.164036 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717324a-9361-4628-b31b-fea05e837f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:58.166366 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717324a-9361-4628-b31b-fea05e837f64 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:58.177085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1170/2327] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:49:58.181347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ce04-03b9-4e75-b545-5b4ad90ffb16 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:58.192557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ce04-03b9-4e75-b545-5b4ad90ffb16 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:58.197335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a90e7-dbe4-4fce-8f3c-c597c6d3c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:58.198230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a90e7-dbe4-4fce-8f3c-c597c6d3c600 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:58.198545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a90e7-dbe4-4fce-8f3c-c597c6d3c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:58.198821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a90e7-dbe4-4fce-8f3c-c597c6d3c600 admin admin] PATH_INFO: `/v3/projects/f418dee8090d4399b5f8e4bd45886f0d/users/20f8b8e0614746bb89f3837d8cd46f24/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:58.213393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a90e7-dbe4-4fce-8f3c-c597c6d3c600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f418dee8090d4399b5f8e4bd45886f0d, user_id=20f8b8e0614746bb89f3837d8cd46f24, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:58.216112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a90e7-dbe4-4fce-8f3c-c597c6d3c600 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:58.229529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1158/2328] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:49:58 2022] PUT /identity/v3/projects/f418dee8090d4399b5f8e4bd45886f0d/users/20f8b8e0614746bb89f3837d8cd46f24/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:49:58.233780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717324a-9361-4628-b31b-fea05e837f64 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:58.245445 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717324a-9361-4628-b31b-fea05e837f64 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:58.303248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdb1b0-94f0-4a7b-aa28-b3b520c9712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:58.303967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdb1b0-94f0-4a7b-aa28-b3b520c9712e admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:58.304190 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdb1b0-94f0-4a7b-aa28-b3b520c9712e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:58.304471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdb1b0-94f0-4a7b-aa28-b3b520c9712e admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:58.305211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdb1b0-94f0-4a7b-aa28-b3b520c9712e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:58.307106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdb1b0-94f0-4a7b-aa28-b3b520c9712e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:58.319879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1171/2329] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:49:58.321151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a90e7-dbe4-4fce-8f3c-c597c6d3c600 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:49:58.331546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a90e7-dbe4-4fce-8f3c-c597c6d3c600 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:49:58.336159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09aa62-0ba3-48c5-909a-c64f2bd0f866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:49:58.337174 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09aa62-0ba3-48c5-909a-c64f2bd0f866 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:49:58.337453 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09aa62-0ba3-48c5-909a-c64f2bd0f866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:49:58.338289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09aa62-0ba3-48c5-909a-c64f2bd0f866 admin admin] PATH_INFO: `/v3/projects/f418dee8090d4399b5f8e4bd45886f0d/users/20f8b8e0614746bb89f3837d8cd46f24/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:49:58.341295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09aa62-0ba3-48c5-909a-c64f2bd0f866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f418dee8090d4399b5f8e4bd45886f0d, user_id=20f8b8e0614746bb89f3837d8cd46f24, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:49:58.343532 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09aa62-0ba3-48c5-909a-c64f2bd0f866 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:49:58.355791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1159/2330] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:49:58 2022] PUT /identity/v3/projects/f418dee8090d4399b5f8e4bd45886f0d/users/20f8b8e0614746bb89f3837d8cd46f24/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:50:03.862156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71231c-5e6f-41f8-8e3b-a8fe4ef37d6a None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:03.863062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71231c-5e6f-41f8-8e3b-a8fe4ef37d6a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:03.863396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71231c-5e6f-41f8-8e3b-a8fe4ef37d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:03.901262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-8f71231c-5e6f-41f8-8e3b-a8fe4ef37d6a None None] MFA Rules not processed for user `20f8b8e0614746bb89f3837d8cd46f24`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:50:03.906077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8f71231c-5e6f-41f8-8e3b-a8fe4ef37d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:04.029271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1172/2331] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:50:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:50:04.044257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09aa62-0ba3-48c5-909a-c64f2bd0f866 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:04.046636 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8c09aa62-0ba3-48c5-909a-c64f2bd0f866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:04.163080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09aa62-0ba3-48c5-909a-c64f2bd0f866 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:04.174282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845a1da-3d74-403d-b66c-b4aa9b46106c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:04.175098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a1da-3d74-403d-b66c-b4aa9b46106c service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:04.175467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a1da-3d74-403d-b66c-b4aa9b46106c service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:04.175914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845a1da-3d74-403d-b66c-b4aa9b46106c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:04.250854 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a1da-3d74-403d-b66c-b4aa9b46106c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:04.252469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845a1da-3d74-403d-b66c-b4aa9b46106c service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:04.261741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1160/2332] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:50:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:50:20.929181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e151e-6c49-4bba-9d48-6696bbe0a3f0 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:20.929756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e151e-6c49-4bba-9d48-6696bbe0a3f0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:20.929756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e151e-6c49-4bba-9d48-6696bbe0a3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:20.948141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-409e151e-6c49-4bba-9d48-6696bbe0a3f0 None None] MFA Rules not processed for user `dc43895177134e9c9c030a9d87f94aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:50:20.950013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-409e151e-6c49-4bba-9d48-6696bbe0a3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:21.001857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1173/2333] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:50:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:50:34.933834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d704f-3169-4978-9ebf-22ede8c423cc None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:34.934411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d704f-3169-4978-9ebf-22ede8c423cc None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:34.934411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d704f-3169-4978-9ebf-22ede8c423cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:34.956189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-9a8d704f-3169-4978-9ebf-22ede8c423cc None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:50:34.957464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9a8d704f-3169-4978-9ebf-22ede8c423cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:35.037012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1161/2334] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:50:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:50:35.053466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e151e-6c49-4bba-9d48-6696bbe0a3f0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:35.055465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-409e151e-6c49-4bba-9d48-6696bbe0a3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:35.139101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e151e-6c49-4bba-9d48-6696bbe0a3f0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:35.144423 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9d7e6-1760-4687-8abc-a2e92e6e97db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:35.145209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d7e6-1760-4687-8abc-a2e92e6e97db service swift] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:35.145553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d7e6-1760-4687-8abc-a2e92e6e97db service swift] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:35.145872 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9d7e6-1760-4687-8abc-a2e92e6e97db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:35.155256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9d7e6-1760-4687-8abc-a2e92e6e97db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:35.156856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9d7e6-1760-4687-8abc-a2e92e6e97db service swift] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:35.164739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1174/2335] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:50:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:50:52.299470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46e6f3-83c0-4ba5-bd5f-4ce2e1d9493f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:52.299994 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46e6f3-83c0-4ba5-bd5f-4ce2e1d9493f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:52.300085 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46e6f3-83c0-4ba5-bd5f-4ce2e1d9493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:52.319233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-5e46e6f3-83c0-4ba5-bd5f-4ce2e1d9493f None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:50:52.320408 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-5e46e6f3-83c0-4ba5-bd5f-4ce2e1d9493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:52.328200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1162/2336] 10.222.0.61 () {58 vars in 967 bytes} [Sat May 14 15:50:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:50:52.340117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9d7e6-1760-4687-8abc-a2e92e6e97db service swift] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:52.350295 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9d7e6-1760-4687-8abc-a2e92e6e97db service swift] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:52.355362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1248107-28d1-4c9b-a021-f6d714e966f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:52.356028 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1248107-28d1-4c9b-a021-f6d714e966f9 service swift] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:52.356289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1248107-28d1-4c9b-a021-f6d714e966f9 service swift] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:52.356564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1248107-28d1-4c9b-a021-f6d714e966f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:52.364990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1248107-28d1-4c9b-a021-f6d714e966f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:52.366577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1248107-28d1-4c9b-a021-f6d714e966f9 service swift] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:52.374959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1175/2337] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:50:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 14 15:50:53.464467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eba2a-262b-46d7-8533-58b7792e6369 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:53.465049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eba2a-262b-46d7-8533-58b7792e6369 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:53.465049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47eba2a-262b-46d7-8533-58b7792e6369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:53.482324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b47eba2a-262b-46d7-8533-58b7792e6369 None None] MFA Rules not processed for user `568f6783dd4d43398a70a9ffa58ff660`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:50:53.483541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b47eba2a-262b-46d7-8533-58b7792e6369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:53.490788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1163/2338] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:50:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:50:54.295688 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1248107-28d1-4c9b-a021-f6d714e966f9 service swift] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:54.297453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c1248107-28d1-4c9b-a021-f6d714e966f9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:54.382800 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1248107-28d1-4c9b-a021-f6d714e966f9 service swift] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:54.388306 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2ee6f-663f-4861-9074-e91a41842b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:54.389841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ee6f-663f-4861-9074-e91a41842b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:54.390253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ee6f-663f-4861-9074-e91a41842b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:54.390417 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ee6f-663f-4861-9074-e91a41842b3a admin admin] PATH_INFO: `/v3/users/e0156ed87a5b4efca7ef5056429db1a0` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:54.391653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2ee6f-663f-4861-9074-e91a41842b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0156ed87a5b4efca7ef5056429db1a0)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:54.393595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2ee6f-663f-4861-9074-e91a41842b3a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:54.444572 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-97a2ee6f-663f-4861-9074-e91a41842b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0156ed87a5b4efca7ef5056429db1a0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:54.456997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-97a2ee6f-663f-4861-9074-e91a41842b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0156ed87a5b4efca7ef5056429db1a0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:54.457697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-97a2ee6f-663f-4861-9074-e91a41842b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0156ed87a5b4efca7ef5056429db1a0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:54.458370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-97a2ee6f-663f-4861-9074-e91a41842b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0156ed87a5b4efca7ef5056429db1a0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:54.465526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-97a2ee6f-663f-4861-9074-e91a41842b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0156ed87a5b4efca7ef5056429db1a0'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:54.478518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1176/2339] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:50:54 2022] DELETE /identity/v3/users/e0156ed87a5b4efca7ef5056429db1a0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:50:54.660212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eba2a-262b-46d7-8533-58b7792e6369 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:54.682834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47eba2a-262b-46d7-8533-58b7792e6369 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:54.750601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:54.751462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:54.751741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:54.752011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] PATH_INFO: `/v3/projects/71b09f9f20b340b5a615b24e05312703` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:54.753232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b09f9f20b340b5a615b24e05312703)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:54.755221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:54.805730 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b09f9f20b340b5a615b24e05312703', 'request_id': 'req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:54.813600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b09f9f20b340b5a615b24e05312703', 'request_id': 'req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:54.819087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b09f9f20b340b5a615b24e05312703', 'request_id': 'req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:54.830255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] The token cache is being invalidate because project 71b09f9f20b340b5a615b24e05312703 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:50:54.830594 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:54.831245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-a21ae5ee-97f0-485c-a8c2-0a0ba15c0878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:54.832780 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1164/2340] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:50:54 2022] DELETE /identity/v3/projects/71b09f9f20b340b5a615b24e05312703 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:50:54.837794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c25c-2401-4cb5-a83c-d6e71235bb98 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:54.838572 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c25c-2401-4cb5-a83c-d6e71235bb98 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:54.838860 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919c25c-2401-4cb5-a83c-d6e71235bb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:54.856957 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9919c25c-2401-4cb5-a83c-d6e71235bb98 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:50:54.858226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9919c25c-2401-4cb5-a83c-d6e71235bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:54.927133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1177/2341] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:50:54.929799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb143a7-d280-4133-af86-b3808bab4ae2 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:54.930158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb143a7-d280-4133-af86-b3808bab4ae2 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:54.930557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb143a7-d280-4133-af86-b3808bab4ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:54.957434 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-1fb143a7-d280-4133-af86-b3808bab4ae2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:50:54.958720 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1fb143a7-d280-4133-af86-b3808bab4ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:54.967260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1165/2342] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:50:54.971796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919c25c-2401-4cb5-a83c-d6e71235bb98 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:54.981756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919c25c-2401-4cb5-a83c-d6e71235bb98 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:54.987243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a42ff-ac45-4fb7-836d-6d18ba3c5fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:54.987919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a42ff-ac45-4fb7-836d-6d18ba3c5fca admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:54.988451 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a42ff-ac45-4fb7-836d-6d18ba3c5fca admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:54.988733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a42ff-ac45-4fb7-836d-6d18ba3c5fca admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:54.989474 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a42ff-ac45-4fb7-836d-6d18ba3c5fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:50:54.989778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a42ff-ac45-4fb7-836d-6d18ba3c5fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:54.991462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a42ff-ac45-4fb7-836d-6d18ba3c5fca admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:55.008321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1178/2343] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:50:55.009365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb143a7-d280-4133-af86-b3808bab4ae2 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:55.019285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb143a7-d280-4133-af86-b3808bab4ae2 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:55.024050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d744065-7943-4a07-9641-bce388e92c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:55.024768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d744065-7943-4a07-9641-bce388e92c06 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:55.025056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d744065-7943-4a07-9641-bce388e92c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:55.025332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d744065-7943-4a07-9641-bce388e92c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:55.026047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d744065-7943-4a07-9641-bce388e92c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:55.028006 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d744065-7943-4a07-9641-bce388e92c06 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:55.055803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1166/2344] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:50:55 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:50:55.060030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a42ff-ac45-4fb7-836d-6d18ba3c5fca admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:55.071656 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a42ff-ac45-4fb7-836d-6d18ba3c5fca admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:55.131403 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac12c3f-db4d-4a29-9569-f711c89e6eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:55.132089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12c3f-db4d-4a29-9569-f711c89e6eba admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:55.132372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12c3f-db4d-4a29-9569-f711c89e6eba admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:55.132648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac12c3f-db4d-4a29-9569-f711c89e6eba admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:55.133363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac12c3f-db4d-4a29-9569-f711c89e6eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:55.135334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac12c3f-db4d-4a29-9569-f711c89e6eba admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:55.156260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1179/2345] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:50:55 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:50:55.160538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d744065-7943-4a07-9641-bce388e92c06 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:55.171106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d744065-7943-4a07-9641-bce388e92c06 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:55.175732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d769850-8b1e-4466-b541-834d6bd2fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:55.176399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769850-8b1e-4466-b541-834d6bd2fdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:55.176679 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769850-8b1e-4466-b541-834d6bd2fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:55.176952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d769850-8b1e-4466-b541-834d6bd2fdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:55.177735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d769850-8b1e-4466-b541-834d6bd2fdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:55.179308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d769850-8b1e-4466-b541-834d6bd2fdb6 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:55.191922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1167/2346] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:50:55.197121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac12c3f-db4d-4a29-9569-f711c89e6eba admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:55.208192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac12c3f-db4d-4a29-9569-f711c89e6eba admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:55.214049 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648a552-5aef-4ae9-b967-16338f5ede10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:55.215003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648a552-5aef-4ae9-b967-16338f5ede10 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:55.215286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648a552-5aef-4ae9-b967-16338f5ede10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:55.215557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648a552-5aef-4ae9-b967-16338f5ede10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:55.216277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648a552-5aef-4ae9-b967-16338f5ede10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:55.218562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648a552-5aef-4ae9-b967-16338f5ede10 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:55.229294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1180/2347] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:50:55.234196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d769850-8b1e-4466-b541-834d6bd2fdb6 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:55.254985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d769850-8b1e-4466-b541-834d6bd2fdb6 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:55.260178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162fe9-0c92-4a90-9697-fc131c0831b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:55.260846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162fe9-0c92-4a90-9697-fc131c0831b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:55.261125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162fe9-0c92-4a90-9697-fc131c0831b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:55.261394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162fe9-0c92-4a90-9697-fc131c0831b3 admin admin] PATH_INFO: `/v3/projects/b57f62a4dc3041ec8652119191d42cca/users/1f80aec6da1b477ba9ee9fc04ca38ab6/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:55.289518 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3162fe9-0c92-4a90-9697-fc131c0831b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b57f62a4dc3041ec8652119191d42cca, user_id=1f80aec6da1b477ba9ee9fc04ca38ab6, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:55.293224 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3162fe9-0c92-4a90-9697-fc131c0831b3 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:55.314849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1168/2348] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:50:55 2022] PUT /identity/v3/projects/b57f62a4dc3041ec8652119191d42cca/users/1f80aec6da1b477ba9ee9fc04ca38ab6/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:50:55.324771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09181e-d02f-4c7c-8383-64e2f60a191c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:55.325337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09181e-d02f-4c7c-8383-64e2f60a191c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:55.325337 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09181e-d02f-4c7c-8383-64e2f60a191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:55.355742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-5c09181e-d02f-4c7c-8383-64e2f60a191c None None] MFA Rules not processed for user `1f80aec6da1b477ba9ee9fc04ca38ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:50:55.357159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-5c09181e-d02f-4c7c-8383-64e2f60a191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:55.465862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1181/2349] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:50:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:50:55.479049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162fe9-0c92-4a90-9697-fc131c0831b3 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:55.483244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b3162fe9-0c92-4a90-9697-fc131c0831b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:55.576613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162fe9-0c92-4a90-9697-fc131c0831b3 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:55.580307 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8458-3ca1-4657-987d-9193bb6d6c4d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd346be1ef7604f1f87371f5d322fd010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:55.581088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8458-3ca1-4657-987d-9193bb6d6c4d service glance] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:55.581379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8458-3ca1-4657-987d-9193bb6d6c4d service glance] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:55.581657 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8458-3ca1-4657-987d-9193bb6d6c4d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:55.591262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da8458-3ca1-4657-987d-9193bb6d6c4d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:55.594986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da8458-3ca1-4657-987d-9193bb6d6c4d service glance] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:55.602980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1169/2350] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:50:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:50:59.620747 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09181e-d02f-4c7c-8383-64e2f60a191c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:59.622503 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-5c09181e-d02f-4c7c-8383-64e2f60a191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:59.690145 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09181e-d02f-4c7c-8383-64e2f60a191c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:59.694983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:59.695870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:59.696155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:59.696429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] PATH_INFO: `/v3/users/d9fb04d1f80a48b499f305181032de1f` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:59.697785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fb04d1f80a48b499f305181032de1f)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:59.699838 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:59.749123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fb04d1f80a48b499f305181032de1f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:59.765685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fb04d1f80a48b499f305181032de1f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:59.766534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fb04d1f80a48b499f305181032de1f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:59.767696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fb04d1f80a48b499f305181032de1f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:59.775790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fb04d1f80a48b499f305181032de1f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:50:59.791447 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1182/2351] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:50:59 2022] DELETE /identity/v3/users/d9fb04d1f80a48b499f305181032de1f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:50:59.795986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae1b5a-6389-43fa-86fa-a74c221292ff None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:59.796460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae1b5a-6389-43fa-86fa-a74c221292ff None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:59.796721 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae1b5a-6389-43fa-86fa-a74c221292ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:59.815168 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-21ae1b5a-6389-43fa-86fa-a74c221292ff None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:50:59.816351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-21ae1b5a-6389-43fa-86fa-a74c221292ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:59.876393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1170/2352] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:50:59.886365 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:50:59.887790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:50:59.946349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119838a3-04a9-46ec-8392-cc66b68d5a23 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:50:59.950762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b6d29-ffd6-4ddd-bfa9-38ce7bdbe8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:50:59.951456 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b6d29-ffd6-4ddd-bfa9-38ce7bdbe8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:50:59.951835 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b6d29-ffd6-4ddd-bfa9-38ce7bdbe8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:50:59.952129 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b6d29-ffd6-4ddd-bfa9-38ce7bdbe8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:50:59.961671 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b6d29-ffd6-4ddd-bfa9-38ce7bdbe8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:50:59.963175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b6d29-ffd6-4ddd-bfa9-38ce7bdbe8f0 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:50:59.973428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1183/2353] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:51:00.276285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae1b5a-6389-43fa-86fa-a74c221292ff None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:00.278086 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-21ae1b5a-6389-43fa-86fa-a74c221292ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:00.300702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae1b5a-6389-43fa-86fa-a74c221292ff None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:00.306201 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:00.307105 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:00.307381 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:00.307727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] PATH_INFO: `/v3/projects/bb6cbdbd05e44aa4b5a6c3f07abd7ce8` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:00.309342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6cbdbd05e44aa4b5a6c3f07abd7ce8)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:00.312860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:00.366754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6cbdbd05e44aa4b5a6c3f07abd7ce8', 'request_id': 'req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:00.374999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6cbdbd05e44aa4b5a6c3f07abd7ce8', 'request_id': 'req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:00.381068 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6cbdbd05e44aa4b5a6c3f07abd7ce8', 'request_id': 'req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:00.396737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] The token cache is being invalidate because project bb6cbdbd05e44aa4b5a6c3f07abd7ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:51:00.396991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:00.398043 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:00.399863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1171/2354] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:51:00 2022] DELETE /identity/v3/projects/bb6cbdbd05e44aa4b5a6c3f07abd7ce8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:51:00.485781 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138f169-6859-4c93-b353-e242a987d75e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:00.486432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138f169-6859-4c93-b353-e242a987d75e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:00.486922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138f169-6859-4c93-b353-e242a987d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:00.507589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-1138f169-6859-4c93-b353-e242a987d75e None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:00.509039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1138f169-6859-4c93-b353-e242a987d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:00.575641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1184/2355] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:00.591967 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:00.593507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:00.663488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387a0a8-d1a9-4e3a-bea2-420bfa19d7d4 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:00.668410 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c178b6-30ae-44de-8114-c0059f9ec755 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:00.669085 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c178b6-30ae-44de-8114-c0059f9ec755 service swift] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:00.669367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c178b6-30ae-44de-8114-c0059f9ec755 service swift] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:00.669665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c178b6-30ae-44de-8114-c0059f9ec755 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:00.678614 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c178b6-30ae-44de-8114-c0059f9ec755 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:00.680259 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c178b6-30ae-44de-8114-c0059f9ec755 service swift] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:00.694153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1172/2356] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:51:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:51:13.682952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138f169-6859-4c93-b353-e242a987d75e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:13.684447 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1138f169-6859-4c93-b353-e242a987d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:13.740295 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138f169-6859-4c93-b353-e242a987d75e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:13.743921 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc31947-60ff-415d-ac8c-961c35c5ce07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:13.744569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31947-60ff-415d-ac8c-961c35c5ce07 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:13.744855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31947-60ff-415d-ac8c-961c35c5ce07 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:13.745133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31947-60ff-415d-ac8c-961c35c5ce07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:13.746908 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9bc31947-60ff-415d-ac8c-961c35c5ce07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:13.807645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc31947-60ff-415d-ac8c-961c35c5ce07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:13.809112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc31947-60ff-415d-ac8c-961c35c5ce07 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:13.819095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1185/2357] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:51:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:51:17.635801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05b0cd-ea75-445e-9ba8-5f774a6bd57a None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:17.636367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05b0cd-ea75-445e-9ba8-5f774a6bd57a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:17.636367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05b0cd-ea75-445e-9ba8-5f774a6bd57a None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:17.637697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1173/2358] 10.222.0.61 () {54 vars in 921 bytes} [Sat May 14 15:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:51:17.645007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c038a-c863-46ef-b213-51657de08ec2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:17.645475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c038a-c863-46ef-b213-51657de08ec2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:17.645573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c038a-c863-46ef-b213-51657de08ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:17.681841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-273c038a-c863-46ef-b213-51657de08ec2 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:17.683115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-273c038a-c863-46ef-b213-51657de08ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:17.752204 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1186/2359] 10.222.0.61 () {58 vars in 1018 bytes} [Sat May 14 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:17.765348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05b0cd-ea75-445e-9ba8-5f774a6bd57a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:17.767161 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1c05b0cd-ea75-445e-9ba8-5f774a6bd57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:17.823523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05b0cd-ea75-445e-9ba8-5f774a6bd57a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:17.827612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2fe7c-c54c-4706-b6ed-5e84b27bffb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd346be1ef7604f1f87371f5d322fd010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:17.828252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2fe7c-c54c-4706-b6ed-5e84b27bffb8 service glance] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:17.828563 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2fe7c-c54c-4706-b6ed-5e84b27bffb8 service glance] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:17.828861 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2fe7c-c54c-4706-b6ed-5e84b27bffb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:17.839529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2fe7c-c54c-4706-b6ed-5e84b27bffb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:17.840963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2fe7c-c54c-4706-b6ed-5e84b27bffb8 service glance] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:17.852073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1174/2360] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:51:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:51:17.918600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6651dd0-d469-4475-90de-be31d06aaaf6 None None] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:17.918914 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6651dd0-d469-4475-90de-be31d06aaaf6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:17.919227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6651dd0-d469-4475-90de-be31d06aaaf6 None None] PATH_INFO: `/` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:17.921709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1187/2361] 10.222.0.61 () {54 vars in 921 bytes} [Sat May 14 15:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 14 15:51:17.926512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba4689-dce6-4b04-a6f6-116c28a7a389 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:17.926804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba4689-dce6-4b04-a6f6-116c28a7a389 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:17.927118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba4689-dce6-4b04-a6f6-116c28a7a389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:17.945251 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e1ba4689-dce6-4b04-a6f6-116c28a7a389 None None] MFA Rules not processed for user `abfc1e35362a4495a05475878db260f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:17.946444 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e1ba4689-dce6-4b04-a6f6-116c28a7a389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:17.952969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1175/2362] 10.222.0.61 () {58 vars in 1018 bytes} [Sat May 14 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:17.964399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6651dd0-d469-4475-90de-be31d06aaaf6 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:17.967330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b6651dd0-d469-4475-90de-be31d06aaaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:17.979541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6651dd0-d469-4475-90de-be31d06aaaf6 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:17.983706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a6ab6-9f5b-4bce-aa09-72f6d7ebf126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:17.984349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a6ab6-9f5b-4bce-aa09-72f6d7ebf126 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:17.984630 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a6ab6-9f5b-4bce-aa09-72f6d7ebf126 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:17.984906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a6ab6-9f5b-4bce-aa09-72f6d7ebf126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:17.992023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a6ab6-9f5b-4bce-aa09-72f6d7ebf126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:17.993432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a6ab6-9f5b-4bce-aa09-72f6d7ebf126 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:18.001498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1188/2363] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:51:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:51:18.083679 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f24028-331d-4bfe-a72e-5a9e0f4dc74f None None] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:18.083897 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f24028-331d-4bfe-a72e-5a9e0f4dc74f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:18.084172 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f24028-331d-4bfe-a72e-5a9e0f4dc74f None None] PATH_INFO: `/` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:18.085580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1176/2364] 10.222.0.61 () {54 vars in 921 bytes} [Sat May 14 15:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 14 15:51:18.091938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73559530-7aae-4805-81e0-8939ce807484 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:18.092279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73559530-7aae-4805-81e0-8939ce807484 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:18.092747 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73559530-7aae-4805-81e0-8939ce807484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:18.111307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-73559530-7aae-4805-81e0-8939ce807484 None None] MFA Rules not processed for user `ebefa53d595b4e6486ce409f2ac47ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:18.112592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-73559530-7aae-4805-81e0-8939ce807484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:18.121915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1189/2365] 10.222.0.61 () {58 vars in 1018 bytes} [Sat May 14 15:51:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:18.132436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f24028-331d-4bfe-a72e-5a9e0f4dc74f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:18.143767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f24028-331d-4bfe-a72e-5a9e0f4dc74f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:18.147354 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f82d51-40bd-44e9-983e-f3a40a625829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:18.147983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f82d51-40bd-44e9-983e-f3a40a625829 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:18.148262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f82d51-40bd-44e9-983e-f3a40a625829 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:18.148585 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f82d51-40bd-44e9-983e-f3a40a625829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:18.159801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f82d51-40bd-44e9-983e-f3a40a625829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:18.161221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f82d51-40bd-44e9-983e-f3a40a625829 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:18.171875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1177/2366] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:51:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:51:18.826297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73559530-7aae-4805-81e0-8939ce807484 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:18.835738 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73559530-7aae-4805-81e0-8939ce807484 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:18.839472 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668042c-939e-4257-b2a8-983a0caa4178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:18.840120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668042c-939e-4257-b2a8-983a0caa4178 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:18.840401 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668042c-939e-4257-b2a8-983a0caa4178 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:18.840677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668042c-939e-4257-b2a8-983a0caa4178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:18.842960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1668042c-939e-4257-b2a8-983a0caa4178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:18.856230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668042c-939e-4257-b2a8-983a0caa4178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:18.858512 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668042c-939e-4257-b2a8-983a0caa4178 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:18.869516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1190/2367] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:51:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:51:20.050073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f82d51-40bd-44e9-983e-f3a40a625829 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:20.058407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f82d51-40bd-44e9-983e-f3a40a625829 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:20.063357 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7143f-d3e3-40b8-a239-50817205100f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:20.064192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7143f-d3e3-40b8-a239-50817205100f service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:20.064474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7143f-d3e3-40b8-a239-50817205100f service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:20.064915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7143f-d3e3-40b8-a239-50817205100f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:20.066949 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-78f7143f-d3e3-40b8-a239-50817205100f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:20.081239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7143f-d3e3-40b8-a239-50817205100f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:20.082702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7143f-d3e3-40b8-a239-50817205100f service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:20.095941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1178/2368] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:51:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:51:20.744427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573d5f2-5a5a-4219-a9de-14ce87bbdd61 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:20.744876 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573d5f2-5a5a-4219-a9de-14ce87bbdd61 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:20.744968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573d5f2-5a5a-4219-a9de-14ce87bbdd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:20.762457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2573d5f2-5a5a-4219-a9de-14ce87bbdd61 None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:20.763689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2573d5f2-5a5a-4219-a9de-14ce87bbdd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:20.770750 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1191/2369] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:51:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:20.783177 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7143f-d3e3-40b8-a239-50817205100f service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:20.794220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7143f-d3e3-40b8-a239-50817205100f service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:20.799991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333af59c-1ccc-4fc4-9113-16fb3b1c57c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:20.800624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af59c-1ccc-4fc4-9113-16fb3b1c57c7 service swift] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:20.800902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af59c-1ccc-4fc4-9113-16fb3b1c57c7 service swift] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:20.801173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af59c-1ccc-4fc4-9113-16fb3b1c57c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:20.810398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333af59c-1ccc-4fc4-9113-16fb3b1c57c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:20.812349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333af59c-1ccc-4fc4-9113-16fb3b1c57c7 service swift] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:20.820180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1179/2370] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:51:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:51:37.874466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573d5f2-5a5a-4219-a9de-14ce87bbdd61 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:37.883605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573d5f2-5a5a-4219-a9de-14ce87bbdd61 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:37.887129 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806d133-ea1f-4459-9e5f-15f074865ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:37.887761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806d133-ea1f-4459-9e5f-15f074865ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:37.888045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806d133-ea1f-4459-9e5f-15f074865ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:37.888323 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806d133-ea1f-4459-9e5f-15f074865ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:37.890751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4806d133-ea1f-4459-9e5f-15f074865ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:37.946130 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806d133-ea1f-4459-9e5f-15f074865ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:37.947511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806d133-ea1f-4459-9e5f-15f074865ab7 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:37.956513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1192/2371] 10.222.0.61 () {60 vars in 1396 bytes} [Sat May 14 15:51:37 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:51:38.380705 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333af59c-1ccc-4fc4-9113-16fb3b1c57c7 service swift] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:38.382089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-333af59c-1ccc-4fc4-9113-16fb3b1c57c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:38.444598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333af59c-1ccc-4fc4-9113-16fb3b1c57c7 service swift] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:38.449088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10973cbb-4aa8-4811-a615-ff5fcf5e70fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:38.449937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10973cbb-4aa8-4811-a615-ff5fcf5e70fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:38.450213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10973cbb-4aa8-4811-a615-ff5fcf5e70fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:38.450511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10973cbb-4aa8-4811-a615-ff5fcf5e70fc admin admin] PATH_INFO: `/v3/users/1f80aec6da1b477ba9ee9fc04ca38ab6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:38.451714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10973cbb-4aa8-4811-a615-ff5fcf5e70fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f80aec6da1b477ba9ee9fc04ca38ab6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:38.454507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10973cbb-4aa8-4811-a615-ff5fcf5e70fc admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:38.510119 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-10973cbb-4aa8-4811-a615-ff5fcf5e70fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f80aec6da1b477ba9ee9fc04ca38ab6'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:38.521918 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-10973cbb-4aa8-4811-a615-ff5fcf5e70fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f80aec6da1b477ba9ee9fc04ca38ab6'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:38.522634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-10973cbb-4aa8-4811-a615-ff5fcf5e70fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f80aec6da1b477ba9ee9fc04ca38ab6'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:38.523233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-10973cbb-4aa8-4811-a615-ff5fcf5e70fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f80aec6da1b477ba9ee9fc04ca38ab6'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:38.530690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-10973cbb-4aa8-4811-a615-ff5fcf5e70fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f80aec6da1b477ba9ee9fc04ca38ab6'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:38.541466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806d133-ea1f-4459-9e5f-15f074865ab7 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:38.543254 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1180/2372] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:51:38 2022] DELETE /identity/v3/users/1f80aec6da1b477ba9ee9fc04ca38ab6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:51:38.548779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb647a-9916-4bcc-bed2-3cd748584e7f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:38.549067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb647a-9916-4bcc-bed2-3cd748584e7f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:38.549342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb647a-9916-4bcc-bed2-3cd748584e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:38.554303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806d133-ea1f-4459-9e5f-15f074865ab7 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:38.566577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-3eeb647a-9916-4bcc-bed2-3cd748584e7f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:38.567778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3eeb647a-9916-4bcc-bed2-3cd748584e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:38.603242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d0f2f-6740-4018-9f59-0d60583e1d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:38.603882 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d0f2f-6740-4018-9f59-0d60583e1d0c service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:38.604162 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d0f2f-6740-4018-9f59-0d60583e1d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:38.604434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d0f2f-6740-4018-9f59-0d60583e1d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:38.606271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1f7d0f2f-6740-4018-9f59-0d60583e1d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:38.616335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d0f2f-6740-4018-9f59-0d60583e1d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:38.617680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d0f2f-6740-4018-9f59-0d60583e1d0c service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:38.626111 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1193/2373] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:51:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:51:38.628280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1181/2374] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:51:38.637740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d0f2f-6740-4018-9f59-0d60583e1d0c service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:38.639172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1f7d0f2f-6740-4018-9f59-0d60583e1d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:38.649988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d0f2f-6740-4018-9f59-0d60583e1d0c service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:38.653700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdb943-438c-4d38-a63b-295b53dfc318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:38.654370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdb943-438c-4d38-a63b-295b53dfc318 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:38.654659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdb943-438c-4d38-a63b-295b53dfc318 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:38.654964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdb943-438c-4d38-a63b-295b53dfc318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:38.664483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdb943-438c-4d38-a63b-295b53dfc318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:38.665919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdb943-438c-4d38-a63b-295b53dfc318 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:38.676497 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1194/2375] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:51:38.948821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb647a-9916-4bcc-bed2-3cd748584e7f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:38.950542 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3eeb647a-9916-4bcc-bed2-3cd748584e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:38.964226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb647a-9916-4bcc-bed2-3cd748584e7f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:38.976266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:38.977693 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:38.977970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:38.978423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] PATH_INFO: `/v3/projects/b57f62a4dc3041ec8652119191d42cca` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:38.980113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b57f62a4dc3041ec8652119191d42cca)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:38.982076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:39.028132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b57f62a4dc3041ec8652119191d42cca', 'request_id': 'req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:39.038386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b57f62a4dc3041ec8652119191d42cca', 'request_id': 'req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:39.047006 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b57f62a4dc3041ec8652119191d42cca', 'request_id': 'req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:39.059651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] The token cache is being invalidate because project b57f62a4dc3041ec8652119191d42cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:51:39.059937 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:39.060666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9813e1f9-4b46-45b7-b05b-f2fc34cfc104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:51:39.063508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1182/2376] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:51:38 2022] DELETE /identity/v3/projects/b57f62a4dc3041ec8652119191d42cca => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:51:39.068691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4579a6-5240-4ee4-a03c-916b9d66568a None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:39.069231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4579a6-5240-4ee4-a03c-916b9d66568a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:39.069231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4579a6-5240-4ee4-a03c-916b9d66568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:39.087950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-fb4579a6-5240-4ee4-a03c-916b9d66568a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:39.089147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-fb4579a6-5240-4ee4-a03c-916b9d66568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:39.156529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1195/2377] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:39.164475 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f219e-44bf-46d1-aabd-08fa2168697a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:39.164767 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f219e-44bf-46d1-aabd-08fa2168697a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:39.165046 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f219e-44bf-46d1-aabd-08fa2168697a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:39.183732 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6d3f219e-44bf-46d1-aabd-08fa2168697a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:39.184962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6d3f219e-44bf-46d1-aabd-08fa2168697a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:39.193112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1183/2378] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:39.197307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4579a6-5240-4ee4-a03c-916b9d66568a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:39.206790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4579a6-5240-4ee4-a03c-916b9d66568a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:39.211638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39611a71-9f76-48eb-8443-b64fb2d3cfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:39.212293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611a71-9f76-48eb-8443-b64fb2d3cfaa admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:39.212575 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611a71-9f76-48eb-8443-b64fb2d3cfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:39.212852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611a71-9f76-48eb-8443-b64fb2d3cfaa admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:39.213586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39611a71-9f76-48eb-8443-b64fb2d3cfaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:51:39.213891 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39611a71-9f76-48eb-8443-b64fb2d3cfaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:39.215526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39611a71-9f76-48eb-8443-b64fb2d3cfaa admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:39.227704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1196/2379] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:51:39.232014 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f219e-44bf-46d1-aabd-08fa2168697a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:39.242457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f219e-44bf-46d1-aabd-08fa2168697a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:39.247101 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac278abb-9392-4666-adc8-8f7ebed7a6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:39.247749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac278abb-9392-4666-adc8-8f7ebed7a6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:39.248030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac278abb-9392-4666-adc8-8f7ebed7a6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:39.248303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac278abb-9392-4666-adc8-8f7ebed7a6e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:39.249183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac278abb-9392-4666-adc8-8f7ebed7a6e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:39.251130 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac278abb-9392-4666-adc8-8f7ebed7a6e9 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:39.275005 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1184/2380] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:51:39 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:51:39.279285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39611a71-9f76-48eb-8443-b64fb2d3cfaa admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:39.290089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39611a71-9f76-48eb-8443-b64fb2d3cfaa admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:39.345584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca926aba-d2b2-4ff7-8e92-4f0449e48c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:39.346251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca926aba-d2b2-4ff7-8e92-4f0449e48c60 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:39.346564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca926aba-d2b2-4ff7-8e92-4f0449e48c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:39.346841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca926aba-d2b2-4ff7-8e92-4f0449e48c60 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:39.347538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca926aba-d2b2-4ff7-8e92-4f0449e48c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:39.349513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca926aba-d2b2-4ff7-8e92-4f0449e48c60 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:39.369063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1197/2381] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:51:39 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:51:39.373110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac278abb-9392-4666-adc8-8f7ebed7a6e9 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:39.383978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac278abb-9392-4666-adc8-8f7ebed7a6e9 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:39.388495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23084534-1271-46c4-86ec-2493c7f991c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:39.389144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084534-1271-46c4-86ec-2493c7f991c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:39.389643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084534-1271-46c4-86ec-2493c7f991c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:39.390004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23084534-1271-46c4-86ec-2493c7f991c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:39.390759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23084534-1271-46c4-86ec-2493c7f991c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:39.392328 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23084534-1271-46c4-86ec-2493c7f991c4 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:39.402418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1185/2382] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:51:39.406217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca926aba-d2b2-4ff7-8e92-4f0449e48c60 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:39.415897 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca926aba-d2b2-4ff7-8e92-4f0449e48c60 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:39.420970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6c77d-6d1b-412d-9dc1-4cd467c1191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:39.421773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c77d-6d1b-412d-9dc1-4cd467c1191b admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:39.422052 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c77d-6d1b-412d-9dc1-4cd467c1191b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:39.422414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c77d-6d1b-412d-9dc1-4cd467c1191b admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:39.423141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6c77d-6d1b-412d-9dc1-4cd467c1191b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:39.424714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6c77d-6d1b-412d-9dc1-4cd467c1191b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:39.434178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1198/2383] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:51:39.438963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23084534-1271-46c4-86ec-2493c7f991c4 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:39.448471 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23084534-1271-46c4-86ec-2493c7f991c4 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:39.453112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048e65f-3196-4780-809d-03b7772050fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:39.453970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e65f-3196-4780-809d-03b7772050fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:39.454247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e65f-3196-4780-809d-03b7772050fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:39.454570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048e65f-3196-4780-809d-03b7772050fb admin admin] PATH_INFO: `/v3/projects/83d6b6f0aa4f4314811ee80480861958/users/4e05ae1c6a054a299e841d008f9d7a09/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:39.468756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048e65f-3196-4780-809d-03b7772050fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d6b6f0aa4f4314811ee80480861958, user_id=4e05ae1c6a054a299e841d008f9d7a09, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:39.471507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048e65f-3196-4780-809d-03b7772050fb admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:39.483999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1186/2384] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:51:39 2022] PUT /identity/v3/projects/83d6b6f0aa4f4314811ee80480861958/users/4e05ae1c6a054a299e841d008f9d7a09/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:51:39.489372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c68419-007b-4079-99b6-ce52feb6f0b6 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:39.489688 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c68419-007b-4079-99b6-ce52feb6f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:39.489996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c68419-007b-4079-99b6-ce52feb6f0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:39.509242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-18c68419-007b-4079-99b6-ce52feb6f0b6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:39.510490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-18c68419-007b-4079-99b6-ce52feb6f0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:39.567997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1199/2385] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:39.578111 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048e65f-3196-4780-809d-03b7772050fb admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:39.579963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7048e65f-3196-4780-809d-03b7772050fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:39.634188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048e65f-3196-4780-809d-03b7772050fb admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:39.637713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed264-28dd-461f-a573-0fa64ca1ef59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:39.638373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed264-28dd-461f-a573-0fa64ca1ef59 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:39.638654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed264-28dd-461f-a573-0fa64ca1ef59 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:39.638927 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabed264-28dd-461f-a573-0fa64ca1ef59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:39.648514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabed264-28dd-461f-a573-0fa64ca1ef59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:39.649927 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabed264-28dd-461f-a573-0fa64ca1ef59 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:39.660168 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1187/2386] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:51:43.667533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3debda-62f4-4a92-8230-f50bb0a3a1b0 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:43.668042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3debda-62f4-4a92-8230-f50bb0a3a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:43.668042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3debda-62f4-4a92-8230-f50bb0a3a1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:43.698577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-be3debda-62f4-4a92-8230-f50bb0a3a1b0 None None] MFA Rules not processed for user `4e05ae1c6a054a299e841d008f9d7a09`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:43.699811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-be3debda-62f4-4a92-8230-f50bb0a3a1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:43.771675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1200/2387] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:51:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:43.776871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed264-28dd-461f-a573-0fa64ca1ef59 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:43.787690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabed264-28dd-461f-a573-0fa64ca1ef59 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:43.792803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c19d-4363-4bd4-b296-7ed4341798a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:43.793532 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c19d-4363-4bd4-b296-7ed4341798a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:43.793985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c19d-4363-4bd4-b296-7ed4341798a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:43.794215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c19d-4363-4bd4-b296-7ed4341798a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:43.795022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6c19d-4363-4bd4-b296-7ed4341798a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:43.797690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6c19d-4363-4bd4-b296-7ed4341798a0 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:43.827533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1188/2388] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:51:43 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:51:43.831524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3debda-62f4-4a92-8230-f50bb0a3a1b0 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:43.846555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3debda-62f4-4a92-8230-f50bb0a3a1b0 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:43.910704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dd05a-85af-4631-b7b4-b6b8bae2c460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:43.911265 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dd05a-85af-4631-b7b4-b6b8bae2c460 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:43.911555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dd05a-85af-4631-b7b4-b6b8bae2c460 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:43.911841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dd05a-85af-4631-b7b4-b6b8bae2c460 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:43.912548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dd05a-85af-4631-b7b4-b6b8bae2c460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:43.914577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22dd05a-85af-4631-b7b4-b6b8bae2c460 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:43.938382 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1201/2389] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:51:43 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:51:43.941426 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c19d-4363-4bd4-b296-7ed4341798a0 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:43.953143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c19d-4363-4bd4-b296-7ed4341798a0 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:43.957997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b62e52-a4d8-4222-bf5c-1c8fdb32b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:43.958783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b62e52-a4d8-4222-bf5c-1c8fdb32b715 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:43.959131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b62e52-a4d8-4222-bf5c-1c8fdb32b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:43.959469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b62e52-a4d8-4222-bf5c-1c8fdb32b715 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:43.960262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b62e52-a4d8-4222-bf5c-1c8fdb32b715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:43.961909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b62e52-a4d8-4222-bf5c-1c8fdb32b715 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:43.973795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1189/2390] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:51:43.977914 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dd05a-85af-4631-b7b4-b6b8bae2c460 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:43.988456 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22dd05a-85af-4631-b7b4-b6b8bae2c460 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:43.993464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10699b-45d3-4cd5-92f7-4c6f2149f486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:43.994389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10699b-45d3-4cd5-92f7-4c6f2149f486 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:43.994674 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10699b-45d3-4cd5-92f7-4c6f2149f486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:43.994949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10699b-45d3-4cd5-92f7-4c6f2149f486 admin admin] PATH_INFO: `/v3/projects/d957ce2b30644c3bb7b43134161a5f69/users/b49090f58f3748acb94a885c416ae7e2/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:44.012411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10699b-45d3-4cd5-92f7-4c6f2149f486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d957ce2b30644c3bb7b43134161a5f69, user_id=b49090f58f3748acb94a885c416ae7e2, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:44.015705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10699b-45d3-4cd5-92f7-4c6f2149f486 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:44.031088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1202/2391] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:51:43 2022] PUT /identity/v3/projects/d957ce2b30644c3bb7b43134161a5f69/users/b49090f58f3748acb94a885c416ae7e2/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:51:44.035030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b62e52-a4d8-4222-bf5c-1c8fdb32b715 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:44.045103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b62e52-a4d8-4222-bf5c-1c8fdb32b715 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:44.102870 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840b4b3-e12b-4044-8996-106a8f667142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:44.103538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840b4b3-e12b-4044-8996-106a8f667142 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:44.103821 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840b4b3-e12b-4044-8996-106a8f667142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:44.104098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840b4b3-e12b-4044-8996-106a8f667142 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:44.104827 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840b4b3-e12b-4044-8996-106a8f667142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:44.106485 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840b4b3-e12b-4044-8996-106a8f667142 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:44.117623 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1190/2392] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:51:44.121695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10699b-45d3-4cd5-92f7-4c6f2149f486 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:44.132922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10699b-45d3-4cd5-92f7-4c6f2149f486 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:44.137952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588bced-f0e6-4fa5-9223-46b8a60b231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:44.138889 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588bced-f0e6-4fa5-9223-46b8a60b231e admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:44.139207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588bced-f0e6-4fa5-9223-46b8a60b231e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:44.139488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588bced-f0e6-4fa5-9223-46b8a60b231e admin admin] PATH_INFO: `/v3/projects/d957ce2b30644c3bb7b43134161a5f69/users/b49090f58f3748acb94a885c416ae7e2/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:44.141582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588bced-f0e6-4fa5-9223-46b8a60b231e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d957ce2b30644c3bb7b43134161a5f69, user_id=b49090f58f3748acb94a885c416ae7e2, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:44.144332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588bced-f0e6-4fa5-9223-46b8a60b231e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:44.155733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1203/2393] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:51:44 2022] PUT /identity/v3/projects/d957ce2b30644c3bb7b43134161a5f69/users/b49090f58f3748acb94a885c416ae7e2/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:51:49.082522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19637d-ce4b-4003-8d0b-f741ec10f3d0 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:49.082996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19637d-ce4b-4003-8d0b-f741ec10f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:49.083159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19637d-ce4b-4003-8d0b-f741ec10f3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:49.127057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-fa19637d-ce4b-4003-8d0b-f741ec10f3d0 None None] MFA Rules not processed for user `b49090f58f3748acb94a885c416ae7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:49.128628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-fa19637d-ce4b-4003-8d0b-f741ec10f3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:49.209673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1191/2394] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:49.216284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588bced-f0e6-4fa5-9223-46b8a60b231e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:49.218987 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6588bced-f0e6-4fa5-9223-46b8a60b231e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:49.307704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588bced-f0e6-4fa5-9223-46b8a60b231e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:49.315003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882eb1a5-c238-4234-974e-86cb66e9efa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:49.315796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882eb1a5-c238-4234-974e-86cb66e9efa9 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:49.316182 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882eb1a5-c238-4234-974e-86cb66e9efa9 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:49.316648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882eb1a5-c238-4234-974e-86cb66e9efa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:49.384215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882eb1a5-c238-4234-974e-86cb66e9efa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:49.385818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882eb1a5-c238-4234-974e-86cb66e9efa9 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:49.396934 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1204/2395] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:51:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:51:50.414570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f12c0-9516-4d6a-ad37-60f012efa7d1 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:50.415144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f12c0-9516-4d6a-ad37-60f012efa7d1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:50.415144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f12c0-9516-4d6a-ad37-60f012efa7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:50.432523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-881f12c0-9516-4d6a-ad37-60f012efa7d1 None None] MFA Rules not processed for user `4e05ae1c6a054a299e841d008f9d7a09`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:50.433707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-881f12c0-9516-4d6a-ad37-60f012efa7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:50.441089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1192/2396] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:51:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:59.207518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81581f-2a58-4b58-8999-905af8aacb97 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:59.208044 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81581f-2a58-4b58-8999-905af8aacb97 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:59.208144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81581f-2a58-4b58-8999-905af8aacb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:59.225528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-1a81581f-2a58-4b58-8999-905af8aacb97 None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:51:59.226765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-1a81581f-2a58-4b58-8999-905af8aacb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:59.281342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1205/2397] 10.222.0.61 () {58 vars in 967 bytes} [Sat May 14 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:51:59.304591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f12c0-9516-4d6a-ad37-60f012efa7d1 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:51:59.306065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-881f12c0-9516-4d6a-ad37-60f012efa7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:51:59.379194 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f12c0-9516-4d6a-ad37-60f012efa7d1 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:51:59.384074 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee13e5-e069-4515-b6dd-27402a703d61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:51:59.384715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee13e5-e069-4515-b6dd-27402a703d61 service swift] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:51:59.384993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee13e5-e069-4515-b6dd-27402a703d61 service swift] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:51:59.385262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee13e5-e069-4515-b6dd-27402a703d61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:51:59.393659 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee13e5-e069-4515-b6dd-27402a703d61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:51:59.395263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee13e5-e069-4515-b6dd-27402a703d61 service swift] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:51:59.403040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1193/2398] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:51:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:52:17.486187 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81581f-2a58-4b58-8999-905af8aacb97 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:52:17.538557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81581f-2a58-4b58-8999-905af8aacb97 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:52:17.542116 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e60ee-8bf9-4148-8646-67bc09a775dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:52:17.542782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e60ee-8bf9-4148-8646-67bc09a775dc service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:52:17.543069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e60ee-8bf9-4148-8646-67bc09a775dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:52:17.543348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e60ee-8bf9-4148-8646-67bc09a775dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:52:17.546183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9c0e60ee-8bf9-4148-8646-67bc09a775dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:52:17.555324 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e60ee-8bf9-4148-8646-67bc09a775dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:52:17.556749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e60ee-8bf9-4148-8646-67bc09a775dc service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:52:17.564545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1206/2399] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:52:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:52:17.985997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee13e5-e069-4515-b6dd-27402a703d61 service swift] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:52:17.987471 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-91ee13e5-e069-4515-b6dd-27402a703d61 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:52:18.057347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee13e5-e069-4515-b6dd-27402a703d61 service swift] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:52:18.062895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616a9c9-7882-435a-8d4e-3da0737f7557 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fac310b740a40718191e905723222ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:52:18.063537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616a9c9-7882-435a-8d4e-3da0737f7557 service placement] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:52:18.063820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616a9c9-7882-435a-8d4e-3da0737f7557 service placement] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:52:18.064099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616a9c9-7882-435a-8d4e-3da0737f7557 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:52:18.065883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e616a9c9-7882-435a-8d4e-3da0737f7557 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:52:18.077413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616a9c9-7882-435a-8d4e-3da0737f7557 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:52:18.079044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616a9c9-7882-435a-8d4e-3da0737f7557 service placement] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:52:18.088673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1194/2400] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:52:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:52:21.460340 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e60ee-8bf9-4148-8646-67bc09a775dc service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:52:21.475763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e60ee-8bf9-4148-8646-67bc09a775dc service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:52:21.484326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff65f00-99f3-4c3f-b5e8-f5d42a355719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:52:21.485531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65f00-99f3-4c3f-b5e8-f5d42a355719 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:52:21.486055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65f00-99f3-4c3f-b5e8-f5d42a355719 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:52:21.487518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65f00-99f3-4c3f-b5e8-f5d42a355719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:52:21.489973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6ff65f00-99f3-4c3f-b5e8-f5d42a355719 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:52:21.504916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff65f00-99f3-4c3f-b5e8-f5d42a355719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:52:21.506570 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff65f00-99f3-4c3f-b5e8-f5d42a355719 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:52:21.520478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1207/2401] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:52:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:52:26.856147 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616a9c9-7882-435a-8d4e-3da0737f7557 service placement] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:52:26.858287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e616a9c9-7882-435a-8d4e-3da0737f7557 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:52:26.875676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616a9c9-7882-435a-8d4e-3da0737f7557 service placement] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:52:26.882049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d6fef-6b7e-460d-8d9f-25374567b0ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:52:26.882890 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6fef-6b7e-460d-8d9f-25374567b0ba service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:52:26.883165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6fef-6b7e-460d-8d9f-25374567b0ba service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:52:26.883510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d6fef-6b7e-460d-8d9f-25374567b0ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:52:26.885617 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1b7d6fef-6b7e-460d-8d9f-25374567b0ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:52:26.945351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d6fef-6b7e-460d-8d9f-25374567b0ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:52:26.947067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d6fef-6b7e-460d-8d9f-25374567b0ba service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:52:26.956825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1195/2402] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:52:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:52:35.104787 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff65f00-99f3-4c3f-b5e8-f5d42a355719 service nova] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:52:35.118624 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff65f00-99f3-4c3f-b5e8-f5d42a355719 service nova] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:52:35.126138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e378ec-6de5-4429-8691-2aa410462dc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:52:35.126839 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e378ec-6de5-4429-8691-2aa410462dc7 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:52:35.127122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e378ec-6de5-4429-8691-2aa410462dc7 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:52:35.127443 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e378ec-6de5-4429-8691-2aa410462dc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:52:35.129297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-94e378ec-6de5-4429-8691-2aa410462dc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:52:35.145214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e378ec-6de5-4429-8691-2aa410462dc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:52:35.147239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e378ec-6de5-4429-8691-2aa410462dc7 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:52:35.160787 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1208/2403] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:52:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:52:40.403722 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d6fef-6b7e-460d-8d9f-25374567b0ba service nova] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:52:40.413098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d6fef-6b7e-460d-8d9f-25374567b0ba service nova] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:52:40.416666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dad64c-6285-432d-90c9-c20065ffb54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:52:40.417305 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dad64c-6285-432d-90c9-c20065ffb54d service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:52:40.417587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dad64c-6285-432d-90c9-c20065ffb54d service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:52:40.417863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dad64c-6285-432d-90c9-c20065ffb54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:52:40.428291 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dad64c-6285-432d-90c9-c20065ffb54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:52:40.429765 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dad64c-6285-432d-90c9-c20065ffb54d service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:52:40.439796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1196/2404] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:52:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:52:42.455273 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e378ec-6de5-4429-8691-2aa410462dc7 service nova] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:52:42.467809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e378ec-6de5-4429-8691-2aa410462dc7 service nova] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:52:42.474101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac546df-79f6-477c-a1c3-de88986f1ac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:52:42.474795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac546df-79f6-477c-a1c3-de88986f1ac2 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:52:42.475171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac546df-79f6-477c-a1c3-de88986f1ac2 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:52:42.475484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac546df-79f6-477c-a1c3-de88986f1ac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:52:42.477408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-bac546df-79f6-477c-a1c3-de88986f1ac2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:52:42.491211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac546df-79f6-477c-a1c3-de88986f1ac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:52:42.492879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac546df-79f6-477c-a1c3-de88986f1ac2 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:52:42.504339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1209/2405] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:52:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:52:48.574098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dad64c-6285-432d-90c9-c20065ffb54d service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:52:48.586051 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dad64c-6285-432d-90c9-c20065ffb54d service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:52:48.591681 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc30ddd-c4f1-44dc-a2cf-3bb7ba50899d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:52:48.592185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc30ddd-c4f1-44dc-a2cf-3bb7ba50899d service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:52:48.592468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc30ddd-c4f1-44dc-a2cf-3bb7ba50899d service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:52:48.592746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc30ddd-c4f1-44dc-a2cf-3bb7ba50899d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:52:48.594535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-fbc30ddd-c4f1-44dc-a2cf-3bb7ba50899d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:52:48.650303 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc30ddd-c4f1-44dc-a2cf-3bb7ba50899d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:52:48.651930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc30ddd-c4f1-44dc-a2cf-3bb7ba50899d service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:52:48.660868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1197/2406] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:52:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:53:03.439465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961231-035f-4fd8-8c25-649b7d20549d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:03.439951 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961231-035f-4fd8-8c25-649b7d20549d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:03.440062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2961231-035f-4fd8-8c25-649b7d20549d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:03.457931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c2961231-035f-4fd8-8c25-649b7d20549d None None] MFA Rules not processed for user `7b896317d96a40d6a137db0dcf5f98f2`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:53:03.459105 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c2961231-035f-4fd8-8c25-649b7d20549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:53:03.466163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1210/2407] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:53:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:53:03.743936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b44d93-d274-4b7a-b61a-56a0c53da4e1 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:03.744478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b44d93-d274-4b7a-b61a-56a0c53da4e1 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:03.744478 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b44d93-d274-4b7a-b61a-56a0c53da4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:03.764941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-96b44d93-d274-4b7a-b61a-56a0c53da4e1 None None] MFA Rules not processed for user `dc43895177134e9c9c030a9d87f94aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:53:03.766146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-96b44d93-d274-4b7a-b61a-56a0c53da4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:53:03.773329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1198/2408] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:53:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:53:28.794468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a20f-98c0-4fa2-99ab-08e439309a94 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:28.795228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a20f-98c0-4fa2-99ab-08e439309a94 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:28.795228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a20f-98c0-4fa2-99ab-08e439309a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:28.813479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9411a20f-98c0-4fa2-99ab-08e439309a94 None None] MFA Rules not processed for user `58bfb7417bc94583963401ae0fe9d39a`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:53:28.814722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9411a20f-98c0-4fa2-99ab-08e439309a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:53:28.871822 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1211/2409] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:53:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:53:29.333889 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b44d93-d274-4b7a-b61a-56a0c53da4e1 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:53:29.344363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b44d93-d274-4b7a-b61a-56a0c53da4e1 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:53:29.348477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99204d96-8fc4-45f0-93ad-acc60c5c1e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:53:29.349222 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99204d96-8fc4-45f0-93ad-acc60c5c1e31 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:29.349569 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99204d96-8fc4-45f0-93ad-acc60c5c1e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:29.350024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99204d96-8fc4-45f0-93ad-acc60c5c1e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:29.351888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-99204d96-8fc4-45f0-93ad-acc60c5c1e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:53:29.362218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99204d96-8fc4-45f0-93ad-acc60c5c1e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:53:29.363671 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99204d96-8fc4-45f0-93ad-acc60c5c1e31 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:53:29.371994 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1199/2410] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:53:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:53:35.574302 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a20f-98c0-4fa2-99ab-08e439309a94 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:53:35.576214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9411a20f-98c0-4fa2-99ab-08e439309a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:53:35.630421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a20f-98c0-4fa2-99ab-08e439309a94 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:53:35.633990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f282227-44e8-419e-924d-4b7bbf4f52b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:53:35.634658 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f282227-44e8-419e-924d-4b7bbf4f52b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:35.634946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f282227-44e8-419e-924d-4b7bbf4f52b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:35.635225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f282227-44e8-419e-924d-4b7bbf4f52b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:35.636976 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9f282227-44e8-419e-924d-4b7bbf4f52b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:53:35.692960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f282227-44e8-419e-924d-4b7bbf4f52b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:53:35.694432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f282227-44e8-419e-924d-4b7bbf4f52b3 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:53:35.703935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1212/2411] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:53:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:53:40.777267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9468bb-8ccb-42e8-ac9b-2020b530d828 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:40.777733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9468bb-8ccb-42e8-ac9b-2020b530d828 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:40.777873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9468bb-8ccb-42e8-ac9b-2020b530d828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:40.795929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-3a9468bb-8ccb-42e8-ac9b-2020b530d828 None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:53:40.797104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3a9468bb-8ccb-42e8-ac9b-2020b530d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:53:40.804216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1200/2412] 10.222.0.61 () {58 vars in 967 bytes} [Sat May 14 15:53:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:53:40.853880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f282227-44e8-419e-924d-4b7bbf4f52b3 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:53:40.866113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f282227-44e8-419e-924d-4b7bbf4f52b3 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:53:40.871157 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215fd2f-e954-46ce-9a21-30e4e0b74375 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:53:40.871815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215fd2f-e954-46ce-9a21-30e4e0b74375 service swift] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:40.872629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215fd2f-e954-46ce-9a21-30e4e0b74375 service swift] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:40.873127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215fd2f-e954-46ce-9a21-30e4e0b74375 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:40.881112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215fd2f-e954-46ce-9a21-30e4e0b74375 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:53:40.882717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215fd2f-e954-46ce-9a21-30e4e0b74375 service swift] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:53:40.897641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1213/2413] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:53:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:53:41.226231 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9468bb-8ccb-42e8-ac9b-2020b530d828 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:53:41.235706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9468bb-8ccb-42e8-ac9b-2020b530d828 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:53:41.239260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e0190-dbff-4bdb-a4b4-f7ebea96082f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:53:41.239888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0190-dbff-4bdb-a4b4-f7ebea96082f service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:41.240430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0190-dbff-4bdb-a4b4-f7ebea96082f service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:41.240702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0190-dbff-4bdb-a4b4-f7ebea96082f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:41.242447 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-563e0190-dbff-4bdb-a4b4-f7ebea96082f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:53:41.301898 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e0190-dbff-4bdb-a4b4-f7ebea96082f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:53:41.303367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e0190-dbff-4bdb-a4b4-f7ebea96082f service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:53:41.313235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1201/2414] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:53:48.538479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215fd2f-e954-46ce-9a21-30e4e0b74375 service swift] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:53:48.539987 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f215fd2f-e954-46ce-9a21-30e4e0b74375 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:53:48.554191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215fd2f-e954-46ce-9a21-30e4e0b74375 service swift] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:53:48.558886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:53:48.559720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:48.560007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:48.560272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] PATH_INFO: `/v3/users/6d5f259e0b98457ea6b6b88d886c813d` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:48.561471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d5f259e0b98457ea6b6b88d886c813d)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:53:48.563415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:53:48.610740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d5f259e0b98457ea6b6b88d886c813d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:48.624234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d5f259e0b98457ea6b6b88d886c813d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:48.624969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d5f259e0b98457ea6b6b88d886c813d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:48.625565 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d5f259e0b98457ea6b6b88d886c813d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:48.632015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d5f259e0b98457ea6b6b88d886c813d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:48.645336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1214/2415] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:53:48 2022] DELETE /identity/v3/users/6d5f259e0b98457ea6b6b88d886c813d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:53:48.815744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e0190-dbff-4bdb-a4b4-f7ebea96082f service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:53:48.826089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e0190-dbff-4bdb-a4b4-f7ebea96082f service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:53:48.892238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:53:48.893093 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:48.893379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:48.893656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] PATH_INFO: `/v3/projects/5fba11e8ade54d388361c4c936a43372` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:48.894871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fba11e8ade54d388361c4c936a43372)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:53:48.896779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:53:48.944887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fba11e8ade54d388361c4c936a43372', 'request_id': 'req-fef45b55-2cbd-40b9-a6aa-7b114015e871'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:48.952430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fba11e8ade54d388361c4c936a43372', 'request_id': 'req-fef45b55-2cbd-40b9-a6aa-7b114015e871'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:48.958089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fba11e8ade54d388361c4c936a43372', 'request_id': 'req-fef45b55-2cbd-40b9-a6aa-7b114015e871'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:48.970358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] The token cache is being invalidate because project 5fba11e8ade54d388361c4c936a43372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:53:48.970655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:48.971320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:48.973063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1202/2416] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:53:48 2022] DELETE /identity/v3/projects/5fba11e8ade54d388361c4c936a43372 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:53:48.976862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:53:48.978248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:53:48.991802 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de4186-b44a-4044-9f99-04c9948634d9 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:53:49.051578 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a3d1a-9970-485f-8881-30f63721edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:53:49.052453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3d1a-9970-485f-8881-30f63721edb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:49.052736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3d1a-9970-485f-8881-30f63721edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:49.053014 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3d1a-9970-485f-8881-30f63721edb1 admin admin] PATH_INFO: `/v3/users/e00d2543ce3e4345b2dea72887a924c1` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:49.054198 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a3d1a-9970-485f-8881-30f63721edb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00d2543ce3e4345b2dea72887a924c1)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:53:49.056168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a3d1a-9970-485f-8881-30f63721edb1 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:53:49.101334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-602a3d1a-9970-485f-8881-30f63721edb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00d2543ce3e4345b2dea72887a924c1'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:49.112843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-602a3d1a-9970-485f-8881-30f63721edb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00d2543ce3e4345b2dea72887a924c1'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:49.113517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-602a3d1a-9970-485f-8881-30f63721edb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00d2543ce3e4345b2dea72887a924c1'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:49.114117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-602a3d1a-9970-485f-8881-30f63721edb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00d2543ce3e4345b2dea72887a924c1'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:49.121184 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-602a3d1a-9970-485f-8881-30f63721edb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00d2543ce3e4345b2dea72887a924c1'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:49.133914 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1215/2417] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:53:48 2022] DELETE /identity/v3/users/e00d2543ce3e4345b2dea72887a924c1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:53:49.301978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:53:49.303524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:53:49.319322 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef45b55-2cbd-40b9-a6aa-7b114015e871 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:53:49.374835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:53:49.375607 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:53:49.375886 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:53:49.376163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] PATH_INFO: `/v3/projects/64b1f483c1724e648f27877d52889290` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:53:49.377330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b1f483c1724e648f27877d52889290)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:53:49.379259 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:53:49.423572 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b1f483c1724e648f27877d52889290', 'request_id': 'req-732c0930-60f4-4b01-bc0c-06cd372dcb91'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:49.430622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b1f483c1724e648f27877d52889290', 'request_id': 'req-732c0930-60f4-4b01-bc0c-06cd372dcb91'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:49.436966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b1f483c1724e648f27877d52889290', 'request_id': 'req-732c0930-60f4-4b01-bc0c-06cd372dcb91'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:49.447562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] The token cache is being invalidate because project 64b1f483c1724e648f27877d52889290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:53:49.447856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:49.448476 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:53:49.449988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1203/2418] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:53:49 2022] DELETE /identity/v3/projects/64b1f483c1724e648f27877d52889290 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:23.340973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab8fb5-1214-4fd9-9e9d-1c37080e4ac4 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:23.341502 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab8fb5-1214-4fd9-9e9d-1c37080e4ac4 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:23.341502 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab8fb5-1214-4fd9-9e9d-1c37080e4ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:23.361542 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-73ab8fb5-1214-4fd9-9e9d-1c37080e4ac4 None None] MFA Rules not processed for user `568f6783dd4d43398a70a9ffa58ff660`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:23.363188 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-73ab8fb5-1214-4fd9-9e9d-1c37080e4ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:23.429274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1216/2419] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:28.935247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:28.936644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:29.006783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c0930-60f4-4b01-bc0c-06cd372dcb91 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:29.011733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722b95a-418a-400c-93dc-6b75c8dff8c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fac310b740a40718191e905723222ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:29.012372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722b95a-418a-400c-93dc-6b75c8dff8c5 service placement] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:29.012650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722b95a-418a-400c-93dc-6b75c8dff8c5 service placement] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:29.012921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722b95a-418a-400c-93dc-6b75c8dff8c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:29.014752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b722b95a-418a-400c-93dc-6b75c8dff8c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:29.026990 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722b95a-418a-400c-93dc-6b75c8dff8c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:29.028671 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722b95a-418a-400c-93dc-6b75c8dff8c5 service placement] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:29.039523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1204/2420] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:54:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:54:33.809516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab8fb5-1214-4fd9-9e9d-1c37080e4ac4 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:33.810984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-73ab8fb5-1214-4fd9-9e9d-1c37080e4ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:33.893197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab8fb5-1214-4fd9-9e9d-1c37080e4ac4 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:33.894097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8221d65-c1d1-4a22-88c2-bed0f87b32b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:33.894858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8221d65-c1d1-4a22-88c2-bed0f87b32b3 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:33.895140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8221d65-c1d1-4a22-88c2-bed0f87b32b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:33.895414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8221d65-c1d1-4a22-88c2-bed0f87b32b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:33.897216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c8221d65-c1d1-4a22-88c2-bed0f87b32b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:33.975316 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8221d65-c1d1-4a22-88c2-bed0f87b32b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:33.976831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8221d65-c1d1-4a22-88c2-bed0f87b32b3 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:33.987890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1217/2421] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:54:37.558688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722b95a-418a-400c-93dc-6b75c8dff8c5 service placement] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:37.560236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b722b95a-418a-400c-93dc-6b75c8dff8c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:37.574637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722b95a-418a-400c-93dc-6b75c8dff8c5 service placement] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:37.580139 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100de31-61a4-4bfb-bf81-c4776ea326df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:37.581001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100de31-61a4-4bfb-bf81-c4776ea326df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:37.581282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100de31-61a4-4bfb-bf81-c4776ea326df admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:37.581556 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100de31-61a4-4bfb-bf81-c4776ea326df admin admin] PATH_INFO: `/v3/users/7b896317d96a40d6a137db0dcf5f98f2` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:37.582943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100de31-61a4-4bfb-bf81-c4776ea326df admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b896317d96a40d6a137db0dcf5f98f2)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:37.584867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100de31-61a4-4bfb-bf81-c4776ea326df admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:37.631049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e100de31-61a4-4bfb-bf81-c4776ea326df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b896317d96a40d6a137db0dcf5f98f2'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:37.643288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e100de31-61a4-4bfb-bf81-c4776ea326df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b896317d96a40d6a137db0dcf5f98f2'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:37.643983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e100de31-61a4-4bfb-bf81-c4776ea326df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b896317d96a40d6a137db0dcf5f98f2'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:37.644593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e100de31-61a4-4bfb-bf81-c4776ea326df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b896317d96a40d6a137db0dcf5f98f2'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:37.651700 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e100de31-61a4-4bfb-bf81-c4776ea326df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b896317d96a40d6a137db0dcf5f98f2'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:37.667428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1205/2422] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:54:37 2022] DELETE /identity/v3/users/7b896317d96a40d6a137db0dcf5f98f2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:37.852112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8221d65-c1d1-4a22-88c2-bed0f87b32b3 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:37.863619 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8221d65-c1d1-4a22-88c2-bed0f87b32b3 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:37.922689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:37.923615 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:37.923874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:37.924172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] PATH_INFO: `/v3/projects/5d2517d5440a4d30949f3dd36a46d813` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:37.925481 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d2517d5440a4d30949f3dd36a46d813)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:37.927410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:37.973483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d2517d5440a4d30949f3dd36a46d813', 'request_id': 'req-b58bd756-1442-4cc8-800a-ba7dc2f32c94'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:37.979415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d2517d5440a4d30949f3dd36a46d813', 'request_id': 'req-b58bd756-1442-4cc8-800a-ba7dc2f32c94'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:37.987718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d2517d5440a4d30949f3dd36a46d813', 'request_id': 'req-b58bd756-1442-4cc8-800a-ba7dc2f32c94'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:37.998219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] The token cache is being invalidate because project 5d2517d5440a4d30949f3dd36a46d813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:54:37.998538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:37.999288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b58bd756-1442-4cc8-800a-ba7dc2f32c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:38.001469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1218/2423] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:54:37 2022] DELETE /identity/v3/projects/5d2517d5440a4d30949f3dd36a46d813 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:38.007061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa469e0-f198-4c61-b77e-4fbbc93ea78e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:38.007454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa469e0-f198-4c61-b77e-4fbbc93ea78e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:38.007819 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa469e0-f198-4c61-b77e-4fbbc93ea78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:38.027412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-2aa469e0-f198-4c61-b77e-4fbbc93ea78e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:38.028611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2aa469e0-f198-4c61-b77e-4fbbc93ea78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:38.087153 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1206/2424] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:38.095223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3de975-f63e-425b-9ec3-086abe7521a6 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:38.095446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3de975-f63e-425b-9ec3-086abe7521a6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:38.095719 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3de975-f63e-425b-9ec3-086abe7521a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:38.114369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-5d3de975-f63e-425b-9ec3-086abe7521a6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:38.115595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-5d3de975-f63e-425b-9ec3-086abe7521a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:38.123679 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1219/2425] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:54:38.128522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa469e0-f198-4c61-b77e-4fbbc93ea78e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:38.138069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa469e0-f198-4c61-b77e-4fbbc93ea78e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:38.143251 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b98248-6702-42ee-8f5b-7e8823f6b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:38.143906 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b98248-6702-42ee-8f5b-7e8823f6b055 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:38.144187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b98248-6702-42ee-8f5b-7e8823f6b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:38.144464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b98248-6702-42ee-8f5b-7e8823f6b055 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:38.145191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b98248-6702-42ee-8f5b-7e8823f6b055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:54:38.145493 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b98248-6702-42ee-8f5b-7e8823f6b055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:38.147214 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b98248-6702-42ee-8f5b-7e8823f6b055 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:38.158764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1207/2426] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:54:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:54:38.163286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3de975-f63e-425b-9ec3-086abe7521a6 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:38.172101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3de975-f63e-425b-9ec3-086abe7521a6 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:38.176774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdd5d6-8258-465b-8876-29da6d9f7e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:38.177427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdd5d6-8258-465b-8876-29da6d9f7e78 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:38.177710 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdd5d6-8258-465b-8876-29da6d9f7e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:38.177984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdd5d6-8258-465b-8876-29da6d9f7e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:38.178718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdd5d6-8258-465b-8876-29da6d9f7e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:38.180621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdd5d6-8258-465b-8876-29da6d9f7e78 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:38.216640 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1220/2427] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:54:38 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:54:38.221311 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b98248-6702-42ee-8f5b-7e8823f6b055 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:38.231438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b98248-6702-42ee-8f5b-7e8823f6b055 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:38.287655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378e929-cd5e-4539-bfcd-24955755401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:38.288316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e929-cd5e-4539-bfcd-24955755401f admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:38.288604 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e929-cd5e-4539-bfcd-24955755401f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:38.288878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e929-cd5e-4539-bfcd-24955755401f admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:38.289586 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378e929-cd5e-4539-bfcd-24955755401f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:38.291765 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378e929-cd5e-4539-bfcd-24955755401f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:38.316007 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1208/2428] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:54:38 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:54:38.317203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdd5d6-8258-465b-8876-29da6d9f7e78 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:38.327287 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdd5d6-8258-465b-8876-29da6d9f7e78 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:38.333006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faabb4-2136-469a-bd87-9b6d186144e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:38.333886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faabb4-2136-469a-bd87-9b6d186144e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:38.334173 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faabb4-2136-469a-bd87-9b6d186144e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:38.334512 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faabb4-2136-469a-bd87-9b6d186144e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:38.335455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faabb4-2136-469a-bd87-9b6d186144e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:38.337095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5faabb4-2136-469a-bd87-9b6d186144e7 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:38.347946 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1221/2429] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:54:38.351991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378e929-cd5e-4539-bfcd-24955755401f admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:38.363044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378e929-cd5e-4539-bfcd-24955755401f admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:38.368236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa448754-c585-43d2-a849-228a5c64e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:38.368901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa448754-c585-43d2-a849-228a5c64e1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:38.369183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa448754-c585-43d2-a849-228a5c64e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:38.369460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa448754-c585-43d2-a849-228a5c64e1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:38.370202 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa448754-c585-43d2-a849-228a5c64e1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:38.371823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa448754-c585-43d2-a849-228a5c64e1b8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:38.385004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1209/2430] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:54:38.386128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faabb4-2136-469a-bd87-9b6d186144e7 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:38.396547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faabb4-2136-469a-bd87-9b6d186144e7 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:38.401658 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cde1b-9fbf-439b-85eb-00d414f5d9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:38.402648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cde1b-9fbf-439b-85eb-00d414f5d9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:38.403002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cde1b-9fbf-439b-85eb-00d414f5d9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:38.403344 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cde1b-9fbf-439b-85eb-00d414f5d9a5 admin admin] PATH_INFO: `/v3/projects/701531f23a0b4fb5b8002f9188e071e1/users/a4347bafd7e943acbefc1cdabd3615ef/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:38.422169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cde1b-9fbf-439b-85eb-00d414f5d9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=701531f23a0b4fb5b8002f9188e071e1, user_id=a4347bafd7e943acbefc1cdabd3615ef, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:38.424915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cde1b-9fbf-439b-85eb-00d414f5d9a5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:38.438338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1222/2431] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:54:38 2022] PUT /identity/v3/projects/701531f23a0b4fb5b8002f9188e071e1/users/a4347bafd7e943acbefc1cdabd3615ef/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:38.449237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9cf3-696f-4f5c-bcc1-6a821aa4e7f0 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:38.449530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9cf3-696f-4f5c-bcc1-6a821aa4e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:38.449812 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9cf3-696f-4f5c-bcc1-6a821aa4e7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:38.477103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e83f9cf3-696f-4f5c-bcc1-6a821aa4e7f0 None None] MFA Rules not processed for user `a4347bafd7e943acbefc1cdabd3615ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:38.478339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e83f9cf3-696f-4f5c-bcc1-6a821aa4e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:38.542217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1210/2432] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:38.553144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cde1b-9fbf-439b-85eb-00d414f5d9a5 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:38.554924 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ae7cde1b-9fbf-439b-85eb-00d414f5d9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:38.610789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cde1b-9fbf-439b-85eb-00d414f5d9a5 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:38.614576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c775b8-2753-4857-8ecc-60f7ccb6f516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:38.615231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c775b8-2753-4857-8ecc-60f7ccb6f516 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:38.615517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c775b8-2753-4857-8ecc-60f7ccb6f516 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:38.616057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c775b8-2753-4857-8ecc-60f7ccb6f516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:38.624846 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c775b8-2753-4857-8ecc-60f7ccb6f516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:38.626293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c775b8-2753-4857-8ecc-60f7ccb6f516 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:38.635299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1223/2433] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:54:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:54:46.877350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f9cf3-696f-4f5c-bcc1-6a821aa4e7f0 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:46.937162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f9cf3-696f-4f5c-bcc1-6a821aa4e7f0 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:46.941594 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:46.942488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:46.942768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:46.943035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] PATH_INFO: `/v3/users/a4347bafd7e943acbefc1cdabd3615ef` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:46.944199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4347bafd7e943acbefc1cdabd3615ef)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:46.946196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:46.989489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4347bafd7e943acbefc1cdabd3615ef'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:47.000756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4347bafd7e943acbefc1cdabd3615ef'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:47.001405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4347bafd7e943acbefc1cdabd3615ef'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:47.002004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4347bafd7e943acbefc1cdabd3615ef'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:47.008504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4347bafd7e943acbefc1cdabd3615ef'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:47.020920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1211/2434] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:54:46 2022] DELETE /identity/v3/users/a4347bafd7e943acbefc1cdabd3615ef => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:47.025553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb30e-6cd4-4e13-9728-68d10c0ec97b None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.026033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb30e-6cd4-4e13-9728-68d10c0ec97b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.026147 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb30e-6cd4-4e13-9728-68d10c0ec97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:47.043281 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-aa3eb30e-6cd4-4e13-9728-68d10c0ec97b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:47.044495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-aa3eb30e-6cd4-4e13-9728-68d10c0ec97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:47.101018 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1224/2435] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:47.110670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:47.112085 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:47.167115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a35170-e210-4ae5-a662-eb1b0f82dcb7 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:47.170778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d217d-bd13-49bc-ae38-e038e7871948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:47.171631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d217d-bd13-49bc-ae38-e038e7871948 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.171916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d217d-bd13-49bc-ae38-e038e7871948 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.172192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d217d-bd13-49bc-ae38-e038e7871948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:47.181018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d217d-bd13-49bc-ae38-e038e7871948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:47.182500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d217d-bd13-49bc-ae38-e038e7871948 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:47.192392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1212/2436] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:54:47.455160 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb30e-6cd4-4e13-9728-68d10c0ec97b None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:47.456595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-aa3eb30e-6cd4-4e13-9728-68d10c0ec97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:47.468959 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb30e-6cd4-4e13-9728-68d10c0ec97b None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:47.474847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:47.475711 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.475998 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.476329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] PATH_INFO: `/v3/projects/701531f23a0b4fb5b8002f9188e071e1` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:47.478152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=701531f23a0b4fb5b8002f9188e071e1)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:47.480312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:47.527914 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701531f23a0b4fb5b8002f9188e071e1', 'request_id': 'req-0462d1a2-af17-45c1-ab5f-fba726938538'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:47.534617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701531f23a0b4fb5b8002f9188e071e1', 'request_id': 'req-0462d1a2-af17-45c1-ab5f-fba726938538'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:47.542196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701531f23a0b4fb5b8002f9188e071e1', 'request_id': 'req-0462d1a2-af17-45c1-ab5f-fba726938538'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:47.552961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] The token cache is being invalidate because project 701531f23a0b4fb5b8002f9188e071e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:54:47.553253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:47.553876 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0462d1a2-af17-45c1-ab5f-fba726938538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:47.555490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1225/2437] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:54:47 2022] DELETE /identity/v3/projects/701531f23a0b4fb5b8002f9188e071e1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:47.560492 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d4f2-e0c8-4902-aac5-4a928695ac51 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.560809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d4f2-e0c8-4902-aac5-4a928695ac51 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.561085 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605d4f2-e0c8-4902-aac5-4a928695ac51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:47.579241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-d605d4f2-e0c8-4902-aac5-4a928695ac51 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:47.580417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d605d4f2-e0c8-4902-aac5-4a928695ac51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:47.636347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1213/2438] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:47.643922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac9b94-0c7d-44ba-b4e7-f2033eec1329 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.644215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac9b94-0c7d-44ba-b4e7-f2033eec1329 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.644498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac9b94-0c7d-44ba-b4e7-f2033eec1329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:47.663723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-26ac9b94-0c7d-44ba-b4e7-f2033eec1329 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:47.664916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-26ac9b94-0c7d-44ba-b4e7-f2033eec1329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:47.673446 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1226/2439] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:47.677456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605d4f2-e0c8-4902-aac5-4a928695ac51 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:47.687390 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605d4f2-e0c8-4902-aac5-4a928695ac51 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:47.691860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d2a24-3e36-4b98-ae2e-17b80142d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:47.692496 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d2a24-3e36-4b98-ae2e-17b80142d4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.692804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d2a24-3e36-4b98-ae2e-17b80142d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.693052 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d2a24-3e36-4b98-ae2e-17b80142d4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:47.693768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d2a24-3e36-4b98-ae2e-17b80142d4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:54:47.694069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d2a24-3e36-4b98-ae2e-17b80142d4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:47.695715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d2a24-3e36-4b98-ae2e-17b80142d4a7 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:47.706734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1214/2440] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:54:47.710765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac9b94-0c7d-44ba-b4e7-f2033eec1329 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:47.719694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac9b94-0c7d-44ba-b4e7-f2033eec1329 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:47.724294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1a591-b66d-453f-8410-08e543cde6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:47.724932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1a591-b66d-453f-8410-08e543cde6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.725213 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1a591-b66d-453f-8410-08e543cde6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.725490 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1a591-b66d-453f-8410-08e543cde6f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:47.726178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1a591-b66d-453f-8410-08e543cde6f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:47.728089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1a591-b66d-453f-8410-08e543cde6f8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:47.754123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1227/2441] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:54:47 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:54:47.758188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d2a24-3e36-4b98-ae2e-17b80142d4a7 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:47.768709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d2a24-3e36-4b98-ae2e-17b80142d4a7 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:47.823912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985850ba-1a91-4aa4-a702-621c8ccddc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:47.824567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985850ba-1a91-4aa4-a702-621c8ccddc69 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.824853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985850ba-1a91-4aa4-a702-621c8ccddc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.825137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985850ba-1a91-4aa4-a702-621c8ccddc69 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:47.825816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985850ba-1a91-4aa4-a702-621c8ccddc69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:47.828244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985850ba-1a91-4aa4-a702-621c8ccddc69 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:47.849547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1215/2442] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:54:47 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:54:47.853830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1a591-b66d-453f-8410-08e543cde6f8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:47.864931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1a591-b66d-453f-8410-08e543cde6f8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:47.869829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5306688-80e1-4a51-8a89-288e5f2516cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:47.870508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306688-80e1-4a51-8a89-288e5f2516cd admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.870787 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306688-80e1-4a51-8a89-288e5f2516cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.871056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5306688-80e1-4a51-8a89-288e5f2516cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:47.871772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5306688-80e1-4a51-8a89-288e5f2516cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:47.873423 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5306688-80e1-4a51-8a89-288e5f2516cd admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:47.884105 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1228/2443] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:54:47.888139 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985850ba-1a91-4aa4-a702-621c8ccddc69 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:47.898570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985850ba-1a91-4aa4-a702-621c8ccddc69 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:47.903222 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d58213-ad9e-4613-8e00-6fe3b04c7d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:47.903876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d58213-ad9e-4613-8e00-6fe3b04c7d52 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.904161 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d58213-ad9e-4613-8e00-6fe3b04c7d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.904443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d58213-ad9e-4613-8e00-6fe3b04c7d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:47.905705 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d58213-ad9e-4613-8e00-6fe3b04c7d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:47.907823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d58213-ad9e-4613-8e00-6fe3b04c7d52 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:47.917691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1216/2444] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:54:47.922450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5306688-80e1-4a51-8a89-288e5f2516cd admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:47.932356 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5306688-80e1-4a51-8a89-288e5f2516cd admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:47.937293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107a945-98d5-461e-ab3a-1461c1c32975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:47.938155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107a945-98d5-461e-ab3a-1461c1c32975 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.938483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107a945-98d5-461e-ab3a-1461c1c32975 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.938762 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107a945-98d5-461e-ab3a-1461c1c32975 admin admin] PATH_INFO: `/v3/projects/2e239aaa6c524e56bb7136f5fb732970/users/e0197a354b0b4b85809bbd0295aee589/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:47.953424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107a945-98d5-461e-ab3a-1461c1c32975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e239aaa6c524e56bb7136f5fb732970, user_id=e0197a354b0b4b85809bbd0295aee589, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:47.956219 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107a945-98d5-461e-ab3a-1461c1c32975 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:47.969155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1229/2445] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:54:47 2022] PUT /identity/v3/projects/2e239aaa6c524e56bb7136f5fb732970/users/e0197a354b0b4b85809bbd0295aee589/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:54:47.979399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db162b-6246-427e-a906-9efc133bd303 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:47.979709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db162b-6246-427e-a906-9efc133bd303 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:47.980010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db162b-6246-427e-a906-9efc133bd303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:48.006836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-06db162b-6246-427e-a906-9efc133bd303 None None] MFA Rules not processed for user `e0197a354b0b4b85809bbd0295aee589`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:48.008047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-06db162b-6246-427e-a906-9efc133bd303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:48.071458 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1217/2446] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:48.076042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107a945-98d5-461e-ab3a-1461c1c32975 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:48.137351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107a945-98d5-461e-ab3a-1461c1c32975 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:48.142614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c0001-540d-4dc0-8248-8a0aa6e485a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:48.143207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c0001-540d-4dc0-8248-8a0aa6e485a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:48.143487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c0001-540d-4dc0-8248-8a0aa6e485a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:48.143758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c0001-540d-4dc0-8248-8a0aa6e485a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:48.144436 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c0001-540d-4dc0-8248-8a0aa6e485a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:48.146339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c0001-540d-4dc0-8248-8a0aa6e485a8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:48.169941 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1230/2447] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:54:48 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:54:48.174201 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db162b-6246-427e-a906-9efc133bd303 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:48.184617 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db162b-6246-427e-a906-9efc133bd303 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:48.238112 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ff64b-7137-440b-b913-93d3c56acb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:48.238796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ff64b-7137-440b-b913-93d3c56acb9d admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:48.239076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ff64b-7137-440b-b913-93d3c56acb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:48.239347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ff64b-7137-440b-b913-93d3c56acb9d admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:48.240028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ff64b-7137-440b-b913-93d3c56acb9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:48.242215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ff64b-7137-440b-b913-93d3c56acb9d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:48.262379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1218/2448] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:54:48 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:54:48.267431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c0001-540d-4dc0-8248-8a0aa6e485a8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:48.277485 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c0001-540d-4dc0-8248-8a0aa6e485a8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:48.282579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fc439-2ca7-4473-8514-62958f95bf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:48.283227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fc439-2ca7-4473-8514-62958f95bf70 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:48.283512 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fc439-2ca7-4473-8514-62958f95bf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:48.283786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fc439-2ca7-4473-8514-62958f95bf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:48.284516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fc439-2ca7-4473-8514-62958f95bf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:48.286128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fc439-2ca7-4473-8514-62958f95bf70 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:48.297505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1231/2449] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:54:48.301615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ff64b-7137-440b-b913-93d3c56acb9d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:48.311265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ff64b-7137-440b-b913-93d3c56acb9d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:48.316382 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b668b-ecca-4e54-9219-8824d25b92a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:48.317237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b668b-ecca-4e54-9219-8824d25b92a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:48.317514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b668b-ecca-4e54-9219-8824d25b92a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:48.317781 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b668b-ecca-4e54-9219-8824d25b92a6 admin admin] PATH_INFO: `/v3/projects/9d48a62828604f4998a7784ebfed7e99/users/a0837f61c1294c16a46285b6cad7f608/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:48.332218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b668b-ecca-4e54-9219-8824d25b92a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d48a62828604f4998a7784ebfed7e99, user_id=a0837f61c1294c16a46285b6cad7f608, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:48.334891 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b668b-ecca-4e54-9219-8824d25b92a6 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:48.347404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1219/2450] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:54:48 2022] PUT /identity/v3/projects/9d48a62828604f4998a7784ebfed7e99/users/a0837f61c1294c16a46285b6cad7f608/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:48.351418 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fc439-2ca7-4473-8514-62958f95bf70 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:48.361714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fc439-2ca7-4473-8514-62958f95bf70 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:48.414756 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f07f1d-6ef2-4a6a-b54e-7169ab82d07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:48.415345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07f1d-6ef2-4a6a-b54e-7169ab82d07b admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:48.415627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07f1d-6ef2-4a6a-b54e-7169ab82d07b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:48.415904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07f1d-6ef2-4a6a-b54e-7169ab82d07b admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:48.416623 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f07f1d-6ef2-4a6a-b54e-7169ab82d07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:48.418247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f07f1d-6ef2-4a6a-b54e-7169ab82d07b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:48.428279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1232/2451] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:54:48.432615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b668b-ecca-4e54-9219-8824d25b92a6 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:48.443441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b668b-ecca-4e54-9219-8824d25b92a6 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:48.448018 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e59ae8-6ad6-43ac-b17e-6185b0dd7c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:48.448920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e59ae8-6ad6-43ac-b17e-6185b0dd7c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:48.449201 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e59ae8-6ad6-43ac-b17e-6185b0dd7c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:48.449475 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e59ae8-6ad6-43ac-b17e-6185b0dd7c8d admin admin] PATH_INFO: `/v3/projects/9d48a62828604f4998a7784ebfed7e99/users/a0837f61c1294c16a46285b6cad7f608/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:48.451482 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e59ae8-6ad6-43ac-b17e-6185b0dd7c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d48a62828604f4998a7784ebfed7e99, user_id=a0837f61c1294c16a46285b6cad7f608, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:48.454223 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e59ae8-6ad6-43ac-b17e-6185b0dd7c8d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:48.464205 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1220/2452] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:54:48 2022] PUT /identity/v3/projects/9d48a62828604f4998a7784ebfed7e99/users/a0837f61c1294c16a46285b6cad7f608/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:48.475913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930645-7f62-4b5f-8560-a60de6b3b1f4 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:48.476205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930645-7f62-4b5f-8560-a60de6b3b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:48.476488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38930645-7f62-4b5f-8560-a60de6b3b1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:48.503388 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-38930645-7f62-4b5f-8560-a60de6b3b1f4 None None] MFA Rules not processed for user `a0837f61c1294c16a46285b6cad7f608`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:48.504575 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-38930645-7f62-4b5f-8560-a60de6b3b1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:48.570556 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1233/2453] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:48 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:48.581770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e59ae8-6ad6-43ac-b17e-6185b0dd7c8d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:48.583547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-00e59ae8-6ad6-43ac-b17e-6185b0dd7c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:48.639545 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e59ae8-6ad6-43ac-b17e-6185b0dd7c8d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:48.643313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434838c-01c2-41f2-99d8-3d403cff622a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:48.643945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434838c-01c2-41f2-99d8-3d403cff622a service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:48.644222 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434838c-01c2-41f2-99d8-3d403cff622a service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:48.644494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434838c-01c2-41f2-99d8-3d403cff622a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:48.653476 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434838c-01c2-41f2-99d8-3d403cff622a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:48.654938 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434838c-01c2-41f2-99d8-3d403cff622a service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:48.664736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1221/2454] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:54:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:54:48.735808 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38930645-7f62-4b5f-8560-a60de6b3b1f4 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:48.745475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38930645-7f62-4b5f-8560-a60de6b3b1f4 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:48.749037 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72d076-31ae-4ff8-91fd-f72dd7fa8243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:48.749661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72d076-31ae-4ff8-91fd-f72dd7fa8243 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:48.749940 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72d076-31ae-4ff8-91fd-f72dd7fa8243 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:48.750214 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72d076-31ae-4ff8-91fd-f72dd7fa8243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:48.806740 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72d076-31ae-4ff8-91fd-f72dd7fa8243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:48.808172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72d076-31ae-4ff8-91fd-f72dd7fa8243 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:48.817200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1234/2455] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:54:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:54:51.490098 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434838c-01c2-41f2-99d8-3d403cff622a service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:51.550383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434838c-01c2-41f2-99d8-3d403cff622a service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:51.554902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:51.555752 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:51.556030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:51.556306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] PATH_INFO: `/v3/users/e0197a354b0b4b85809bbd0295aee589` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:51.557480 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0197a354b0b4b85809bbd0295aee589)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:51.559436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:51.604960 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0197a354b0b4b85809bbd0295aee589'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:51.616960 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0197a354b0b4b85809bbd0295aee589'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:51.617562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0197a354b0b4b85809bbd0295aee589'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:51.618155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0197a354b0b4b85809bbd0295aee589'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:51.625328 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0197a354b0b4b85809bbd0295aee589'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:51.637060 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1222/2456] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:54:51 2022] DELETE /identity/v3/users/e0197a354b0b4b85809bbd0295aee589 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:51.642327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20c536-03b5-429e-a2e2-a623aff67faa None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:51.642790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20c536-03b5-429e-a2e2-a623aff67faa None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:51.642910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20c536-03b5-429e-a2e2-a623aff67faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:51.659153 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2b20c536-03b5-429e-a2e2-a623aff67faa None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:51.660319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2b20c536-03b5-429e-a2e2-a623aff67faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:51.716763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1235/2457] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:54:51.726809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:51.728184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:51.783162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2f36d-a3e5-4bdd-866b-75d0b1cc8134 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:51.786743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43f6fb-c86f-4546-98dd-0b94eee53fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:51.787404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43f6fb-c86f-4546-98dd-0b94eee53fff service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:51.787682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43f6fb-c86f-4546-98dd-0b94eee53fff service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:51.787956 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43f6fb-c86f-4546-98dd-0b94eee53fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:51.797085 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43f6fb-c86f-4546-98dd-0b94eee53fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:51.798530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43f6fb-c86f-4546-98dd-0b94eee53fff service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:51.807647 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1223/2458] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:54:52.060785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20c536-03b5-429e-a2e2-a623aff67faa None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:52.062940 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2b20c536-03b5-429e-a2e2-a623aff67faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:52.075202 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20c536-03b5-429e-a2e2-a623aff67faa None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:52.080007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:52.081000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:52.081271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:52.081543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] PATH_INFO: `/v3/projects/2e239aaa6c524e56bb7136f5fb732970` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:52.082760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e239aaa6c524e56bb7136f5fb732970)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:52.084657 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:52.131330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e239aaa6c524e56bb7136f5fb732970', 'request_id': 'req-43db929c-fc8c-4491-b20e-00d8ba367bd5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.137144 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e239aaa6c524e56bb7136f5fb732970', 'request_id': 'req-43db929c-fc8c-4491-b20e-00d8ba367bd5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.144458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e239aaa6c524e56bb7136f5fb732970', 'request_id': 'req-43db929c-fc8c-4491-b20e-00d8ba367bd5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.154511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] The token cache is being invalidate because project 2e239aaa6c524e56bb7136f5fb732970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:54:52.154798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.155466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.157035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1236/2459] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:54:52 2022] DELETE /identity/v3/projects/2e239aaa6c524e56bb7136f5fb732970 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:52.162158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43f6fb-c86f-4546-98dd-0b94eee53fff service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:52.172185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43f6fb-c86f-4546-98dd-0b94eee53fff service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:52.225830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38145bc4-5284-4c51-87cb-cfa67578b846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:52.226716 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145bc4-5284-4c51-87cb-cfa67578b846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:52.227041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145bc4-5284-4c51-87cb-cfa67578b846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:52.227313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38145bc4-5284-4c51-87cb-cfa67578b846 admin admin] PATH_INFO: `/v3/users/a0837f61c1294c16a46285b6cad7f608` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:52.228495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145bc4-5284-4c51-87cb-cfa67578b846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0837f61c1294c16a46285b6cad7f608)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:52.230427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38145bc4-5284-4c51-87cb-cfa67578b846 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:52.273966 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-38145bc4-5284-4c51-87cb-cfa67578b846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0837f61c1294c16a46285b6cad7f608'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.285360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-38145bc4-5284-4c51-87cb-cfa67578b846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0837f61c1294c16a46285b6cad7f608'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.286007 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-38145bc4-5284-4c51-87cb-cfa67578b846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0837f61c1294c16a46285b6cad7f608'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.286624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-38145bc4-5284-4c51-87cb-cfa67578b846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0837f61c1294c16a46285b6cad7f608'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.293100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-38145bc4-5284-4c51-87cb-cfa67578b846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0837f61c1294c16a46285b6cad7f608'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.305611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1224/2460] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:54:52 2022] DELETE /identity/v3/users/a0837f61c1294c16a46285b6cad7f608 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:52.565869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:52.567648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:52.581651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db929c-fc8c-4491-b20e-00d8ba367bd5 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:52.637521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:52.638417 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:52.638703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:52.638978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] PATH_INFO: `/v3/projects/9d48a62828604f4998a7784ebfed7e99` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:52.640392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d48a62828604f4998a7784ebfed7e99)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:52.642330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:52.686881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d48a62828604f4998a7784ebfed7e99', 'request_id': 'req-d875df97-42b7-451b-b18f-13bbc30d15e6'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.692592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d48a62828604f4998a7784ebfed7e99', 'request_id': 'req-d875df97-42b7-451b-b18f-13bbc30d15e6'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.699435 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d48a62828604f4998a7784ebfed7e99', 'request_id': 'req-d875df97-42b7-451b-b18f-13bbc30d15e6'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.709236 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] The token cache is being invalidate because project 9d48a62828604f4998a7784ebfed7e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:54:52.709523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.710137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d875df97-42b7-451b-b18f-13bbc30d15e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:52.711932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1237/2461] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:54:52 2022] DELETE /identity/v3/projects/9d48a62828604f4998a7784ebfed7e99 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:54:52.716559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bb2c4-3646-4057-9407-fa8cedbf588f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:52.717011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bb2c4-3646-4057-9407-fa8cedbf588f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:52.717107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bb2c4-3646-4057-9407-fa8cedbf588f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:52.736203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-427bb2c4-3646-4057-9407-fa8cedbf588f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:52.737394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-427bb2c4-3646-4057-9407-fa8cedbf588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:52.794036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1225/2462] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:52.801659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef66eac-7783-4c72-87b5-cf915732e1b9 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:52.801947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef66eac-7783-4c72-87b5-cf915732e1b9 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:52.802222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef66eac-7783-4c72-87b5-cf915732e1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:52.819720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4ef66eac-7783-4c72-87b5-cf915732e1b9 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:52.820894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4ef66eac-7783-4c72-87b5-cf915732e1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:52.829453 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1238/2463] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:52.834770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bb2c4-3646-4057-9407-fa8cedbf588f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:52.847061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bb2c4-3646-4057-9407-fa8cedbf588f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:52.851642 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cd576-dad7-417f-bafb-f182f68df59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:52.852293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cd576-dad7-417f-bafb-f182f68df59b admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:52.852609 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cd576-dad7-417f-bafb-f182f68df59b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:52.852887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cd576-dad7-417f-bafb-f182f68df59b admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:52.853691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cd576-dad7-417f-bafb-f182f68df59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:54:52.853997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cd576-dad7-417f-bafb-f182f68df59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:52.855654 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cd576-dad7-417f-bafb-f182f68df59b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:52.867252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1226/2464] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:54:52.871534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef66eac-7783-4c72-87b5-cf915732e1b9 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:52.880746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef66eac-7783-4c72-87b5-cf915732e1b9 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:52.885309 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37769e6a-1951-4ffd-a604-d4390067e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:52.885948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37769e6a-1951-4ffd-a604-d4390067e79f admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:52.886225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37769e6a-1951-4ffd-a604-d4390067e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:52.886531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37769e6a-1951-4ffd-a604-d4390067e79f admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:52.887227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37769e6a-1951-4ffd-a604-d4390067e79f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:52.889112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37769e6a-1951-4ffd-a604-d4390067e79f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:52.914120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1239/2465] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:54:52 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:54:52.918302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cd576-dad7-417f-bafb-f182f68df59b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:52.928598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cd576-dad7-417f-bafb-f182f68df59b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:52.986736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03433e-302c-49cc-a8a5-77553c458ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:52.987399 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03433e-302c-49cc-a8a5-77553c458ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:52.987682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03433e-302c-49cc-a8a5-77553c458ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:52.987954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03433e-302c-49cc-a8a5-77553c458ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:52.988642 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03433e-302c-49cc-a8a5-77553c458ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:52.990605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03433e-302c-49cc-a8a5-77553c458ca3 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:53.009454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1227/2466] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:54:52 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:54:53.013531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37769e6a-1951-4ffd-a604-d4390067e79f admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:53.024013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37769e6a-1951-4ffd-a604-d4390067e79f admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:53.028563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1028a90-8232-46e9-a24d-578acb0f41f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:53.029205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1028a90-8232-46e9-a24d-578acb0f41f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.029484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1028a90-8232-46e9-a24d-578acb0f41f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.029755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1028a90-8232-46e9-a24d-578acb0f41f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.031334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1028a90-8232-46e9-a24d-578acb0f41f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:53.032916 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1028a90-8232-46e9-a24d-578acb0f41f8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:53.042842 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1240/2467] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:54:53.046764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03433e-302c-49cc-a8a5-77553c458ca3 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:53.056514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03433e-302c-49cc-a8a5-77553c458ca3 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:53.061163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67bb52-ee21-414a-8d57-ff9d1b68ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:53.061833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67bb52-ee21-414a-8d57-ff9d1b68ddb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.062110 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67bb52-ee21-414a-8d57-ff9d1b68ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.062421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67bb52-ee21-414a-8d57-ff9d1b68ddb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.063138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67bb52-ee21-414a-8d57-ff9d1b68ddb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:53.064750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67bb52-ee21-414a-8d57-ff9d1b68ddb8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:53.074253 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1228/2468] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:54:53.078835 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1028a90-8232-46e9-a24d-578acb0f41f8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:53.088560 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1028a90-8232-46e9-a24d-578acb0f41f8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:53.093791 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793bf92-25db-4a1f-9b30-695c9da7f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:53.094684 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793bf92-25db-4a1f-9b30-695c9da7f7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.094967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793bf92-25db-4a1f-9b30-695c9da7f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.095243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793bf92-25db-4a1f-9b30-695c9da7f7dd admin admin] PATH_INFO: `/v3/projects/ef4d22401f854baca2bdd9cdc0710466/users/909bf75e83ee43cca962beb38fe90b17/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.109516 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793bf92-25db-4a1f-9b30-695c9da7f7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4d22401f854baca2bdd9cdc0710466, user_id=909bf75e83ee43cca962beb38fe90b17, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:53.112423 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5793bf92-25db-4a1f-9b30-695c9da7f7dd admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:53.125177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1241/2469] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:54:53 2022] PUT /identity/v3/projects/ef4d22401f854baca2bdd9cdc0710466/users/909bf75e83ee43cca962beb38fe90b17/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:53.135300 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800b1f8-9f17-415a-bb43-40e274d1c0c7 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.135594 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800b1f8-9f17-415a-bb43-40e274d1c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.135876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800b1f8-9f17-415a-bb43-40e274d1c0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.161849 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-f800b1f8-9f17-415a-bb43-40e274d1c0c7 None None] MFA Rules not processed for user `909bf75e83ee43cca962beb38fe90b17`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:53.163073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f800b1f8-9f17-415a-bb43-40e274d1c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:53.224796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1229/2470] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:53.229191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793bf92-25db-4a1f-9b30-695c9da7f7dd admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:53.289313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5793bf92-25db-4a1f-9b30-695c9da7f7dd admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:53.293857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01a2ae-7d51-41bd-a19e-e8d42f06c1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:53.294530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01a2ae-7d51-41bd-a19e-e8d42f06c1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.294811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01a2ae-7d51-41bd-a19e-e8d42f06c1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.295082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a01a2ae-7d51-41bd-a19e-e8d42f06c1b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.295808 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01a2ae-7d51-41bd-a19e-e8d42f06c1b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:53.297689 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a01a2ae-7d51-41bd-a19e-e8d42f06c1b9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:53.322181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1242/2471] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:54:53 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:54:53.326235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800b1f8-9f17-415a-bb43-40e274d1c0c7 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:53.337278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800b1f8-9f17-415a-bb43-40e274d1c0c7 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:53.391322 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ce455-f9b5-44d0-bc45-71bb9e407199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:53.392635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ce455-f9b5-44d0-bc45-71bb9e407199 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.392917 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ce455-f9b5-44d0-bc45-71bb9e407199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.393194 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ce455-f9b5-44d0-bc45-71bb9e407199 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.393880 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ce455-f9b5-44d0-bc45-71bb9e407199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:53.395823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ce455-f9b5-44d0-bc45-71bb9e407199 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:53.414806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1230/2472] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:54:53 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:54:53.418807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01a2ae-7d51-41bd-a19e-e8d42f06c1b9 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:53.428883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a01a2ae-7d51-41bd-a19e-e8d42f06c1b9 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:53.433471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9e749-aec0-48c4-bf50-103102d31531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:53.434117 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9e749-aec0-48c4-bf50-103102d31531 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.434426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9e749-aec0-48c4-bf50-103102d31531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.434703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9e749-aec0-48c4-bf50-103102d31531 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.435421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9e749-aec0-48c4-bf50-103102d31531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:53.437528 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9e749-aec0-48c4-bf50-103102d31531 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:53.447636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1243/2473] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:54:53.451683 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ce455-f9b5-44d0-bc45-71bb9e407199 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:53.461899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ce455-f9b5-44d0-bc45-71bb9e407199 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:53.466526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597638e-9b16-435f-bf70-e4f14c9da235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:53.467393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597638e-9b16-435f-bf70-e4f14c9da235 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.467795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597638e-9b16-435f-bf70-e4f14c9da235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.468076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597638e-9b16-435f-bf70-e4f14c9da235 admin admin] PATH_INFO: `/v3/projects/911a9965a36944d28573249cca4c578a/users/a979d25e694145cd80be16e606383eea/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.483075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597638e-9b16-435f-bf70-e4f14c9da235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911a9965a36944d28573249cca4c578a, user_id=a979d25e694145cd80be16e606383eea, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:53.485755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597638e-9b16-435f-bf70-e4f14c9da235 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:53.498269 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1231/2474] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:54:53 2022] PUT /identity/v3/projects/911a9965a36944d28573249cca4c578a/users/a979d25e694145cd80be16e606383eea/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:53.502761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9e749-aec0-48c4-bf50-103102d31531 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:53.512361 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9e749-aec0-48c4-bf50-103102d31531 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:53.565725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621ba1-3088-49e5-b60e-491dd26f2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:53.566416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621ba1-3088-49e5-b60e-491dd26f2774 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.566683 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621ba1-3088-49e5-b60e-491dd26f2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.566958 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621ba1-3088-49e5-b60e-491dd26f2774 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.567667 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621ba1-3088-49e5-b60e-491dd26f2774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:53.569260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621ba1-3088-49e5-b60e-491dd26f2774 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:53.578866 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1244/2475] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:54:53.583025 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597638e-9b16-435f-bf70-e4f14c9da235 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:53.593619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597638e-9b16-435f-bf70-e4f14c9da235 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:53.598218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bb787-3948-4717-9a58-550a7a6e87e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:53.599125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bb787-3948-4717-9a58-550a7a6e87e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.599410 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bb787-3948-4717-9a58-550a7a6e87e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.599689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bb787-3948-4717-9a58-550a7a6e87e0 admin admin] PATH_INFO: `/v3/projects/911a9965a36944d28573249cca4c578a/users/a979d25e694145cd80be16e606383eea/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.601696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bb787-3948-4717-9a58-550a7a6e87e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911a9965a36944d28573249cca4c578a, user_id=a979d25e694145cd80be16e606383eea, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:53.604358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bb787-3948-4717-9a58-550a7a6e87e0 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:53.615182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1232/2476] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:54:53 2022] PUT /identity/v3/projects/911a9965a36944d28573249cca4c578a/users/a979d25e694145cd80be16e606383eea/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:53.627780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8473e96-dba6-46ae-98ab-c4d261ad8e2d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.628075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8473e96-dba6-46ae-98ab-c4d261ad8e2d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.628354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8473e96-dba6-46ae-98ab-c4d261ad8e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.654243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d8473e96-dba6-46ae-98ab-c4d261ad8e2d None None] MFA Rules not processed for user `a979d25e694145cd80be16e606383eea`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:53.656026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d8473e96-dba6-46ae-98ab-c4d261ad8e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:53.722979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1245/2477] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:53.734599 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bb787-3948-4717-9a58-550a7a6e87e0 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:53.736304 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-898bb787-3948-4717-9a58-550a7a6e87e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:53.792676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bb787-3948-4717-9a58-550a7a6e87e0 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:53.797282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba64ea4-ca18-4ef4-afcb-8bcf00bc4e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:53.797916 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba64ea4-ca18-4ef4-afcb-8bcf00bc4e9c service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:53.798199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba64ea4-ca18-4ef4-afcb-8bcf00bc4e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:53.798509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba64ea4-ca18-4ef4-afcb-8bcf00bc4e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:53.807409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba64ea4-ca18-4ef4-afcb-8bcf00bc4e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:53.808841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba64ea4-ca18-4ef4-afcb-8bcf00bc4e9c service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:53.819306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1233/2478] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:54:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:54:54.325962 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8473e96-dba6-46ae-98ab-c4d261ad8e2d None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:54.386258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8473e96-dba6-46ae-98ab-c4d261ad8e2d None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:54.391457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:54.392349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:54.392631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:54.392906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] PATH_INFO: `/v3/users/909bf75e83ee43cca962beb38fe90b17` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:54.394096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909bf75e83ee43cca962beb38fe90b17)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:54.396040 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:54.438812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909bf75e83ee43cca962beb38fe90b17'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:54.449839 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909bf75e83ee43cca962beb38fe90b17'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:54.450524 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909bf75e83ee43cca962beb38fe90b17'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:54.451115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909bf75e83ee43cca962beb38fe90b17'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:54.458232 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909bf75e83ee43cca962beb38fe90b17'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:54.471890 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1246/2479] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:54:54 2022] DELETE /identity/v3/users/909bf75e83ee43cca962beb38fe90b17 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:54.476377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9b249-b4cb-40c7-b640-55b861dcd6f2 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:54.476726 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9b249-b4cb-40c7-b640-55b861dcd6f2 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:54.477027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9b249-b4cb-40c7-b640-55b861dcd6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:54.494161 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a4e9b249-b4cb-40c7-b640-55b861dcd6f2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:54.495327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a4e9b249-b4cb-40c7-b640-55b861dcd6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:54.551226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1234/2480] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:54:54.560599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:54.561993 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:54.616513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff64cfe-f115-4112-af5b-9636bc277474 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:54.620211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bac2f-b1b7-483a-a3e2-d573b403b778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:54.620843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bac2f-b1b7-483a-a3e2-d573b403b778 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:54.621124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bac2f-b1b7-483a-a3e2-d573b403b778 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:54.621396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bac2f-b1b7-483a-a3e2-d573b403b778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:54.631029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bac2f-b1b7-483a-a3e2-d573b403b778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:54.632450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bac2f-b1b7-483a-a3e2-d573b403b778 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:54.642244 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1247/2481] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:54:54.898954 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9b249-b4cb-40c7-b640-55b861dcd6f2 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:54.900504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a4e9b249-b4cb-40c7-b640-55b861dcd6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:54.912587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9b249-b4cb-40c7-b640-55b861dcd6f2 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:54.917378 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:54.918454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:54.918738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:54.919011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] PATH_INFO: `/v3/projects/ef4d22401f854baca2bdd9cdc0710466` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:54.920300 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4d22401f854baca2bdd9cdc0710466)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:54.922474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:54.970031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4d22401f854baca2bdd9cdc0710466', 'request_id': 'req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:54.977022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4d22401f854baca2bdd9cdc0710466', 'request_id': 'req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:54.982231 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4d22401f854baca2bdd9cdc0710466', 'request_id': 'req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:54.993782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] The token cache is being invalidate because project ef4d22401f854baca2bdd9cdc0710466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:54:54.994065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:54.994709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:54.996217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1235/2482] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:54:54 2022] DELETE /identity/v3/projects/ef4d22401f854baca2bdd9cdc0710466 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:55.000850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bac2f-b1b7-483a-a3e2-d573b403b778 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:55.010406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bac2f-b1b7-483a-a3e2-d573b403b778 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:55.067935 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6dbdc-8837-44db-ae65-064315e178bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:55.068911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6dbdc-8837-44db-ae65-064315e178bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:55.069277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6dbdc-8837-44db-ae65-064315e178bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:55.069618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6dbdc-8837-44db-ae65-064315e178bd admin admin] PATH_INFO: `/v3/users/a979d25e694145cd80be16e606383eea` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:55.071107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6dbdc-8837-44db-ae65-064315e178bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a979d25e694145cd80be16e606383eea)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:55.073026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6dbdc-8837-44db-ae65-064315e178bd admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:55.118387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-adf6dbdc-8837-44db-ae65-064315e178bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a979d25e694145cd80be16e606383eea'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:55.129536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-adf6dbdc-8837-44db-ae65-064315e178bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a979d25e694145cd80be16e606383eea'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:55.130191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-adf6dbdc-8837-44db-ae65-064315e178bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a979d25e694145cd80be16e606383eea'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:55.130817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-adf6dbdc-8837-44db-ae65-064315e178bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a979d25e694145cd80be16e606383eea'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:55.137234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-adf6dbdc-8837-44db-ae65-064315e178bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a979d25e694145cd80be16e606383eea'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:55.150786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1248/2483] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:54:54 2022] DELETE /identity/v3/users/a979d25e694145cd80be16e606383eea => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:55.410249 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:55.411785 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:55.425578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363ee1a-bdb9-4bce-a55c-ae87e3db8f97 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:55.481969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:55.482868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:55.483229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:55.483505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] PATH_INFO: `/v3/projects/911a9965a36944d28573249cca4c578a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:55.484686 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=911a9965a36944d28573249cca4c578a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:55.486640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:55.530433 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911a9965a36944d28573249cca4c578a', 'request_id': 'req-0949ae60-b319-4c0e-807d-21a49225d7f9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:55.537211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911a9965a36944d28573249cca4c578a', 'request_id': 'req-0949ae60-b319-4c0e-807d-21a49225d7f9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:55.542391 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911a9965a36944d28573249cca4c578a', 'request_id': 'req-0949ae60-b319-4c0e-807d-21a49225d7f9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:55.552871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] The token cache is being invalidate because project 911a9965a36944d28573249cca4c578a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:54:55.553160 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:55.553808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0949ae60-b319-4c0e-807d-21a49225d7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:54:55.555353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1236/2484] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:54:55 2022] DELETE /identity/v3/projects/911a9965a36944d28573249cca4c578a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:55.561830 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da2739-2f6c-4da8-b465-bb3e6c6be545 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:55.562369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da2739-2f6c-4da8-b465-bb3e6c6be545 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:55.562820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da2739-2f6c-4da8-b465-bb3e6c6be545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:55.580685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-92da2739-2f6c-4da8-b465-bb3e6c6be545 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:55.581878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-92da2739-2f6c-4da8-b465-bb3e6c6be545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:55.637567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1249/2485] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:55.646289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934d7e6-8122-4ccc-b29b-02d0ada537f8 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:55.646605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934d7e6-8122-4ccc-b29b-02d0ada537f8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:55.646885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934d7e6-8122-4ccc-b29b-02d0ada537f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:55.665575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-9934d7e6-8122-4ccc-b29b-02d0ada537f8 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:55.666773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9934d7e6-8122-4ccc-b29b-02d0ada537f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:55.674648 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1237/2486] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:55.678613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da2739-2f6c-4da8-b465-bb3e6c6be545 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:55.688829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da2739-2f6c-4da8-b465-bb3e6c6be545 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:55.693336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad2b2-2435-46c1-ae97-79c2adc14ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:55.693979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad2b2-2435-46c1-ae97-79c2adc14ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:55.694257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad2b2-2435-46c1-ae97-79c2adc14ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:55.694563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad2b2-2435-46c1-ae97-79c2adc14ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:55.695286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ad2b2-2435-46c1-ae97-79c2adc14ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:54:55.695586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ad2b2-2435-46c1-ae97-79c2adc14ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:55.697175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ad2b2-2435-46c1-ae97-79c2adc14ff8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:55.708997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1250/2487] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:54:55.713221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934d7e6-8122-4ccc-b29b-02d0ada537f8 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:55.722600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934d7e6-8122-4ccc-b29b-02d0ada537f8 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:55.727195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b788f90-c05e-43c9-8619-192a440d285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:55.727833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b788f90-c05e-43c9-8619-192a440d285d admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:55.728116 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b788f90-c05e-43c9-8619-192a440d285d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:55.728389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b788f90-c05e-43c9-8619-192a440d285d admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:55.729103 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b788f90-c05e-43c9-8619-192a440d285d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:55.731063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b788f90-c05e-43c9-8619-192a440d285d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:55.756734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1238/2488] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:54:55 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:54:55.760772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad2b2-2435-46c1-ae97-79c2adc14ff8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:55.770719 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad2b2-2435-46c1-ae97-79c2adc14ff8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:55.824784 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a2dcb-be6a-47a9-8bd2-0b65242c572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:55.825439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a2dcb-be6a-47a9-8bd2-0b65242c572d admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:55.825722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a2dcb-be6a-47a9-8bd2-0b65242c572d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:55.826000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a2dcb-be6a-47a9-8bd2-0b65242c572d admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:55.826707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a2dcb-be6a-47a9-8bd2-0b65242c572d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:55.828744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a2dcb-be6a-47a9-8bd2-0b65242c572d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:55.849027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1251/2489] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:54:55 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:54:55.853069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b788f90-c05e-43c9-8619-192a440d285d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:55.864120 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b788f90-c05e-43c9-8619-192a440d285d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:55.868934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfec21b-2ec4-479a-b666-ef5e8d7cc54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:55.869578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfec21b-2ec4-479a-b666-ef5e8d7cc54a admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:55.869859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfec21b-2ec4-479a-b666-ef5e8d7cc54a admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:55.870133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfec21b-2ec4-479a-b666-ef5e8d7cc54a admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:55.870904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfec21b-2ec4-479a-b666-ef5e8d7cc54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:55.872472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfec21b-2ec4-479a-b666-ef5e8d7cc54a admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:55.883277 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1239/2490] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:54:55.887452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a2dcb-be6a-47a9-8bd2-0b65242c572d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:55.897904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a2dcb-be6a-47a9-8bd2-0b65242c572d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:55.902630 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8ea28-a745-415e-9512-7d4d1fccf4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:55.903283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8ea28-a745-415e-9512-7d4d1fccf4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:55.903567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8ea28-a745-415e-9512-7d4d1fccf4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:55.903843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8ea28-a745-415e-9512-7d4d1fccf4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:55.904571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8ea28-a745-415e-9512-7d4d1fccf4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:55.906671 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8ea28-a745-415e-9512-7d4d1fccf4d5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:55.924701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1252/2491] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:54:55.928775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfec21b-2ec4-479a-b666-ef5e8d7cc54a admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:55.939311 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfec21b-2ec4-479a-b666-ef5e8d7cc54a admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:55.943971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abc6d0-8037-41fb-b4eb-37485d7f0e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:55.944848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abc6d0-8037-41fb-b4eb-37485d7f0e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:55.945127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abc6d0-8037-41fb-b4eb-37485d7f0e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:55.945398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abc6d0-8037-41fb-b4eb-37485d7f0e0f admin admin] PATH_INFO: `/v3/projects/3de5f1712d9a4879ab8f0dfc64abb357/users/cc35f99ee6154efdb13de12fdb813faa/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:55.959816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abc6d0-8037-41fb-b4eb-37485d7f0e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de5f1712d9a4879ab8f0dfc64abb357, user_id=cc35f99ee6154efdb13de12fdb813faa, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:55.962472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abc6d0-8037-41fb-b4eb-37485d7f0e0f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:55.974766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1240/2492] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:54:55 2022] PUT /identity/v3/projects/3de5f1712d9a4879ab8f0dfc64abb357/users/cc35f99ee6154efdb13de12fdb813faa/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:54:55.985161 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b50fac-ec8d-43e7-b7f6-3329c50de9fa None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:55.985454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b50fac-ec8d-43e7-b7f6-3329c50de9fa None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:55.985737 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b50fac-ec8d-43e7-b7f6-3329c50de9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:56.012026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b3b50fac-ec8d-43e7-b7f6-3329c50de9fa None None] MFA Rules not processed for user `cc35f99ee6154efdb13de12fdb813faa`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:54:56.013251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b3b50fac-ec8d-43e7-b7f6-3329c50de9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:56.075126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1253/2493] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:54:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:54:56.087339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abc6d0-8037-41fb-b4eb-37485d7f0e0f admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:54:56.089011 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-76abc6d0-8037-41fb-b4eb-37485d7f0e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:54:56.145364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abc6d0-8037-41fb-b4eb-37485d7f0e0f admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:54:56.149218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9e62f-5bb2-4243-9b9c-431dd330e40d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd346be1ef7604f1f87371f5d322fd010', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:54:56.149875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9e62f-5bb2-4243-9b9c-431dd330e40d service glance] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:54:56.150199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9e62f-5bb2-4243-9b9c-431dd330e40d service glance] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:54:56.150529 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9e62f-5bb2-4243-9b9c-431dd330e40d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:54:56.159676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9e62f-5bb2-4243-9b9c-431dd330e40d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:54:56.161099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9e62f-5bb2-4243-9b9c-431dd330e40d service glance] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:54:56.169776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1241/2494] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:54:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:55:06.824158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcd20f-7fa7-4efd-9104-c452b1c52c30 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:06.824685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcd20f-7fa7-4efd-9104-c452b1c52c30 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:06.824799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcd20f-7fa7-4efd-9104-c452b1c52c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:06.844583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-63bcd20f-7fa7-4efd-9104-c452b1c52c30 None None] MFA Rules not processed for user `dc43895177134e9c9c030a9d87f94aaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:06.845799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-63bcd20f-7fa7-4efd-9104-c452b1c52c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:06.901140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1254/2495] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:55:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:55:41.529131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0467-6b2a-4d29-ae11-e254f7fca71f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:41.529648 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0467-6b2a-4d29-ae11-e254f7fca71f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:41.529751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0467-6b2a-4d29-ae11-e254f7fca71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:41.549964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b1ec0467-6b2a-4d29-ae11-e254f7fca71f None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:41.552144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b1ec0467-6b2a-4d29-ae11-e254f7fca71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:41.617211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1242/2496] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:55:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:55:41.663287 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcd20f-7fa7-4efd-9104-c452b1c52c30 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:41.664694 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-63bcd20f-7fa7-4efd-9104-c452b1c52c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:41.730951 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcd20f-7fa7-4efd-9104-c452b1c52c30 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:41.736131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248b1e-b68e-4143-bf33-59cfee834615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:41.736783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248b1e-b68e-4143-bf33-59cfee834615 service swift] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:41.737072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248b1e-b68e-4143-bf33-59cfee834615 service swift] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:41.737347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248b1e-b68e-4143-bf33-59cfee834615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:41.745626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe248b1e-b68e-4143-bf33-59cfee834615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:41.747242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe248b1e-b68e-4143-bf33-59cfee834615 service swift] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:41.755574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1255/2497] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:55:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:55:45.376467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec0467-6b2a-4d29-ae11-e254f7fca71f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:45.446866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec0467-6b2a-4d29-ae11-e254f7fca71f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:45.454381 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:45.454381 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:45.454381 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:45.454381 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] PATH_INFO: `/v3/users/cc35f99ee6154efdb13de12fdb813faa` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:45.455548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc35f99ee6154efdb13de12fdb813faa)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:45.456883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:45.513292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc35f99ee6154efdb13de12fdb813faa'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:45.525687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc35f99ee6154efdb13de12fdb813faa'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:45.526432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc35f99ee6154efdb13de12fdb813faa'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:45.527136 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc35f99ee6154efdb13de12fdb813faa'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:45.537607 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc35f99ee6154efdb13de12fdb813faa'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:45.553664 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1243/2498] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:55:45 2022] DELETE /identity/v3/users/cc35f99ee6154efdb13de12fdb813faa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:55:45.558592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c597f0-5b9f-4d84-a219-5202c58f07c6 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:45.558592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c597f0-5b9f-4d84-a219-5202c58f07c6 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:45.559899 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c597f0-5b9f-4d84-a219-5202c58f07c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:45.578053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-63c597f0-5b9f-4d84-a219-5202c58f07c6 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:45.580161 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-63c597f0-5b9f-4d84-a219-5202c58f07c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:45.642660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1256/2499] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:55:45.651356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:45.659848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:45.732971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d2e79-7878-41d3-a8cd-ccdb7e987309 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:45.738129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8405f-c24b-4e0c-a749-cf524660fc2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:45.739263 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8405f-c24b-4e0c-a749-cf524660fc2d service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:45.739629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8405f-c24b-4e0c-a749-cf524660fc2d service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:45.740003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8405f-c24b-4e0c-a749-cf524660fc2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:45.750235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8405f-c24b-4e0c-a749-cf524660fc2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:45.752192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8405f-c24b-4e0c-a749-cf524660fc2d service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:45.767149 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1244/2500] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:55:46.207208 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c597f0-5b9f-4d84-a219-5202c58f07c6 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:46.208743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-63c597f0-5b9f-4d84-a219-5202c58f07c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:46.224493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c597f0-5b9f-4d84-a219-5202c58f07c6 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:46.232988 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:46.235883 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:46.236728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:46.237249 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] PATH_INFO: `/v3/projects/3de5f1712d9a4879ab8f0dfc64abb357` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:46.239479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de5f1712d9a4879ab8f0dfc64abb357)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:46.241887 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:46.307483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de5f1712d9a4879ab8f0dfc64abb357', 'request_id': 'req-7570ae52-a958-4da5-b886-9666635b3dc5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:46.316969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de5f1712d9a4879ab8f0dfc64abb357', 'request_id': 'req-7570ae52-a958-4da5-b886-9666635b3dc5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:46.327574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de5f1712d9a4879ab8f0dfc64abb357', 'request_id': 'req-7570ae52-a958-4da5-b886-9666635b3dc5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:46.340110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] The token cache is being invalidate because project 3de5f1712d9a4879ab8f0dfc64abb357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:55:46.340620 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:46.341443 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7570ae52-a958-4da5-b886-9666635b3dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:46.343590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1257/2501] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:55:46 2022] DELETE /identity/v3/projects/3de5f1712d9a4879ab8f0dfc64abb357 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:55:46.349001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a205e-83f9-44bd-8d49-e45dcc91a8fd None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:46.349289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a205e-83f9-44bd-8d49-e45dcc91a8fd None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:46.349567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a205e-83f9-44bd-8d49-e45dcc91a8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:46.370951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7a3a205e-83f9-44bd-8d49-e45dcc91a8fd None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:46.372428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7a3a205e-83f9-44bd-8d49-e45dcc91a8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:46.456795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1245/2502] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:55:46.464584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b31cb9-9a38-4b17-889c-f706169be76d None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:46.464876 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b31cb9-9a38-4b17-889c-f706169be76d None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:46.465165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b31cb9-9a38-4b17-889c-f706169be76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:46.487053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-29b31cb9-9a38-4b17-889c-f706169be76d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:46.488289 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-29b31cb9-9a38-4b17-889c-f706169be76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:46.497753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1258/2503] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:55:46.502614 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a205e-83f9-44bd-8d49-e45dcc91a8fd None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:46.513924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a205e-83f9-44bd-8d49-e45dcc91a8fd None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:46.519166 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0286832-6e66-49fd-88b1-486c977248d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:46.519833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0286832-6e66-49fd-88b1-486c977248d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:46.520129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0286832-6e66-49fd-88b1-486c977248d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:46.520540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0286832-6e66-49fd-88b1-486c977248d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:46.521281 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0286832-6e66-49fd-88b1-486c977248d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:55:46.521866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0286832-6e66-49fd-88b1-486c977248d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:46.523510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0286832-6e66-49fd-88b1-486c977248d8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:46.540418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1246/2504] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:55:46.541544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b31cb9-9a38-4b17-889c-f706169be76d None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:46.552981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b31cb9-9a38-4b17-889c-f706169be76d None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:46.558345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654044f4-b764-4883-a7ae-f267e0d63233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:46.559010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654044f4-b764-4883-a7ae-f267e0d63233 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:46.559591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654044f4-b764-4883-a7ae-f267e0d63233 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:46.559591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654044f4-b764-4883-a7ae-f267e0d63233 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:46.560303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654044f4-b764-4883-a7ae-f267e0d63233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:46.562154 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654044f4-b764-4883-a7ae-f267e0d63233 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:46.591847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1259/2505] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:55:46 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:55:46.596556 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0286832-6e66-49fd-88b1-486c977248d8 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:46.612875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0286832-6e66-49fd-88b1-486c977248d8 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:46.686515 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84806f9d-2960-46ef-aee1-7bf55feac617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:46.687349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806f9d-2960-46ef-aee1-7bf55feac617 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:46.688276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806f9d-2960-46ef-aee1-7bf55feac617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:46.688600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84806f9d-2960-46ef-aee1-7bf55feac617 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:46.689389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84806f9d-2960-46ef-aee1-7bf55feac617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:46.691556 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84806f9d-2960-46ef-aee1-7bf55feac617 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:46.714155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1247/2506] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:55:46 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:55:46.718329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654044f4-b764-4883-a7ae-f267e0d63233 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:46.730417 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654044f4-b764-4883-a7ae-f267e0d63233 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:46.736780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e805645-6eac-4cc6-9281-318816ff9921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:46.737709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e805645-6eac-4cc6-9281-318816ff9921 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:46.738012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e805645-6eac-4cc6-9281-318816ff9921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:46.738326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e805645-6eac-4cc6-9281-318816ff9921 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:46.739328 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e805645-6eac-4cc6-9281-318816ff9921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:46.742527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e805645-6eac-4cc6-9281-318816ff9921 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:46.757644 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1260/2507] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:55:46.768240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84806f9d-2960-46ef-aee1-7bf55feac617 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:46.785127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84806f9d-2960-46ef-aee1-7bf55feac617 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:46.791220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987b3f4-dcbb-47d8-9ca6-e9d8c3c710c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:46.791881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987b3f4-dcbb-47d8-9ca6-e9d8c3c710c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:46.792156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987b3f4-dcbb-47d8-9ca6-e9d8c3c710c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:46.792436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987b3f4-dcbb-47d8-9ca6-e9d8c3c710c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:46.793220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987b3f4-dcbb-47d8-9ca6-e9d8c3c710c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:46.794836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987b3f4-dcbb-47d8-9ca6-e9d8c3c710c2 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:46.806833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1248/2508] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:55:46.810786 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e805645-6eac-4cc6-9281-318816ff9921 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:46.821283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e805645-6eac-4cc6-9281-318816ff9921 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:46.826601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405e5c2-6e30-48a5-a156-1b8da5422161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:46.827557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e5c2-6e30-48a5-a156-1b8da5422161 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:46.827899 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e5c2-6e30-48a5-a156-1b8da5422161 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:46.828178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e5c2-6e30-48a5-a156-1b8da5422161 admin admin] PATH_INFO: `/v3/projects/a43bdf584a314e6fa8f761e1c2766643/users/a0e2cf91b8fb47a7b3d8422c2eef2302/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:46.847791 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405e5c2-6e30-48a5-a156-1b8da5422161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43bdf584a314e6fa8f761e1c2766643, user_id=a0e2cf91b8fb47a7b3d8422c2eef2302, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:46.851278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405e5c2-6e30-48a5-a156-1b8da5422161 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:46.879023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1261/2509] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:55:46 2022] PUT /identity/v3/projects/a43bdf584a314e6fa8f761e1c2766643/users/a0e2cf91b8fb47a7b3d8422c2eef2302/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:55:46.880684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f974469-7886-4bd8-9177-7d2336b4a5ee None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:46.881150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f974469-7886-4bd8-9177-7d2336b4a5ee None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:46.881588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f974469-7886-4bd8-9177-7d2336b4a5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:46.911769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-4f974469-7886-4bd8-9177-7d2336b4a5ee None None] MFA Rules not processed for user `a0e2cf91b8fb47a7b3d8422c2eef2302`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:46.913325 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4f974469-7886-4bd8-9177-7d2336b4a5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:47.039511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1249/2510] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:55:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:55:47.047354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405e5c2-6e30-48a5-a156-1b8da5422161 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:47.049922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-3405e5c2-6e30-48a5-a156-1b8da5422161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:47.127478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405e5c2-6e30-48a5-a156-1b8da5422161 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:47.137511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ecbda-7c83-4bd4-b4d6-880377cb722f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:47.138284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ecbda-7c83-4bd4-b4d6-880377cb722f service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:47.138655 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ecbda-7c83-4bd4-b4d6-880377cb722f service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:47.139010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ecbda-7c83-4bd4-b4d6-880377cb722f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:47.149837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ecbda-7c83-4bd4-b4d6-880377cb722f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:47.151733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ecbda-7c83-4bd4-b4d6-880377cb722f service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:47.163678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1262/2511] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:55:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:55:47.191550 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f974469-7886-4bd8-9177-7d2336b4a5ee None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:47.284537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f974469-7886-4bd8-9177-7d2336b4a5ee None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:47.299731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:47.300902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:47.301402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:47.301865 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] PATH_INFO: `/v3/users/a0e2cf91b8fb47a7b3d8422c2eef2302` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:47.303494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e2cf91b8fb47a7b3d8422c2eef2302)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:47.305738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:47.368220 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e2cf91b8fb47a7b3d8422c2eef2302'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:47.384868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e2cf91b8fb47a7b3d8422c2eef2302'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:47.385613 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e2cf91b8fb47a7b3d8422c2eef2302'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:47.386229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e2cf91b8fb47a7b3d8422c2eef2302'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:47.393665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e2cf91b8fb47a7b3d8422c2eef2302'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:47.410953 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1250/2512] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:55:47 2022] DELETE /identity/v3/users/a0e2cf91b8fb47a7b3d8422c2eef2302 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:55:47.415201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c1385-d245-446c-b3f5-488d7f1d6c51 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:47.415596 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c1385-d245-446c-b3f5-488d7f1d6c51 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:47.415922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c1385-d245-446c-b3f5-488d7f1d6c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:47.438985 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-918c1385-d245-446c-b3f5-488d7f1d6c51 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:47.440939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-918c1385-d245-446c-b3f5-488d7f1d6c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:47.520370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1263/2513] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:55:47.532556 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:47.534088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:47.603240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cacd6-eb05-4bc1-acbc-60ffaff66172 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:47.607778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d51caa-e433-418b-bc61-719fb31c92a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:47.608456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d51caa-e433-418b-bc61-719fb31c92a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:47.608740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d51caa-e433-418b-bc61-719fb31c92a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:47.609044 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d51caa-e433-418b-bc61-719fb31c92a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:47.620885 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d51caa-e433-418b-bc61-719fb31c92a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:47.622364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d51caa-e433-418b-bc61-719fb31c92a1 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:47.636289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1251/2514] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:55:47.964181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c1385-d245-446c-b3f5-488d7f1d6c51 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:47.965867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-918c1385-d245-446c-b3f5-488d7f1d6c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:47.994364 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c1385-d245-446c-b3f5-488d7f1d6c51 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:47.999317 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:48.000236 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:48.000520 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:48.000820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] PATH_INFO: `/v3/projects/a43bdf584a314e6fa8f761e1c2766643` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:48.002025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43bdf584a314e6fa8f761e1c2766643)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:48.004028 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:48.080811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43bdf584a314e6fa8f761e1c2766643', 'request_id': 'req-a3223967-e4f4-45ed-8a66-04949dcb6d61'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:48.087491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43bdf584a314e6fa8f761e1c2766643', 'request_id': 'req-a3223967-e4f4-45ed-8a66-04949dcb6d61'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:48.103488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43bdf584a314e6fa8f761e1c2766643', 'request_id': 'req-a3223967-e4f4-45ed-8a66-04949dcb6d61'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:48.120620 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] The token cache is being invalidate because project a43bdf584a314e6fa8f761e1c2766643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:55:48.121278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:48.122473 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a3223967-e4f4-45ed-8a66-04949dcb6d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:55:48.124850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1264/2515] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:55:47 2022] DELETE /identity/v3/projects/a43bdf584a314e6fa8f761e1c2766643 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:55:48.130612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc7d8-515d-40aa-9dab-7c2bbc464dda None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:48.131163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc7d8-515d-40aa-9dab-7c2bbc464dda None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:48.131600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cc7d8-515d-40aa-9dab-7c2bbc464dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:48.155979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-5f3cc7d8-515d-40aa-9dab-7c2bbc464dda None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:48.157939 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-5f3cc7d8-515d-40aa-9dab-7c2bbc464dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:48.249902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1252/2516] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:55:48.252354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaecfb3-9343-44b3-b004-9f2d229885c2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:48.253367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaecfb3-9343-44b3-b004-9f2d229885c2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:48.253753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaecfb3-9343-44b3-b004-9f2d229885c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:48.276864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7aaecfb3-9343-44b3-b004-9f2d229885c2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:48.278220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7aaecfb3-9343-44b3-b004-9f2d229885c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:48.292175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1265/2517] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:55:48.293313 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cc7d8-515d-40aa-9dab-7c2bbc464dda None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:48.305964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cc7d8-515d-40aa-9dab-7c2bbc464dda None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:48.311466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6271c-8573-49d0-85e7-584da4032165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:48.312396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6271c-8573-49d0-85e7-584da4032165 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:48.313095 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6271c-8573-49d0-85e7-584da4032165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:48.313909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6271c-8573-49d0-85e7-584da4032165 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:48.315240 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6271c-8573-49d0-85e7-584da4032165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:55:48.315672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6271c-8573-49d0-85e7-584da4032165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:48.317538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6271c-8573-49d0-85e7-584da4032165 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:48.336589 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1253/2518] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:55:48.340907 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaecfb3-9343-44b3-b004-9f2d229885c2 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:48.352052 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaecfb3-9343-44b3-b004-9f2d229885c2 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:48.357697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87bf94-171d-4e90-a368-66aa6a005cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:48.358577 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87bf94-171d-4e90-a368-66aa6a005cac admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:48.358964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87bf94-171d-4e90-a368-66aa6a005cac admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:48.359372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87bf94-171d-4e90-a368-66aa6a005cac admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:48.360778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87bf94-171d-4e90-a368-66aa6a005cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:48.363164 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87bf94-171d-4e90-a368-66aa6a005cac admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:48.399626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1266/2519] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:55:48 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:55:48.400901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6271c-8573-49d0-85e7-584da4032165 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:48.418203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6271c-8573-49d0-85e7-584da4032165 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:48.504602 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048112d-38b8-430f-a995-dd01ae0392ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:48.505524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048112d-38b8-430f-a995-dd01ae0392ba admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:48.505872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048112d-38b8-430f-a995-dd01ae0392ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:48.506217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048112d-38b8-430f-a995-dd01ae0392ba admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:48.507026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048112d-38b8-430f-a995-dd01ae0392ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:48.509054 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048112d-38b8-430f-a995-dd01ae0392ba admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:48.535519 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1254/2520] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:55:48 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:55:48.539098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87bf94-171d-4e90-a368-66aa6a005cac admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:48.553514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87bf94-171d-4e90-a368-66aa6a005cac admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:48.559555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8269a3f-331f-4ed7-aaee-937520477abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:48.560419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8269a3f-331f-4ed7-aaee-937520477abc admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:48.560886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8269a3f-331f-4ed7-aaee-937520477abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:48.561165 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8269a3f-331f-4ed7-aaee-937520477abc admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:48.561895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8269a3f-331f-4ed7-aaee-937520477abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:48.563851 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8269a3f-331f-4ed7-aaee-937520477abc admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:48.583666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1267/2521] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:55:48.584552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048112d-38b8-430f-a995-dd01ae0392ba admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:48.601144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048112d-38b8-430f-a995-dd01ae0392ba admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:48.606142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31594dd9-0734-4d07-90a9-22e139ef9bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:48.606918 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31594dd9-0734-4d07-90a9-22e139ef9bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:48.607278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31594dd9-0734-4d07-90a9-22e139ef9bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:48.607634 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31594dd9-0734-4d07-90a9-22e139ef9bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:48.609073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31594dd9-0734-4d07-90a9-22e139ef9bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:48.610829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31594dd9-0734-4d07-90a9-22e139ef9bc5 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:48.622801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1255/2522] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:55:48.627228 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8269a3f-331f-4ed7-aaee-937520477abc admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:48.640110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8269a3f-331f-4ed7-aaee-937520477abc admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:48.645396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66b25-c90e-4f70-996b-c9dfa223c33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:48.646295 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66b25-c90e-4f70-996b-c9dfa223c33a admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:48.646602 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66b25-c90e-4f70-996b-c9dfa223c33a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:48.647000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d66b25-c90e-4f70-996b-c9dfa223c33a admin admin] PATH_INFO: `/v3/projects/4ad8088ecb8a4f72a98ad70fa8be02b3/users/d3e4193c9d9043c99ee5bee59f79f7a8/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:48.672725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d66b25-c90e-4f70-996b-c9dfa223c33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad8088ecb8a4f72a98ad70fa8be02b3, user_id=d3e4193c9d9043c99ee5bee59f79f7a8, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:48.675620 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d66b25-c90e-4f70-996b-c9dfa223c33a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:48.692612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1268/2523] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:55:48 2022] PUT /identity/v3/projects/4ad8088ecb8a4f72a98ad70fa8be02b3/users/d3e4193c9d9043c99ee5bee59f79f7a8/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:55:48.698030 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776eb1-bd65-4086-a2f5-c5e34ed3a1c8 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:48.698347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776eb1-bd65-4086-a2f5-c5e34ed3a1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:48.698637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776eb1-bd65-4086-a2f5-c5e34ed3a1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:48.720991 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-8b776eb1-bd65-4086-a2f5-c5e34ed3a1c8 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:48.722514 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8b776eb1-bd65-4086-a2f5-c5e34ed3a1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:48.795443 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1256/2524] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:55:48.806932 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66b25-c90e-4f70-996b-c9dfa223c33a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:48.809096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d0d66b25-c90e-4f70-996b-c9dfa223c33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:48.879356 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d66b25-c90e-4f70-996b-c9dfa223c33a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:48.883539 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da6f67-0e35-4171-bc4c-b888db15f415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:48.884367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da6f67-0e35-4171-bc4c-b888db15f415 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:48.884654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da6f67-0e35-4171-bc4c-b888db15f415 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:48.884931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da6f67-0e35-4171-bc4c-b888db15f415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:48.894945 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da6f67-0e35-4171-bc4c-b888db15f415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:48.896385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da6f67-0e35-4171-bc4c-b888db15f415 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:48.906939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1269/2525] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:55:49.744413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3482fec-f32a-470d-9fac-5c5b7fa1d9d0 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:49.744993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3482fec-f32a-470d-9fac-5c5b7fa1d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:49.745104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3482fec-f32a-470d-9fac-5c5b7fa1d9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:49.782976 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-f3482fec-f32a-470d-9fac-5c5b7fa1d9d0 None None] MFA Rules not processed for user `d3e4193c9d9043c99ee5bee59f79f7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:49.784258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f3482fec-f32a-470d-9fac-5c5b7fa1d9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:49.885312 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1257/2526] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:55:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:55:49.893108 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da6f67-0e35-4171-bc4c-b888db15f415 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:55:49.895035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-35da6f67-0e35-4171-bc4c-b888db15f415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:49.983879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da6f67-0e35-4171-bc4c-b888db15f415 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:55:49.990189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc1fd5-a3a7-4aa5-8332-867d9a15b711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:55:49.990696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc1fd5-a3a7-4aa5-8332-867d9a15b711 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:49.990978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc1fd5-a3a7-4aa5-8332-867d9a15b711 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:49.991253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc1fd5-a3a7-4aa5-8332-867d9a15b711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:50.006776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc1fd5-a3a7-4aa5-8332-867d9a15b711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:55:50.010576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc1fd5-a3a7-4aa5-8332-867d9a15b711 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:55:50.039789 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1270/2527] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:55:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:55:51.447164 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eed6d-1051-4fd0-8a37-f26580ceb608 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:55:51.447679 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eed6d-1051-4fd0-8a37-f26580ceb608 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:55:51.447778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98eed6d-1051-4fd0-8a37-f26580ceb608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:55:51.471000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c98eed6d-1051-4fd0-8a37-f26580ceb608 None None] MFA Rules not processed for user `d3e4193c9d9043c99ee5bee59f79f7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:55:51.472451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c98eed6d-1051-4fd0-8a37-f26580ceb608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:55:51.479717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1258/2528] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:55:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:56:00.141347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed80ab-35cd-47d0-a4ac-ce9e68ef81f7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:56:00.141914 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed80ab-35cd-47d0-a4ac-ce9e68ef81f7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:56:00.141914 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed80ab-35cd-47d0-a4ac-ce9e68ef81f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:56:00.159530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-54ed80ab-35cd-47d0-a4ac-ce9e68ef81f7 None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:56:00.160659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-54ed80ab-35cd-47d0-a4ac-ce9e68ef81f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:56:00.219709 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1271/2529] 10.222.0.61 () {58 vars in 1009 bytes} [Sat May 14 15:56:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:56:00.231748 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98eed6d-1051-4fd0-8a37-f26580ceb608 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:56:00.233299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c98eed6d-1051-4fd0-8a37-f26580ceb608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:56:00.315372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98eed6d-1051-4fd0-8a37-f26580ceb608 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:56:00.321427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75710b0-31b6-40d2-bee2-fa8e67adae28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:56:00.322656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75710b0-31b6-40d2-bee2-fa8e67adae28 service swift] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:56:00.323003 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75710b0-31b6-40d2-bee2-fa8e67adae28 service swift] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:56:00.323340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75710b0-31b6-40d2-bee2-fa8e67adae28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:56:00.334023 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75710b0-31b6-40d2-bee2-fa8e67adae28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:56:00.335721 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75710b0-31b6-40d2-bee2-fa8e67adae28 service swift] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:56:00.344873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1259/2530] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:56:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:56:18.990251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed80ab-35cd-47d0-a4ac-ce9e68ef81f7 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:56:18.991697 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-54ed80ab-35cd-47d0-a4ac-ce9e68ef81f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:56:19.002987 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed80ab-35cd-47d0-a4ac-ce9e68ef81f7 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:56:19.006823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956dd466-7a2f-4833-9dd8-bb464c9e34cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:56:19.007460 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dd466-7a2f-4833-9dd8-bb464c9e34cc service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:56:19.007738 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dd466-7a2f-4833-9dd8-bb464c9e34cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:56:19.008008 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dd466-7a2f-4833-9dd8-bb464c9e34cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:56:19.009691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-956dd466-7a2f-4833-9dd8-bb464c9e34cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:56:19.078051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956dd466-7a2f-4833-9dd8-bb464c9e34cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:56:19.079518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956dd466-7a2f-4833-9dd8-bb464c9e34cc service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:56:19.090404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1272/2531] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:56:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:56:20.553841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75710b0-31b6-40d2-bee2-fa8e67adae28 service swift] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:56:20.562842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75710b0-31b6-40d2-bee2-fa8e67adae28 service swift] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:56:20.566918 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77101b6a-f56b-45c6-8419-41140030f994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:56:20.567566 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77101b6a-f56b-45c6-8419-41140030f994 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:56:20.567851 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77101b6a-f56b-45c6-8419-41140030f994 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:56:20.568132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77101b6a-f56b-45c6-8419-41140030f994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:56:20.569887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-77101b6a-f56b-45c6-8419-41140030f994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:56:20.585391 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77101b6a-f56b-45c6-8419-41140030f994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:56:20.586857 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77101b6a-f56b-45c6-8419-41140030f994 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:56:20.598734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1260/2532] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:56:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:56:24.064607 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c0b8-d757-4c29-ac9b-2b9baf8065c7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:56:24.065050 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c0b8-d757-4c29-ac9b-2b9baf8065c7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:56:24.065201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c0b8-d757-4c29-ac9b-2b9baf8065c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:56:24.082826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-4e24c0b8-d757-4c29-ac9b-2b9baf8065c7 None None] MFA Rules not processed for user `579cb64ce191482eb4ae03d099e8635d`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:56:24.084799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4e24c0b8-d757-4c29-ac9b-2b9baf8065c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:56:24.091973 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1273/2533] 10.222.0.61 () {58 vars in 967 bytes} [Sat May 14 15:56:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:56:24.104417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77101b6a-f56b-45c6-8419-41140030f994 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:56:24.115820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77101b6a-f56b-45c6-8419-41140030f994 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:56:24.122068 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5cf7b-a744-4e82-9091-de39808ca27b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1713718ff95744b9bd42f21d4ec8bb91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:56:24.122775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5cf7b-a744-4e82-9091-de39808ca27b service swift] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:56:24.123082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5cf7b-a744-4e82-9091-de39808ca27b service swift] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:56:24.123369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5cf7b-a744-4e82-9091-de39808ca27b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:56:24.136687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5cf7b-a744-4e82-9091-de39808ca27b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:56:24.138269 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5cf7b-a744-4e82-9091-de39808ca27b service swift] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:56:24.147683 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1261/2534] 10.222.0.61 () {60 vars in 1384 bytes} [Sat May 14 15:56:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 14 15:56:55.101633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24c0b8-d757-4c29-ac9b-2b9baf8065c7 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:56:55.111256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24c0b8-d757-4c29-ac9b-2b9baf8065c7 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:56:55.114833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfd360-f83d-46cc-b6a6-b2d7aa98d205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:56:55.115465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfd360-f83d-46cc-b6a6-b2d7aa98d205 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:56:55.115746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfd360-f83d-46cc-b6a6-b2d7aa98d205 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:56:55.116023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfd360-f83d-46cc-b6a6-b2d7aa98d205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:56:55.118041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b5dfd360-f83d-46cc-b6a6-b2d7aa98d205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:56:55.175989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfd360-f83d-46cc-b6a6-b2d7aa98d205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:56:55.177420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfd360-f83d-46cc-b6a6-b2d7aa98d205 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:56:55.186754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1274/2535] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:56:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:18.629421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec948ab-1679-419f-aa43-0bcf12356ee8 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:18.630401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec948ab-1679-419f-aa43-0bcf12356ee8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:18.630401 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec948ab-1679-419f-aa43-0bcf12356ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:18.649218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6ec948ab-1679-419f-aa43-0bcf12356ee8 None None] MFA Rules not processed for user `568f6783dd4d43398a70a9ffa58ff660`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:57:18.651073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6ec948ab-1679-419f-aa43-0bcf12356ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:18.659315 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1262/2536] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:57:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:57:19.424239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfd360-f83d-46cc-b6a6-b2d7aa98d205 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:19.425680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b5dfd360-f83d-46cc-b6a6-b2d7aa98d205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:19.495248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfd360-f83d-46cc-b6a6-b2d7aa98d205 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:19.500110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47996501-c453-4f69-8c92-235fb7d28df6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fac310b740a40718191e905723222ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:19.500745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47996501-c453-4f69-8c92-235fb7d28df6 service placement] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:19.501025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47996501-c453-4f69-8c92-235fb7d28df6 service placement] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:19.501297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47996501-c453-4f69-8c92-235fb7d28df6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:19.503022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-47996501-c453-4f69-8c92-235fb7d28df6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:19.514445 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47996501-c453-4f69-8c92-235fb7d28df6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:19.516005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47996501-c453-4f69-8c92-235fb7d28df6 service placement] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:19.525414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1275/2537] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:21.209817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec948ab-1679-419f-aa43-0bcf12356ee8 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:21.220870 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec948ab-1679-419f-aa43-0bcf12356ee8 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:21.225266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f368520-5d98-4d63-a3a8-b13846ffcee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:21.225925 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368520-5d98-4d63-a3a8-b13846ffcee6 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:21.226241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368520-5d98-4d63-a3a8-b13846ffcee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:21.226552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368520-5d98-4d63-a3a8-b13846ffcee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:21.229941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2f368520-5d98-4d63-a3a8-b13846ffcee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:21.240691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f368520-5d98-4d63-a3a8-b13846ffcee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:21.242228 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f368520-5d98-4d63-a3a8-b13846ffcee6 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:21.252331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1263/2538] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:21.907874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47996501-c453-4f69-8c92-235fb7d28df6 service placement] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:21.910279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-47996501-c453-4f69-8c92-235fb7d28df6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:21.930878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47996501-c453-4f69-8c92-235fb7d28df6 service placement] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:21.938386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc4601-cb67-4a2c-a309-0d3a6177a6df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:21.939318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc4601-cb67-4a2c-a309-0d3a6177a6df service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:21.939598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc4601-cb67-4a2c-a309-0d3a6177a6df service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:21.940376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc4601-cb67-4a2c-a309-0d3a6177a6df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:21.941818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-28fc4601-cb67-4a2c-a309-0d3a6177a6df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:21.955087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc4601-cb67-4a2c-a309-0d3a6177a6df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:21.958212 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc4601-cb67-4a2c-a309-0d3a6177a6df service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:21.980675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1276/2539] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:41.844575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f368520-5d98-4d63-a3a8-b13846ffcee6 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:41.858981 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f368520-5d98-4d63-a3a8-b13846ffcee6 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:41.864481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799faed-b146-4e5b-834f-90a2b1c1a81e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:41.865250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799faed-b146-4e5b-834f-90a2b1c1a81e service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:41.865537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799faed-b146-4e5b-834f-90a2b1c1a81e service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:41.865811 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799faed-b146-4e5b-834f-90a2b1c1a81e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:41.867611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e799faed-b146-4e5b-834f-90a2b1c1a81e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:41.880292 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799faed-b146-4e5b-834f-90a2b1c1a81e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:41.882237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799faed-b146-4e5b-834f-90a2b1c1a81e service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:41.894225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1264/2540] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:47.718248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc4601-cb67-4a2c-a309-0d3a6177a6df service nova] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:47.727857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc4601-cb67-4a2c-a309-0d3a6177a6df service nova] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:47.732591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8e0c5-bf10-4d80-b81a-df683608feb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:47.733431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8e0c5-bf10-4d80-b81a-df683608feb7 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:47.733952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8e0c5-bf10-4d80-b81a-df683608feb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:47.734332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8e0c5-bf10-4d80-b81a-df683608feb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:47.737051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-88d8e0c5-bf10-4d80-b81a-df683608feb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:47.813334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8e0c5-bf10-4d80-b81a-df683608feb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:47.815017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8e0c5-bf10-4d80-b81a-df683608feb7 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:47.824677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1277/2541] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:48.728755 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5b07-2261-4a8b-9fcf-fdc93a6bea02 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:48.729274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5b07-2261-4a8b-9fcf-fdc93a6bea02 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:48.729274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b5b07-2261-4a8b-9fcf-fdc93a6bea02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:48.752115 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-358b5b07-2261-4a8b-9fcf-fdc93a6bea02 None None] MFA Rules not processed for user `d3e4193c9d9043c99ee5bee59f79f7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:57:48.753804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-358b5b07-2261-4a8b-9fcf-fdc93a6bea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:48.766498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1265/2542] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:57:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:57:49.124300 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8e0c5-bf10-4d80-b81a-df683608feb7 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:49.136949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8e0c5-bf10-4d80-b81a-df683608feb7 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:49.143118 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad5789-3d22-4ac1-8ff9-f8db58a26522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:49.144397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad5789-3d22-4ac1-8ff9-f8db58a26522 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:49.145359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad5789-3d22-4ac1-8ff9-f8db58a26522 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:49.145857 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad5789-3d22-4ac1-8ff9-f8db58a26522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:49.147982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a5ad5789-3d22-4ac1-8ff9-f8db58a26522 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:49.233878 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad5789-3d22-4ac1-8ff9-f8db58a26522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:49.235944 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad5789-3d22-4ac1-8ff9-f8db58a26522 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:49.264637 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1278/2543] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:49.522636 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b5b07-2261-4a8b-9fcf-fdc93a6bea02 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:49.540614 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b5b07-2261-4a8b-9fcf-fdc93a6bea02 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:49.558183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb401a23-0344-426c-b409-553f40d2e2d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:49.559061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb401a23-0344-426c-b409-553f40d2e2d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:49.559360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb401a23-0344-426c-b409-553f40d2e2d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:49.559625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb401a23-0344-426c-b409-553f40d2e2d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:49.561584 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-cb401a23-0344-426c-b409-553f40d2e2d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:49.581584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad5789-3d22-4ac1-8ff9-f8db58a26522 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:49.599028 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad5789-3d22-4ac1-8ff9-f8db58a26522 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:49.602649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ce0f-c19f-4b1d-9a09-78560850253c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:49.603513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ce0f-c19f-4b1d-9a09-78560850253c service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:49.603795 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ce0f-c19f-4b1d-9a09-78560850253c service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:49.604070 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444ce0f-c19f-4b1d-9a09-78560850253c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:49.606633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9444ce0f-c19f-4b1d-9a09-78560850253c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:49.622512 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444ce0f-c19f-4b1d-9a09-78560850253c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:49.624290 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444ce0f-c19f-4b1d-9a09-78560850253c service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:49.635992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1279/2544] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:49.653362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb401a23-0344-426c-b409-553f40d2e2d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:49.654910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb401a23-0344-426c-b409-553f40d2e2d7 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:49.669784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1266/2545] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:52.257371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ce0f-c19f-4b1d-9a09-78560850253c service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:52.259142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9444ce0f-c19f-4b1d-9a09-78560850253c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:52.280367 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444ce0f-c19f-4b1d-9a09-78560850253c service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:52.290454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ccfc7-bf86-4289-9db0-f06807513e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:52.292326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ccfc7-bf86-4289-9db0-f06807513e67 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:52.292799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ccfc7-bf86-4289-9db0-f06807513e67 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:52.293422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ccfc7-bf86-4289-9db0-f06807513e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:52.298824 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ef3ccfc7-bf86-4289-9db0-f06807513e67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:52.317569 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ccfc7-bf86-4289-9db0-f06807513e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:52.319229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ccfc7-bf86-4289-9db0-f06807513e67 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:52.331508 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1280/2546] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:54.701458 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb401a23-0344-426c-b409-553f40d2e2d7 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:54.711830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb401a23-0344-426c-b409-553f40d2e2d7 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:54.720067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7aacf-f72e-4185-994d-43d50150898a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:54.720923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7aacf-f72e-4185-994d-43d50150898a service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:54.721394 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7aacf-f72e-4185-994d-43d50150898a service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:54.721921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7aacf-f72e-4185-994d-43d50150898a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:54.728518 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-25c7aacf-f72e-4185-994d-43d50150898a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:54.743882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7aacf-f72e-4185-994d-43d50150898a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:54.746793 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7aacf-f72e-4185-994d-43d50150898a service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:54.765580 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1267/2547] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:55.082041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ccfc7-bf86-4289-9db0-f06807513e67 service nova] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:55.083588 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ef3ccfc7-bf86-4289-9db0-f06807513e67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:55.105156 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ccfc7-bf86-4289-9db0-f06807513e67 service nova] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:55.112024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b64cd-c6bd-4e2b-9eb6-feee952d1dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:55.113106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b64cd-c6bd-4e2b-9eb6-feee952d1dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:55.113383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b64cd-c6bd-4e2b-9eb6-feee952d1dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:55.113652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b64cd-c6bd-4e2b-9eb6-feee952d1dd0 admin admin] PATH_INFO: `/v3/users/dc43895177134e9c9c030a9d87f94aaa` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:55.114905 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b64cd-c6bd-4e2b-9eb6-feee952d1dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc43895177134e9c9c030a9d87f94aaa)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:55.116808 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b64cd-c6bd-4e2b-9eb6-feee952d1dd0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:55.177122 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-cf6b64cd-c6bd-4e2b-9eb6-feee952d1dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc43895177134e9c9c030a9d87f94aaa'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:55.190546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-cf6b64cd-c6bd-4e2b-9eb6-feee952d1dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc43895177134e9c9c030a9d87f94aaa'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:55.191386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-cf6b64cd-c6bd-4e2b-9eb6-feee952d1dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc43895177134e9c9c030a9d87f94aaa'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:55.192089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-cf6b64cd-c6bd-4e2b-9eb6-feee952d1dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc43895177134e9c9c030a9d87f94aaa'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:55.200810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-cf6b64cd-c6bd-4e2b-9eb6-feee952d1dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc43895177134e9c9c030a9d87f94aaa'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:55.216410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1281/2548] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:57:55 2022] DELETE /identity/v3/users/dc43895177134e9c9c030a9d87f94aaa => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:57:55.393104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7aacf-f72e-4185-994d-43d50150898a service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:55.405919 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7aacf-f72e-4185-994d-43d50150898a service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:55.465579 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:55.466577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:55.466860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:55.467284 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] PATH_INFO: `/v3/projects/7905689c95d44a5c9169249c70f7de57` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:55.468497 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7905689c95d44a5c9169249c70f7de57)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:55.470462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:55.519215 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7905689c95d44a5c9169249c70f7de57', 'request_id': 'req-21ebeb28-cf80-4aae-9419-b2d30e344546'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:55.527861 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7905689c95d44a5c9169249c70f7de57', 'request_id': 'req-21ebeb28-cf80-4aae-9419-b2d30e344546'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:55.538173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7905689c95d44a5c9169249c70f7de57', 'request_id': 'req-21ebeb28-cf80-4aae-9419-b2d30e344546'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:55.553012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] The token cache is being invalidate because project 7905689c95d44a5c9169249c70f7de57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:57:55.553299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:55.553949 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-21ebeb28-cf80-4aae-9419-b2d30e344546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:55.559019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1268/2549] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:57:55 2022] DELETE /identity/v3/projects/7905689c95d44a5c9169249c70f7de57 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:57:55.560719 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65751b93-4d04-4d44-bf0b-1a3e6f2a874b None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:55.561009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65751b93-4d04-4d44-bf0b-1a3e6f2a874b None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:55.561286 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65751b93-4d04-4d44-bf0b-1a3e6f2a874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:55.580351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-65751b93-4d04-4d44-bf0b-1a3e6f2a874b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:57:55.581551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-65751b93-4d04-4d44-bf0b-1a3e6f2a874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:55.645455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1282/2550] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:57:55.654039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa1bd1-c891-4c51-9327-491ccace81b8 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:55.654354 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa1bd1-c891-4c51-9327-491ccace81b8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:55.654631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa1bd1-c891-4c51-9327-491ccace81b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:55.674029 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-07aa1bd1-c891-4c51-9327-491ccace81b8 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:57:55.675343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-07aa1bd1-c891-4c51-9327-491ccace81b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:55.684102 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1269/2551] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:57:55.688652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65751b93-4d04-4d44-bf0b-1a3e6f2a874b None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:55.698270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65751b93-4d04-4d44-bf0b-1a3e6f2a874b None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:55.703204 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff7ada-3232-40c9-9b6a-83b60b1d9808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:55.703855 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff7ada-3232-40c9-9b6a-83b60b1d9808 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:55.704135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff7ada-3232-40c9-9b6a-83b60b1d9808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:55.704410 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff7ada-3232-40c9-9b6a-83b60b1d9808 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:55.705133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff7ada-3232-40c9-9b6a-83b60b1d9808 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:57:55.705442 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff7ada-3232-40c9-9b6a-83b60b1d9808 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:55.707120 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff7ada-3232-40c9-9b6a-83b60b1d9808 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:55.734716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1283/2552] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:57:55.737447 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa1bd1-c891-4c51-9327-491ccace81b8 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:55.753150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa1bd1-c891-4c51-9327-491ccace81b8 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:55.758507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe5603-d8e8-45be-b79f-fd42134119a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:55.759178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe5603-d8e8-45be-b79f-fd42134119a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:55.759457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe5603-d8e8-45be-b79f-fd42134119a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:55.759731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe5603-d8e8-45be-b79f-fd42134119a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:55.760440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe5603-d8e8-45be-b79f-fd42134119a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:55.763090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe5603-d8e8-45be-b79f-fd42134119a9 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:55.795270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1270/2553] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:57:55 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:57:55.796387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff7ada-3232-40c9-9b6a-83b60b1d9808 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:55.807336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff7ada-3232-40c9-9b6a-83b60b1d9808 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:55.872590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cce3a3-12d9-4c12-85d9-85d78b1293c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:55.873270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cce3a3-12d9-4c12-85d9-85d78b1293c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:55.873558 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cce3a3-12d9-4c12-85d9-85d78b1293c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:55.873840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cce3a3-12d9-4c12-85d9-85d78b1293c0 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:55.874582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cce3a3-12d9-4c12-85d9-85d78b1293c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:55.876562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cce3a3-12d9-4c12-85d9-85d78b1293c0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:55.903376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1284/2554] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:57:55 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:57:55.904612 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe5603-d8e8-45be-b79f-fd42134119a9 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:55.915537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe5603-d8e8-45be-b79f-fd42134119a9 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:55.920408 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c7afd-4779-46f2-98cc-83a80f2d3322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:55.921079 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c7afd-4779-46f2-98cc-83a80f2d3322 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:55.921358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c7afd-4779-46f2-98cc-83a80f2d3322 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:55.921628 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c7afd-4779-46f2-98cc-83a80f2d3322 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:55.922386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c7afd-4779-46f2-98cc-83a80f2d3322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:55.924013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c7afd-4779-46f2-98cc-83a80f2d3322 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:55.935192 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1271/2555] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:57:55.939283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cce3a3-12d9-4c12-85d9-85d78b1293c0 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:55.950610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cce3a3-12d9-4c12-85d9-85d78b1293c0 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:55.955428 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c578d7-96b6-4766-8139-b582c44a7be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:55.956153 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c578d7-96b6-4766-8139-b582c44a7be1 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:55.956499 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c578d7-96b6-4766-8139-b582c44a7be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:55.956843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c578d7-96b6-4766-8139-b582c44a7be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:55.957642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c578d7-96b6-4766-8139-b582c44a7be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:55.959267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c578d7-96b6-4766-8139-b582c44a7be1 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:55.970911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1285/2556] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:57:55.975329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c7afd-4779-46f2-98cc-83a80f2d3322 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:55.986066 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c7afd-4779-46f2-98cc-83a80f2d3322 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:55.990760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e93bb-bf40-433c-b886-144e9b2214a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:55.991639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e93bb-bf40-433c-b886-144e9b2214a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:55.991924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e93bb-bf40-433c-b886-144e9b2214a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:55.992205 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e93bb-bf40-433c-b886-144e9b2214a1 admin admin] PATH_INFO: `/v3/projects/3f21d13bd26b4543b87fe5ac946e4baa/users/e4924b1b5f5a4d96afec1ee1d89a7818/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:56.007694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e93bb-bf40-433c-b886-144e9b2214a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f21d13bd26b4543b87fe5ac946e4baa, user_id=e4924b1b5f5a4d96afec1ee1d89a7818, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:56.010276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e93bb-bf40-433c-b886-144e9b2214a1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:56.023971 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1272/2557] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:57:55 2022] PUT /identity/v3/projects/3f21d13bd26b4543b87fe5ac946e4baa/users/e4924b1b5f5a4d96afec1ee1d89a7818/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:57:56.034573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dab7a-a909-4498-8a9b-17a98e541eb3 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:56.034893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dab7a-a909-4498-8a9b-17a98e541eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:56.035178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dab7a-a909-4498-8a9b-17a98e541eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:56.062128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-634dab7a-a909-4498-8a9b-17a98e541eb3 None None] MFA Rules not processed for user `e4924b1b5f5a4d96afec1ee1d89a7818`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:57:56.063519 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-634dab7a-a909-4498-8a9b-17a98e541eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:56.132521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1286/2558] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:57:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:57:56.145314 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e93bb-bf40-433c-b886-144e9b2214a1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:56.148377 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-779e93bb-bf40-433c-b886-144e9b2214a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:56.221535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e93bb-bf40-433c-b886-144e9b2214a1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:56.227703 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a07d7-2f82-4e5c-8e97-da880e4e40bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:56.228353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a07d7-2f82-4e5c-8e97-da880e4e40bb service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:56.228637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a07d7-2f82-4e5c-8e97-da880e4e40bb service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:56.228942 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a07d7-2f82-4e5c-8e97-da880e4e40bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:56.237360 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a07d7-2f82-4e5c-8e97-da880e4e40bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:56.239010 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a07d7-2f82-4e5c-8e97-da880e4e40bb service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:56.249533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1273/2559] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:56.484310 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dab7a-a909-4498-8a9b-17a98e541eb3 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:56.552597 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dab7a-a909-4498-8a9b-17a98e541eb3 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:56.557241 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:56.558105 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:56.558996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:56.559321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] PATH_INFO: `/v3/users/e4924b1b5f5a4d96afec1ee1d89a7818` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:56.560594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4924b1b5f5a4d96afec1ee1d89a7818)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:56.563072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:56.616434 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4924b1b5f5a4d96afec1ee1d89a7818'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:56.629062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4924b1b5f5a4d96afec1ee1d89a7818'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:56.629892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4924b1b5f5a4d96afec1ee1d89a7818'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:56.630593 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4924b1b5f5a4d96afec1ee1d89a7818'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:56.638536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4924b1b5f5a4d96afec1ee1d89a7818'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:56.654397 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1287/2560] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:57:56 2022] DELETE /identity/v3/users/e4924b1b5f5a4d96afec1ee1d89a7818 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:57:56.660818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246bc7-f7a0-415b-b639-6b4ec3c760b7 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:56.661404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246bc7-f7a0-415b-b639-6b4ec3c760b7 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:56.662229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246bc7-f7a0-415b-b639-6b4ec3c760b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:56.689135 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-e6246bc7-f7a0-415b-b639-6b4ec3c760b7 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:57:56.691307 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e6246bc7-f7a0-415b-b639-6b4ec3c760b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:56.785361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1274/2561] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:57:56.800492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:56.801955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:56.879476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e3a89-7496-41dc-bf0f-4abe0326d122 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:56.884093 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95cda5-678c-413e-8fff-33024e750be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:56.884439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95cda5-678c-413e-8fff-33024e750be0 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:56.884738 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95cda5-678c-413e-8fff-33024e750be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:56.884990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95cda5-678c-413e-8fff-33024e750be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:56.899104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95cda5-678c-413e-8fff-33024e750be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:56.900587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e95cda5-678c-413e-8fff-33024e750be0 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:56.911664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1288/2562] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:57:58.029564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6246bc7-f7a0-415b-b639-6b4ec3c760b7 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:58.031227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-e6246bc7-f7a0-415b-b639-6b4ec3c760b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:58.048636 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6246bc7-f7a0-415b-b639-6b4ec3c760b7 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:58.062725 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:58.063778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:58.064316 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:58.065505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] PATH_INFO: `/v3/projects/3f21d13bd26b4543b87fe5ac946e4baa` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:58.069711 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f21d13bd26b4543b87fe5ac946e4baa)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:58.073024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:58.147505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f21d13bd26b4543b87fe5ac946e4baa', 'request_id': 'req-04e8b00f-011a-42d2-8b4d-def8339f1274'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:58.157804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f21d13bd26b4543b87fe5ac946e4baa', 'request_id': 'req-04e8b00f-011a-42d2-8b4d-def8339f1274'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:58.164624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f21d13bd26b4543b87fe5ac946e4baa', 'request_id': 'req-04e8b00f-011a-42d2-8b4d-def8339f1274'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:58.178751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] The token cache is being invalidate because project 3f21d13bd26b4543b87fe5ac946e4baa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:57:58.179367 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:58.180250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-04e8b00f-011a-42d2-8b4d-def8339f1274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:57:58.182352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1275/2563] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:57:58 2022] DELETE /identity/v3/projects/3f21d13bd26b4543b87fe5ac946e4baa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:57:58.187169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7b62-aeee-4654-bdd2-be8eb67245f1 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:58.187704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7b62-aeee-4654-bdd2-be8eb67245f1 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:58.187704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f7b62-aeee-4654-bdd2-be8eb67245f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:58.209517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-0e4f7b62-aeee-4654-bdd2-be8eb67245f1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:57:58.210753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0e4f7b62-aeee-4654-bdd2-be8eb67245f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:58.291045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1289/2564] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:57:58.299070 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7af06f-2d6e-4d0f-a69d-61bb872936d2 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:58.299354 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7af06f-2d6e-4d0f-a69d-61bb872936d2 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:58.299633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7af06f-2d6e-4d0f-a69d-61bb872936d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:58.317736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7b7af06f-2d6e-4d0f-a69d-61bb872936d2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:57:58.318958 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7b7af06f-2d6e-4d0f-a69d-61bb872936d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:58.328961 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1276/2565] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:57:58.333349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f7b62-aeee-4654-bdd2-be8eb67245f1 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:58.344243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f7b62-aeee-4654-bdd2-be8eb67245f1 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:58.349095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74eb28-ddc5-4843-9ab7-600dedbadec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:58.349825 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74eb28-ddc5-4843-9ab7-600dedbadec6 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:58.350180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74eb28-ddc5-4843-9ab7-600dedbadec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:58.350566 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74eb28-ddc5-4843-9ab7-600dedbadec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:58.351375 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74eb28-ddc5-4843-9ab7-600dedbadec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:57:58.351770 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74eb28-ddc5-4843-9ab7-600dedbadec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:58.353536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74eb28-ddc5-4843-9ab7-600dedbadec6 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:58.367461 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1290/2566] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:57:58.372467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7af06f-2d6e-4d0f-a69d-61bb872936d2 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:58.381664 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7af06f-2d6e-4d0f-a69d-61bb872936d2 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:58.386520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7794a-65e6-4c55-9593-dee366600018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:58.387918 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7794a-65e6-4c55-9593-dee366600018 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:58.388435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7794a-65e6-4c55-9593-dee366600018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:58.388708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7794a-65e6-4c55-9593-dee366600018 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:58.389396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7794a-65e6-4c55-9593-dee366600018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:58.391517 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7794a-65e6-4c55-9593-dee366600018 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:58.422893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1277/2567] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:57:58 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:57:58.424486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74eb28-ddc5-4843-9ab7-600dedbadec6 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:58.436534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74eb28-ddc5-4843-9ab7-600dedbadec6 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:58.508680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763ad88-fa64-4f85-9886-50cca68e0a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:58.509373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763ad88-fa64-4f85-9886-50cca68e0a92 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:58.509659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763ad88-fa64-4f85-9886-50cca68e0a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:58.509939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763ad88-fa64-4f85-9886-50cca68e0a92 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:58.511277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763ad88-fa64-4f85-9886-50cca68e0a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:58.513332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763ad88-fa64-4f85-9886-50cca68e0a92 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:58.543585 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1291/2568] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:57:58 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:57:58.545120 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7794a-65e6-4c55-9593-dee366600018 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:58.557217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7794a-65e6-4c55-9593-dee366600018 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:58.563513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad3e4-9d65-4dfa-8ea1-f9652ff83a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:58.564818 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad3e4-9d65-4dfa-8ea1-f9652ff83a55 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:58.565108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad3e4-9d65-4dfa-8ea1-f9652ff83a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:58.565381 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad3e4-9d65-4dfa-8ea1-f9652ff83a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:58.566127 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ad3e4-9d65-4dfa-8ea1-f9652ff83a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:58.567892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ad3e4-9d65-4dfa-8ea1-f9652ff83a55 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:58.584995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1278/2569] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:57:58.586220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763ad88-fa64-4f85-9886-50cca68e0a92 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:58.598239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763ad88-fa64-4f85-9886-50cca68e0a92 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:58.603728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea836e07-1d6f-4787-9a55-da2e70bd7d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:58.604402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea836e07-1d6f-4787-9a55-da2e70bd7d58 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:58.604861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea836e07-1d6f-4787-9a55-da2e70bd7d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:58.605911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea836e07-1d6f-4787-9a55-da2e70bd7d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:58.607125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea836e07-1d6f-4787-9a55-da2e70bd7d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:58.608333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea836e07-1d6f-4787-9a55-da2e70bd7d58 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:58.623730 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1292/2570] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:57:58.624893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad3e4-9d65-4dfa-8ea1-f9652ff83a55 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:58.641143 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad3e4-9d65-4dfa-8ea1-f9652ff83a55 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:58.646199 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a01cf-26c3-4989-af87-4881d881dfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:58.647775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a01cf-26c3-4989-af87-4881d881dfc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:58.647775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a01cf-26c3-4989-af87-4881d881dfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:58.649940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a01cf-26c3-4989-af87-4881d881dfc0 admin admin] PATH_INFO: `/v3/projects/b2611ebbd33244718735ddacb3546dbd/users/0d477a0495de4b7295d077f4d04a4f9a/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:58.668823 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a01cf-26c3-4989-af87-4881d881dfc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2611ebbd33244718735ddacb3546dbd, user_id=0d477a0495de4b7295d077f4d04a4f9a, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:58.671533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a01cf-26c3-4989-af87-4881d881dfc0 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:58.686973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1279/2571] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:57:58 2022] PUT /identity/v3/projects/b2611ebbd33244718735ddacb3546dbd/users/0d477a0495de4b7295d077f4d04a4f9a/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:57:58.696952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166d1e8-c87e-4602-9ee0-a97d9df8b194 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:58.697246 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166d1e8-c87e-4602-9ee0-a97d9df8b194 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:58.697527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166d1e8-c87e-4602-9ee0-a97d9df8b194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:58.727701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-d166d1e8-c87e-4602-9ee0-a97d9df8b194 None None] MFA Rules not processed for user `0d477a0495de4b7295d077f4d04a4f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:57:58.729021 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d166d1e8-c87e-4602-9ee0-a97d9df8b194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:58.817498 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1293/2572] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:57:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:57:58.817706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a01cf-26c3-4989-af87-4881d881dfc0 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:58.906113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a01cf-26c3-4989-af87-4881d881dfc0 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:58.911102 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0296d-58ad-4a5f-aa28-a28cf38ed04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:58.911871 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0296d-58ad-4a5f-aa28-a28cf38ed04b admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:58.912221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0296d-58ad-4a5f-aa28-a28cf38ed04b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:58.912568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0296d-58ad-4a5f-aa28-a28cf38ed04b admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:58.913334 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0296d-58ad-4a5f-aa28-a28cf38ed04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:58.916809 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0296d-58ad-4a5f-aa28-a28cf38ed04b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:58.940505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1280/2573] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:57:58 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:57:58.944481 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166d1e8-c87e-4602-9ee0-a97d9df8b194 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:58.955578 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166d1e8-c87e-4602-9ee0-a97d9df8b194 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:59.012327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a12a31-f983-4ced-bc29-5554cc237b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:59.013099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12a31-f983-4ced-bc29-5554cc237b3a admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:59.013455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12a31-f983-4ced-bc29-5554cc237b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:59.013731 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12a31-f983-4ced-bc29-5554cc237b3a admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:59.014671 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a12a31-f983-4ced-bc29-5554cc237b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:59.016670 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a12a31-f983-4ced-bc29-5554cc237b3a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:59.036568 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1294/2574] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:57:58 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:57:59.040411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0296d-58ad-4a5f-aa28-a28cf38ed04b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:59.068038 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0296d-58ad-4a5f-aa28-a28cf38ed04b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:59.078745 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949e9e9-f718-419a-8db0-8f71530fe68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:59.079706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949e9e9-f718-419a-8db0-8f71530fe68b admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:59.081339 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949e9e9-f718-419a-8db0-8f71530fe68b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:59.081860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949e9e9-f718-419a-8db0-8f71530fe68b admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:59.083552 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949e9e9-f718-419a-8db0-8f71530fe68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:59.085322 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949e9e9-f718-419a-8db0-8f71530fe68b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:59.098432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1281/2575] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:57:59.102371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a12a31-f983-4ced-bc29-5554cc237b3a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:59.117095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a12a31-f983-4ced-bc29-5554cc237b3a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:59.123420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833d677-884c-44a5-9eed-a643943269ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:59.124501 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d677-884c-44a5-9eed-a643943269ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:59.124779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d677-884c-44a5-9eed-a643943269ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:59.125111 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833d677-884c-44a5-9eed-a643943269ec admin admin] PATH_INFO: `/v3/projects/17b5baa3847c426a808130c54e1b4cfa/users/a6a65bfa3cf44585b56a4d10e948017f/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:59.146265 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833d677-884c-44a5-9eed-a643943269ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b5baa3847c426a808130c54e1b4cfa, user_id=a6a65bfa3cf44585b56a4d10e948017f, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:59.149309 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833d677-884c-44a5-9eed-a643943269ec admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:59.171389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1295/2576] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:57:59 2022] PUT /identity/v3/projects/17b5baa3847c426a808130c54e1b4cfa/users/a6a65bfa3cf44585b56a4d10e948017f/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:57:59.175727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949e9e9-f718-419a-8db0-8f71530fe68b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:59.186170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949e9e9-f718-419a-8db0-8f71530fe68b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:59.251407 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbce378-d6c1-4b70-bb36-e3a00a27563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:59.252344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbce378-d6c1-4b70-bb36-e3a00a27563c admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:59.252804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbce378-d6c1-4b70-bb36-e3a00a27563c admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:59.253082 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbce378-d6c1-4b70-bb36-e3a00a27563c admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:59.253819 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbce378-d6c1-4b70-bb36-e3a00a27563c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:59.255461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbce378-d6c1-4b70-bb36-e3a00a27563c admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:59.265594 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1282/2577] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:57:59.269551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833d677-884c-44a5-9eed-a643943269ec admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:59.280525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833d677-884c-44a5-9eed-a643943269ec admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:59.285152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1aa139-5354-44ae-91e5-1c51537fb7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:59.286053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aa139-5354-44ae-91e5-1c51537fb7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:59.286360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aa139-5354-44ae-91e5-1c51537fb7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:59.286636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1aa139-5354-44ae-91e5-1c51537fb7b8 admin admin] PATH_INFO: `/v3/projects/17b5baa3847c426a808130c54e1b4cfa/users/a6a65bfa3cf44585b56a4d10e948017f/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:59.288601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1aa139-5354-44ae-91e5-1c51537fb7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b5baa3847c426a808130c54e1b4cfa, user_id=a6a65bfa3cf44585b56a4d10e948017f, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:59.291538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1aa139-5354-44ae-91e5-1c51537fb7b8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:59.303266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1296/2578] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:57:59 2022] PUT /identity/v3/projects/17b5baa3847c426a808130c54e1b4cfa/users/a6a65bfa3cf44585b56a4d10e948017f/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:57:59.315050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab60d-f0c9-46ad-8109-2f4e04e62665 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:59.315366 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab60d-f0c9-46ad-8109-2f4e04e62665 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:59.315641 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ab60d-f0c9-46ad-8109-2f4e04e62665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:59.342372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b46ab60d-f0c9-46ad-8109-2f4e04e62665 None None] MFA Rules not processed for user `a6a65bfa3cf44585b56a4d10e948017f`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:57:59.343630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b46ab60d-f0c9-46ad-8109-2f4e04e62665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:59.411919 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1283/2579] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:57:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:57:59.422892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1aa139-5354-44ae-91e5-1c51537fb7b8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:59.424783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9c1aa139-5354-44ae-91e5-1c51537fb7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:59.481423 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1aa139-5354-44ae-91e5-1c51537fb7b8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:59.485127 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455b25f-626c-43a3-a429-63bf4d6a8870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:59.485775 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b25f-626c-43a3-a429-63bf4d6a8870 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:59.486055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b25f-626c-43a3-a429-63bf4d6a8870 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:59.486351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b25f-626c-43a3-a429-63bf4d6a8870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:59.495792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455b25f-626c-43a3-a429-63bf4d6a8870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:59.498086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455b25f-626c-43a3-a429-63bf4d6a8870 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:59.507631 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1297/2580] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:57:59.551403 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ab60d-f0c9-46ad-8109-2f4e04e62665 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:57:59.552766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b46ab60d-f0c9-46ad-8109-2f4e04e62665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:57:59.565117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ab60d-f0c9-46ad-8109-2f4e04e62665 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:57:59.568746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04e9b6-c703-40bf-95de-677831a751d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:57:59.569385 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04e9b6-c703-40bf-95de-677831a751d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:57:59.569668 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04e9b6-c703-40bf-95de-677831a751d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:57:59.569942 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04e9b6-c703-40bf-95de-677831a751d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:57:59.627233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04e9b6-c703-40bf-95de-677831a751d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:57:59.628584 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04e9b6-c703-40bf-95de-677831a751d9 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:57:59.637361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1284/2581] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:57:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:58:02.079158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455b25f-626c-43a3-a429-63bf4d6a8870 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:02.080636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9455b25f-626c-43a3-a429-63bf4d6a8870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:02.146693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455b25f-626c-43a3-a429-63bf4d6a8870 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:02.151231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:02.152796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:02.153109 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:02.153387 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] PATH_INFO: `/v3/users/4e05ae1c6a054a299e841d008f9d7a09` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:02.154610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e05ae1c6a054a299e841d008f9d7a09)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:02.156518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:02.200513 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e05ae1c6a054a299e841d008f9d7a09'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.211646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e05ae1c6a054a299e841d008f9d7a09'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.212299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e05ae1c6a054a299e841d008f9d7a09'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.212919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e05ae1c6a054a299e841d008f9d7a09'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.220009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e05ae1c6a054a299e841d008f9d7a09'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.232531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1298/2582] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:02 2022] DELETE /identity/v3/users/4e05ae1c6a054a299e841d008f9d7a09 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:02.409688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04e9b6-c703-40bf-95de-677831a751d9 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:02.427894 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04e9b6-c703-40bf-95de-677831a751d9 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:02.489512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:02.490286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:02.490593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:02.490868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] PATH_INFO: `/v3/projects/83d6b6f0aa4f4314811ee80480861958` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:02.492285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d6b6f0aa4f4314811ee80480861958)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:02.494474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:02.539216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d6b6f0aa4f4314811ee80480861958', 'request_id': 'req-70755b1d-b7ac-4015-8c90-a8169fd62a2d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.547340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d6b6f0aa4f4314811ee80480861958', 'request_id': 'req-70755b1d-b7ac-4015-8c90-a8169fd62a2d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.552540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d6b6f0aa4f4314811ee80480861958', 'request_id': 'req-70755b1d-b7ac-4015-8c90-a8169fd62a2d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.565231 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] The token cache is being invalidate because project 83d6b6f0aa4f4314811ee80480861958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:02.565624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.566275 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.570734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1285/2583] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:02 2022] DELETE /identity/v3/projects/83d6b6f0aa4f4314811ee80480861958 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:02.571836 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:02.573216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:02.591703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6919f60-b4eb-47bc-a348-88422a62026e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:02.657470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:02.658351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:02.658632 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:02.658902 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] PATH_INFO: `/v3/users/b49090f58f3748acb94a885c416ae7e2` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:02.660091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49090f58f3748acb94a885c416ae7e2)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:02.662020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:02.710221 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49090f58f3748acb94a885c416ae7e2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.722255 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49090f58f3748acb94a885c416ae7e2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.723132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49090f58f3748acb94a885c416ae7e2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.723968 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49090f58f3748acb94a885c416ae7e2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.733595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49090f58f3748acb94a885c416ae7e2'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:02.750466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1299/2584] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:02 2022] DELETE /identity/v3/users/b49090f58f3748acb94a885c416ae7e2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:02.945280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:02.947096 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:02.967683 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70755b1d-b7ac-4015-8c90-a8169fd62a2d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:03.046470 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:03.047484 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:03.047808 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:03.048146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] PATH_INFO: `/v3/projects/d957ce2b30644c3bb7b43134161a5f69` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:03.049464 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d957ce2b30644c3bb7b43134161a5f69)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:03.051652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:03.082360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:03.090856 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:03.108099 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d10e2c-6d75-4aca-92ad-08e2994387d2 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:03.113506 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd957ce2b30644c3bb7b43134161a5f69', 'request_id': 'req-afd65906-caf7-4b90-98ea-91381de907eb'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.131487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd957ce2b30644c3bb7b43134161a5f69', 'request_id': 'req-afd65906-caf7-4b90-98ea-91381de907eb'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.139346 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd957ce2b30644c3bb7b43134161a5f69', 'request_id': 'req-afd65906-caf7-4b90-98ea-91381de907eb'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.153621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] The token cache is being invalidate because project d957ce2b30644c3bb7b43134161a5f69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:03.154193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.155467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-afd65906-caf7-4b90-98ea-91381de907eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.167276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1286/2585] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:02 2022] DELETE /identity/v3/projects/d957ce2b30644c3bb7b43134161a5f69 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:03.178594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:03.179718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:03.180010 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:03.180548 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] PATH_INFO: `/v3/users/0d477a0495de4b7295d077f4d04a4f9a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:03.182797 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d477a0495de4b7295d077f4d04a4f9a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:03.185543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:03.246216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d477a0495de4b7295d077f4d04a4f9a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.261868 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d477a0495de4b7295d077f4d04a4f9a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.263034 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d477a0495de4b7295d077f4d04a4f9a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.263723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d477a0495de4b7295d077f4d04a4f9a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.273409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d477a0495de4b7295d077f4d04a4f9a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.292373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1300/2586] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:03 2022] DELETE /identity/v3/users/0d477a0495de4b7295d077f4d04a4f9a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:03.297840 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1732e-dbd7-4b62-8847-aff55ff6fb58 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:03.298461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1732e-dbd7-4b62-8847-aff55ff6fb58 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:03.298952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1732e-dbd7-4b62-8847-aff55ff6fb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:03.321338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-15e1732e-dbd7-4b62-8847-aff55ff6fb58 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:03.322684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-15e1732e-dbd7-4b62-8847-aff55ff6fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:03.393070 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1287/2587] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:03.400949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:03.402770 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:03.462869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181e26a-e5b2-4d49-af29-ace98f6edd94 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:03.466687 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cd8e2-b7b9-4bea-9c71-86ec1c578adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:03.467333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cd8e2-b7b9-4bea-9c71-86ec1c578adb service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:03.467617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cd8e2-b7b9-4bea-9c71-86ec1c578adb service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:03.467893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cd8e2-b7b9-4bea-9c71-86ec1c578adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:03.477086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cd8e2-b7b9-4bea-9c71-86ec1c578adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:03.478551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cd8e2-b7b9-4bea-9c71-86ec1c578adb service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:03.488684 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1301/2588] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:03.744477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1732e-dbd7-4b62-8847-aff55ff6fb58 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:03.746204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-15e1732e-dbd7-4b62-8847-aff55ff6fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:03.763968 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1732e-dbd7-4b62-8847-aff55ff6fb58 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:03.768853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:03.769567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:03.769945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:03.770091 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] PATH_INFO: `/v3/projects/b2611ebbd33244718735ddacb3546dbd` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:03.771356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2611ebbd33244718735ddacb3546dbd)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:03.773250 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:03.819171 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2611ebbd33244718735ddacb3546dbd', 'request_id': 'req-668d6e48-9269-417d-8d6e-6d132b331b94'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.826625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2611ebbd33244718735ddacb3546dbd', 'request_id': 'req-668d6e48-9269-417d-8d6e-6d132b331b94'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.832073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2611ebbd33244718735ddacb3546dbd', 'request_id': 'req-668d6e48-9269-417d-8d6e-6d132b331b94'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.845914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] The token cache is being invalidate because project b2611ebbd33244718735ddacb3546dbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:03.846206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.846887 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.851211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1288/2589] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:03 2022] DELETE /identity/v3/projects/b2611ebbd33244718735ddacb3546dbd => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:03.852365 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cd8e2-b7b9-4bea-9c71-86ec1c578adb service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:03.862742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cd8e2-b7b9-4bea-9c71-86ec1c578adb service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:03.917199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a88e2a-39c0-47bd-af5e-58efb70507bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:03.918802 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a88e2a-39c0-47bd-af5e-58efb70507bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:03.919066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a88e2a-39c0-47bd-af5e-58efb70507bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:03.919341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a88e2a-39c0-47bd-af5e-58efb70507bc admin admin] PATH_INFO: `/v3/users/a6a65bfa3cf44585b56a4d10e948017f` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:03.920526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a88e2a-39c0-47bd-af5e-58efb70507bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a65bfa3cf44585b56a4d10e948017f)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:03.922466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a88e2a-39c0-47bd-af5e-58efb70507bc admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:03.964874 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-94a88e2a-39c0-47bd-af5e-58efb70507bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a65bfa3cf44585b56a4d10e948017f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.976176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-94a88e2a-39c0-47bd-af5e-58efb70507bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a65bfa3cf44585b56a4d10e948017f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.976836 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-94a88e2a-39c0-47bd-af5e-58efb70507bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a65bfa3cf44585b56a4d10e948017f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.977441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-94a88e2a-39c0-47bd-af5e-58efb70507bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a65bfa3cf44585b56a4d10e948017f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.984716 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-94a88e2a-39c0-47bd-af5e-58efb70507bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a65bfa3cf44585b56a4d10e948017f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:03.996953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1302/2590] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:03 2022] DELETE /identity/v3/users/a6a65bfa3cf44585b56a4d10e948017f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:04.518332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:04.519773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:04.532881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d6e48-9269-417d-8d6e-6d132b331b94 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:04.592565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:04.593347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:04.593627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:04.593899 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] PATH_INFO: `/v3/projects/17b5baa3847c426a808130c54e1b4cfa` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:04.595102 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b5baa3847c426a808130c54e1b4cfa)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:04.597021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:04.641266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b5baa3847c426a808130c54e1b4cfa', 'request_id': 'req-571207b9-6a0c-441f-a2c6-4b6c16659571'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:04.647825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b5baa3847c426a808130c54e1b4cfa', 'request_id': 'req-571207b9-6a0c-441f-a2c6-4b6c16659571'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:04.653508 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b5baa3847c426a808130c54e1b4cfa', 'request_id': 'req-571207b9-6a0c-441f-a2c6-4b6c16659571'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:04.664330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] The token cache is being invalidate because project 17b5baa3847c426a808130c54e1b4cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:04.665206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:04.665876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-571207b9-6a0c-441f-a2c6-4b6c16659571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:04.667498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1289/2591] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:04 2022] DELETE /identity/v3/projects/17b5baa3847c426a808130c54e1b4cfa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:04.672587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90630be6-084e-4c40-9a4e-b308c6076d3c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:04.673085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90630be6-084e-4c40-9a4e-b308c6076d3c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:04.673185 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90630be6-084e-4c40-9a4e-b308c6076d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:04.691514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-90630be6-084e-4c40-9a4e-b308c6076d3c None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:04.692698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-90630be6-084e-4c40-9a4e-b308c6076d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:04.750216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1303/2592] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:04.758213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934c51-29fe-4136-b94c-c13f8c8d61e0 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:04.758703 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934c51-29fe-4136-b94c-c13f8c8d61e0 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:04.758800 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0934c51-29fe-4136-b94c-c13f8c8d61e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:04.777622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a0934c51-29fe-4136-b94c-c13f8c8d61e0 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:04.778846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a0934c51-29fe-4136-b94c-c13f8c8d61e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:04.786788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1290/2593] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:04.790927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90630be6-084e-4c40-9a4e-b308c6076d3c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:04.800880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90630be6-084e-4c40-9a4e-b308c6076d3c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:04.805407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf739ef-636e-495d-a34f-00e75bedf256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:04.806054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf739ef-636e-495d-a34f-00e75bedf256 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:04.806357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf739ef-636e-495d-a34f-00e75bedf256 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:04.806636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf739ef-636e-495d-a34f-00e75bedf256 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:04.807358 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf739ef-636e-495d-a34f-00e75bedf256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:58:04.807663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf739ef-636e-495d-a34f-00e75bedf256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:04.809865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf739ef-636e-495d-a34f-00e75bedf256 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:04.820903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1304/2594] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:58:04.825147 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934c51-29fe-4136-b94c-c13f8c8d61e0 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:04.834359 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0934c51-29fe-4136-b94c-c13f8c8d61e0 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:04.840041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3ed06-61c6-4dc8-9920-87fe99a4bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:04.840764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3ed06-61c6-4dc8-9920-87fe99a4bbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:04.841049 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3ed06-61c6-4dc8-9920-87fe99a4bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:04.841374 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3ed06-61c6-4dc8-9920-87fe99a4bbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:04.842069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3ed06-61c6-4dc8-9920-87fe99a4bbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:04.844351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3ed06-61c6-4dc8-9920-87fe99a4bbf1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:04.876926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1291/2595] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:58:04 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:58:04.881187 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf739ef-636e-495d-a34f-00e75bedf256 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:04.891163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf739ef-636e-495d-a34f-00e75bedf256 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:04.944291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8ddf2-5855-44ee-8cce-48a8755465f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:04.944964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ddf2-5855-44ee-8cce-48a8755465f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:04.945248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ddf2-5855-44ee-8cce-48a8755465f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:04.945521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ddf2-5855-44ee-8cce-48a8755465f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:04.946203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8ddf2-5855-44ee-8cce-48a8755465f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:04.948140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8ddf2-5855-44ee-8cce-48a8755465f2 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:04.967174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1305/2596] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:58:04 2022] POST /identity/v3/users => generated 294 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:58:04.971265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3ed06-61c6-4dc8-9920-87fe99a4bbf1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:04.982099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3ed06-61c6-4dc8-9920-87fe99a4bbf1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:04.987197 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5c726-33ae-4ad7-ae88-f182f6a7a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:04.987848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5c726-33ae-4ad7-ae88-f182f6a7a202 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:04.988132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5c726-33ae-4ad7-ae88-f182f6a7a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:04.988413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5c726-33ae-4ad7-ae88-f182f6a7a202 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:04.989182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5c726-33ae-4ad7-ae88-f182f6a7a202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:04.991106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5c726-33ae-4ad7-ae88-f182f6a7a202 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:05.002239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1292/2597] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:05.006038 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8ddf2-5855-44ee-8cce-48a8755465f2 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:05.015695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8ddf2-5855-44ee-8cce-48a8755465f2 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:05.020210 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aed0dc-9a95-461d-9c1a-0ee7cef08193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:05.020847 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aed0dc-9a95-461d-9c1a-0ee7cef08193 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.021125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aed0dc-9a95-461d-9c1a-0ee7cef08193 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.021394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aed0dc-9a95-461d-9c1a-0ee7cef08193 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.022113 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aed0dc-9a95-461d-9c1a-0ee7cef08193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:05.023735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aed0dc-9a95-461d-9c1a-0ee7cef08193 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:05.035278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1306/2598] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:58:05.039424 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5c726-33ae-4ad7-ae88-f182f6a7a202 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:05.049953 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5c726-33ae-4ad7-ae88-f182f6a7a202 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:05.054935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a1fd-2b14-4173-a29c-470cc4fd40cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:05.055801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a1fd-2b14-4173-a29c-470cc4fd40cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.056084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a1fd-2b14-4173-a29c-470cc4fd40cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.056358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861a1fd-2b14-4173-a29c-470cc4fd40cd admin admin] PATH_INFO: `/v3/projects/24d7338fb7bf49f2bc4cb8c45b5c593d/users/a6b491ce6d3a49ca8ab1d84361c67a6f/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.071344 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861a1fd-2b14-4173-a29c-470cc4fd40cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d7338fb7bf49f2bc4cb8c45b5c593d, user_id=a6b491ce6d3a49ca8ab1d84361c67a6f, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:05.074004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861a1fd-2b14-4173-a29c-470cc4fd40cd admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:05.087227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1293/2599] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:05 2022] PUT /identity/v3/projects/24d7338fb7bf49f2bc4cb8c45b5c593d/users/a6b491ce6d3a49ca8ab1d84361c67a6f/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:58:05.097368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc672c-dbd1-45d2-b119-dd1048522133 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.097713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc672c-dbd1-45d2-b119-dd1048522133 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.097997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc672c-dbd1-45d2-b119-dd1048522133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.124954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-5abc672c-dbd1-45d2-b119-dd1048522133 None None] MFA Rules not processed for user `a6b491ce6d3a49ca8ab1d84361c67a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:05.126325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-5abc672c-dbd1-45d2-b119-dd1048522133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:05.189142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1307/2600] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:05.193749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a1fd-2b14-4173-a29c-470cc4fd40cd admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:05.254094 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861a1fd-2b14-4173-a29c-470cc4fd40cd admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:05.258717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382cac6-3b7b-4ef9-83c2-6301f3531a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:05.259364 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382cac6-3b7b-4ef9-83c2-6301f3531a82 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.259646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382cac6-3b7b-4ef9-83c2-6301f3531a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.259921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8382cac6-3b7b-4ef9-83c2-6301f3531a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.260605 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382cac6-3b7b-4ef9-83c2-6301f3531a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:05.262737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8382cac6-3b7b-4ef9-83c2-6301f3531a82 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:05.287071 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1294/2601] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:58:05 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:05.291086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc672c-dbd1-45d2-b119-dd1048522133 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:05.302007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc672c-dbd1-45d2-b119-dd1048522133 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:05.354177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5fc95-7955-432d-b804-12a045dc005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:05.354867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5fc95-7955-432d-b804-12a045dc005b admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.355849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5fc95-7955-432d-b804-12a045dc005b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.356066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5fc95-7955-432d-b804-12a045dc005b admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.356796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5fc95-7955-432d-b804-12a045dc005b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:05.358744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5fc95-7955-432d-b804-12a045dc005b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:05.381311 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1308/2602] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:58:05 2022] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:05.382531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382cac6-3b7b-4ef9-83c2-6301f3531a82 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:05.392799 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8382cac6-3b7b-4ef9-83c2-6301f3531a82 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:05.397806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f70e4-2d21-47f7-afca-6e3ec7ed9e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:05.398504 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f70e4-2d21-47f7-afca-6e3ec7ed9e06 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.398788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f70e4-2d21-47f7-afca-6e3ec7ed9e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.399091 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f70e4-2d21-47f7-afca-6e3ec7ed9e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.399816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f70e4-2d21-47f7-afca-6e3ec7ed9e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:05.401431 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f70e4-2d21-47f7-afca-6e3ec7ed9e06 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:05.412684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1295/2603] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:05.416809 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5fc95-7955-432d-b804-12a045dc005b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:05.427370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5fc95-7955-432d-b804-12a045dc005b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:05.431927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02539d30-cb45-4c1a-bee1-2466e494924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:05.432785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539d30-cb45-4c1a-bee1-2466e494924e admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.433124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539d30-cb45-4c1a-bee1-2466e494924e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.433596 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539d30-cb45-4c1a-bee1-2466e494924e admin admin] PATH_INFO: `/v3/projects/1bbbea577cb24679bb1ca5b1665dcba0/users/a88bdaa6487a422f8ae0320a149c541d/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.447665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02539d30-cb45-4c1a-bee1-2466e494924e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbbea577cb24679bb1ca5b1665dcba0, user_id=a88bdaa6487a422f8ae0320a149c541d, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:05.450665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02539d30-cb45-4c1a-bee1-2466e494924e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:05.463025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1309/2604] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:05 2022] PUT /identity/v3/projects/1bbbea577cb24679bb1ca5b1665dcba0/users/a88bdaa6487a422f8ae0320a149c541d/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:58:05.467553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f70e4-2d21-47f7-afca-6e3ec7ed9e06 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:05.477276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f70e4-2d21-47f7-afca-6e3ec7ed9e06 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:05.531837 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7199c5b-6c24-43e1-9fec-05c12e280c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:05.532489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7199c5b-6c24-43e1-9fec-05c12e280c02 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.532770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7199c5b-6c24-43e1-9fec-05c12e280c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.533040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7199c5b-6c24-43e1-9fec-05c12e280c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.533749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7199c5b-6c24-43e1-9fec-05c12e280c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:05.535499 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7199c5b-6c24-43e1-9fec-05c12e280c02 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:05.544901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1296/2605] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:05.548950 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02539d30-cb45-4c1a-bee1-2466e494924e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:05.559181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02539d30-cb45-4c1a-bee1-2466e494924e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:05.563780 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca70bb-a124-4423-befd-045675bb70a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:05.564648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca70bb-a124-4423-befd-045675bb70a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.564925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca70bb-a124-4423-befd-045675bb70a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.565197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca70bb-a124-4423-befd-045675bb70a0 admin admin] PATH_INFO: `/v3/projects/1bbbea577cb24679bb1ca5b1665dcba0/users/a88bdaa6487a422f8ae0320a149c541d/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.567199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca70bb-a124-4423-befd-045675bb70a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbbea577cb24679bb1ca5b1665dcba0, user_id=a88bdaa6487a422f8ae0320a149c541d, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:05.569811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca70bb-a124-4423-befd-045675bb70a0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:05.580699 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1310/2606] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:05 2022] PUT /identity/v3/projects/1bbbea577cb24679bb1ca5b1665dcba0/users/a88bdaa6487a422f8ae0320a149c541d/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:05.592225 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db180e-0126-499f-8f32-8f1f2868489e None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.592521 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db180e-0126-499f-8f32-8f1f2868489e None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.592798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db180e-0126-499f-8f32-8f1f2868489e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.618349 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-78db180e-0126-499f-8f32-8f1f2868489e None None] MFA Rules not processed for user `a88bdaa6487a422f8ae0320a149c541d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:05.619473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-78db180e-0126-499f-8f32-8f1f2868489e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:05.682893 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1297/2607] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:05.693955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca70bb-a124-4423-befd-045675bb70a0 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:05.695683 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0bca70bb-a124-4423-befd-045675bb70a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:05.750763 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca70bb-a124-4423-befd-045675bb70a0 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:05.754346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e210b-55fb-4ad8-8a31-8defa177a173 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:05.754981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e210b-55fb-4ad8-8a31-8defa177a173 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.755269 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e210b-55fb-4ad8-8a31-8defa177a173 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.755534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e210b-55fb-4ad8-8a31-8defa177a173 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.764704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e210b-55fb-4ad8-8a31-8defa177a173 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:05.766116 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e210b-55fb-4ad8-8a31-8defa177a173 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:05.775131 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1311/2608] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:05.836717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db180e-0126-499f-8f32-8f1f2868489e None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:05.899795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db180e-0126-499f-8f32-8f1f2868489e None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:05.904678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:05.905779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.906118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.906442 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] PATH_INFO: `/v3/users/a6b491ce6d3a49ca8ab1d84361c67a6f` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:05.907756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b491ce6d3a49ca8ab1d84361c67a6f)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:05.909807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:05.953456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b491ce6d3a49ca8ab1d84361c67a6f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:05.964428 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b491ce6d3a49ca8ab1d84361c67a6f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:05.965183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b491ce6d3a49ca8ab1d84361c67a6f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:05.965774 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b491ce6d3a49ca8ab1d84361c67a6f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:05.972311 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b491ce6d3a49ca8ab1d84361c67a6f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:05.986468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1298/2609] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:05 2022] DELETE /identity/v3/users/a6b491ce6d3a49ca8ab1d84361c67a6f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:05.991062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ca0e3-34e1-49fc-bcd8-22e0eae61622 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:05.991384 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ca0e3-34e1-49fc-bcd8-22e0eae61622 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:05.991665 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ca0e3-34e1-49fc-bcd8-22e0eae61622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:06.009600 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-ac0ca0e3-34e1-49fc-bcd8-22e0eae61622 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:06.010832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ac0ca0e3-34e1-49fc-bcd8-22e0eae61622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:06.066983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1312/2610] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:06.077296 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:06.078699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:06.134137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec15f374-fb6b-4b76-ac0a-c210040be1a0 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:06.138527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a891a-1df2-45a3-80dc-fb1754a96170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:06.139166 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a891a-1df2-45a3-80dc-fb1754a96170 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:06.139444 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a891a-1df2-45a3-80dc-fb1754a96170 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:06.139712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a891a-1df2-45a3-80dc-fb1754a96170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:06.148356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a891a-1df2-45a3-80dc-fb1754a96170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:06.149778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a891a-1df2-45a3-80dc-fb1754a96170 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:06.159187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1299/2611] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:06.416202 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ca0e3-34e1-49fc-bcd8-22e0eae61622 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:06.417774 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ac0ca0e3-34e1-49fc-bcd8-22e0eae61622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:06.431100 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ca0e3-34e1-49fc-bcd8-22e0eae61622 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:06.437713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:06.438901 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:06.439170 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:06.439449 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] PATH_INFO: `/v3/projects/24d7338fb7bf49f2bc4cb8c45b5c593d` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:06.440723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d7338fb7bf49f2bc4cb8c45b5c593d)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:06.443591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:06.490654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d7338fb7bf49f2bc4cb8c45b5c593d', 'request_id': 'req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:06.497891 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d7338fb7bf49f2bc4cb8c45b5c593d', 'request_id': 'req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:06.504879 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d7338fb7bf49f2bc4cb8c45b5c593d', 'request_id': 'req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:06.515527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] The token cache is being invalidate because project 24d7338fb7bf49f2bc4cb8c45b5c593d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:06.515817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:06.516427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:06.517960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1313/2612] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:06 2022] DELETE /identity/v3/projects/24d7338fb7bf49f2bc4cb8c45b5c593d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:06.521891 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a891a-1df2-45a3-80dc-fb1754a96170 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:06.532169 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a891a-1df2-45a3-80dc-fb1754a96170 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:06.584794 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d7d3d5-ce3b-4522-8089-630caca1a0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:06.585678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7d3d5-ce3b-4522-8089-630caca1a0d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:06.585959 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7d3d5-ce3b-4522-8089-630caca1a0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:06.586230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7d3d5-ce3b-4522-8089-630caca1a0d5 admin admin] PATH_INFO: `/v3/users/a88bdaa6487a422f8ae0320a149c541d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:06.587459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7d3d5-ce3b-4522-8089-630caca1a0d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a88bdaa6487a422f8ae0320a149c541d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:06.589980 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d7d3d5-ce3b-4522-8089-630caca1a0d5 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:06.633960 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-82d7d3d5-ce3b-4522-8089-630caca1a0d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a88bdaa6487a422f8ae0320a149c541d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:06.646672 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-82d7d3d5-ce3b-4522-8089-630caca1a0d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a88bdaa6487a422f8ae0320a149c541d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:06.647319 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-82d7d3d5-ce3b-4522-8089-630caca1a0d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a88bdaa6487a422f8ae0320a149c541d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:06.647914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-82d7d3d5-ce3b-4522-8089-630caca1a0d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a88bdaa6487a422f8ae0320a149c541d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:06.654537 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-82d7d3d5-ce3b-4522-8089-630caca1a0d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a88bdaa6487a422f8ae0320a149c541d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:06.666591 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1300/2613] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:06 2022] DELETE /identity/v3/users/a88bdaa6487a422f8ae0320a149c541d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:06.936613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:06.938069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:06.952104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c9b6f-d2b4-462c-90e5-f2cc5cfa1b65 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.009089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.009938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.010217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.010521 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] PATH_INFO: `/v3/projects/1bbbea577cb24679bb1ca5b1665dcba0` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.011692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bbbea577cb24679bb1ca5b1665dcba0)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.013590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.056895 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bbbea577cb24679bb1ca5b1665dcba0', 'request_id': 'req-629503a7-e3a2-412f-9767-7283e73507ed'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:07.063573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bbbea577cb24679bb1ca5b1665dcba0', 'request_id': 'req-629503a7-e3a2-412f-9767-7283e73507ed'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:07.070810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bbbea577cb24679bb1ca5b1665dcba0', 'request_id': 'req-629503a7-e3a2-412f-9767-7283e73507ed'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:07.081077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] The token cache is being invalidate because project 1bbbea577cb24679bb1ca5b1665dcba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:07.081369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:07.081996 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-629503a7-e3a2-412f-9767-7283e73507ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:07.083626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1314/2614] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:06 2022] DELETE /identity/v3/projects/1bbbea577cb24679bb1ca5b1665dcba0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:07.088665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7edeb-0786-40a2-b286-5cf967a9e921 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.089170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7edeb-0786-40a2-b286-5cf967a9e921 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.089312 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7edeb-0786-40a2-b286-5cf967a9e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.107713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-11f7edeb-0786-40a2-b286-5cf967a9e921 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:07.108906 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-11f7edeb-0786-40a2-b286-5cf967a9e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:07.168627 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1301/2615] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:07.176284 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a24352-39e2-42b7-afd4-c4e337dc3b46 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.176580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a24352-39e2-42b7-afd4-c4e337dc3b46 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.176865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a24352-39e2-42b7-afd4-c4e337dc3b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.195191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-20a24352-39e2-42b7-afd4-c4e337dc3b46 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:07.196316 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-20a24352-39e2-42b7-afd4-c4e337dc3b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:07.205383 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1315/2616] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:07.209301 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7edeb-0786-40a2-b286-5cf967a9e921 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.219610 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7edeb-0786-40a2-b286-5cf967a9e921 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.224104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86f44e-ab2d-49c9-b95d-ce15c244b120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.224744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86f44e-ab2d-49c9-b95d-ce15c244b120 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.225037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86f44e-ab2d-49c9-b95d-ce15c244b120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.225293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86f44e-ab2d-49c9-b95d-ce15c244b120 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.226008 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86f44e-ab2d-49c9-b95d-ce15c244b120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:58:07.226341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86f44e-ab2d-49c9-b95d-ce15c244b120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.227922 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86f44e-ab2d-49c9-b95d-ce15c244b120 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.239227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1302/2617] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:58:07.243685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a24352-39e2-42b7-afd4-c4e337dc3b46 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.252797 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a24352-39e2-42b7-afd4-c4e337dc3b46 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.257394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0111b-9e25-4ae9-92c7-dd6238f4e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.258035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0111b-9e25-4ae9-92c7-dd6238f4e2ea admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.258340 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0111b-9e25-4ae9-92c7-dd6238f4e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.258628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0111b-9e25-4ae9-92c7-dd6238f4e2ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.259327 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0111b-9e25-4ae9-92c7-dd6238f4e2ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.261835 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0111b-9e25-4ae9-92c7-dd6238f4e2ea admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.286672 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1316/2618] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:58:07 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:07.290630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86f44e-ab2d-49c9-b95d-ce15c244b120 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.300239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86f44e-ab2d-49c9-b95d-ce15c244b120 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.357701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f3fc3-fe0d-4cab-986a-c91b29d7eded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.358405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f3fc3-fe0d-4cab-986a-c91b29d7eded admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.358689 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f3fc3-fe0d-4cab-986a-c91b29d7eded admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.358963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f3fc3-fe0d-4cab-986a-c91b29d7eded admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.359643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f3fc3-fe0d-4cab-986a-c91b29d7eded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.361546 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f3fc3-fe0d-4cab-986a-c91b29d7eded admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.380578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1303/2619] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:58:07 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:07.384537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0111b-9e25-4ae9-92c7-dd6238f4e2ea admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.395645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0111b-9e25-4ae9-92c7-dd6238f4e2ea admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.400255 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91797e3-f111-4523-a772-11dd198583b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.400912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91797e3-f111-4523-a772-11dd198583b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.401196 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91797e3-f111-4523-a772-11dd198583b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.401476 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91797e3-f111-4523-a772-11dd198583b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.402254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91797e3-f111-4523-a772-11dd198583b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.403893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91797e3-f111-4523-a772-11dd198583b3 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.415172 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1317/2620] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:07.419097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f3fc3-fe0d-4cab-986a-c91b29d7eded admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.428992 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f3fc3-fe0d-4cab-986a-c91b29d7eded admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.434243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b7da6-f517-413b-aa44-516fa8240373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.434927 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b7da6-f517-413b-aa44-516fa8240373 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.435209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b7da6-f517-413b-aa44-516fa8240373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.435481 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b7da6-f517-413b-aa44-516fa8240373 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.436206 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b7da6-f517-413b-aa44-516fa8240373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.437797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b7da6-f517-413b-aa44-516fa8240373 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.447497 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1304/2621] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:58:07.451454 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91797e3-f111-4523-a772-11dd198583b3 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.461245 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91797e3-f111-4523-a772-11dd198583b3 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.466606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b7c12-4a6c-4dc1-8035-ea9c4838748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.467485 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7c12-4a6c-4dc1-8035-ea9c4838748c admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.467796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7c12-4a6c-4dc1-8035-ea9c4838748c admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.468071 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b7c12-4a6c-4dc1-8035-ea9c4838748c admin admin] PATH_INFO: `/v3/projects/9453b028e1e04dafbb094dd3715d7b3d/users/5cdfb42b535a4f4485f6bf4971f6d63f/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.483168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b7c12-4a6c-4dc1-8035-ea9c4838748c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9453b028e1e04dafbb094dd3715d7b3d, user_id=5cdfb42b535a4f4485f6bf4971f6d63f, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.485981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b7c12-4a6c-4dc1-8035-ea9c4838748c admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.499189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1318/2622] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:07 2022] PUT /identity/v3/projects/9453b028e1e04dafbb094dd3715d7b3d/users/5cdfb42b535a4f4485f6bf4971f6d63f/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:07.509541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89332b2-b94f-4afb-aa84-68668c7ee192 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.509927 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89332b2-b94f-4afb-aa84-68668c7ee192 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.510273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89332b2-b94f-4afb-aa84-68668c7ee192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.536047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a89332b2-b94f-4afb-aa84-68668c7ee192 None None] MFA Rules not processed for user `5cdfb42b535a4f4485f6bf4971f6d63f`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:07.537227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a89332b2-b94f-4afb-aa84-68668c7ee192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:07.600307 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1305/2623] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:58:07.604723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b7c12-4a6c-4dc1-8035-ea9c4838748c admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.663331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b7c12-4a6c-4dc1-8035-ea9c4838748c admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.668832 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afa4e-9922-4913-b9b8-dd9e5a92352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.669483 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afa4e-9922-4913-b9b8-dd9e5a92352c admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.669769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afa4e-9922-4913-b9b8-dd9e5a92352c admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.670076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997afa4e-9922-4913-b9b8-dd9e5a92352c admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.670807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997afa4e-9922-4913-b9b8-dd9e5a92352c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.672702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997afa4e-9922-4913-b9b8-dd9e5a92352c admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.696145 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1319/2624] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:58:07 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 15:58:07.700273 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89332b2-b94f-4afb-aa84-68668c7ee192 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.710671 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89332b2-b94f-4afb-aa84-68668c7ee192 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.764177 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157d2ff-e1ca-433b-99b1-4cf393ac50f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.764833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157d2ff-e1ca-433b-99b1-4cf393ac50f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.765122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157d2ff-e1ca-433b-99b1-4cf393ac50f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.765398 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157d2ff-e1ca-433b-99b1-4cf393ac50f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.766088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157d2ff-e1ca-433b-99b1-4cf393ac50f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.768024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157d2ff-e1ca-433b-99b1-4cf393ac50f1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.788137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1306/2625] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:58:07 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:07.793469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afa4e-9922-4913-b9b8-dd9e5a92352c admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.804038 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997afa4e-9922-4913-b9b8-dd9e5a92352c admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.809252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d3679-0100-46eb-b6f0-793c7b978d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.809911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d3679-0100-46eb-b6f0-793c7b978d58 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.810199 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d3679-0100-46eb-b6f0-793c7b978d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.810541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d3679-0100-46eb-b6f0-793c7b978d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.811280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d3679-0100-46eb-b6f0-793c7b978d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.812880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d3679-0100-46eb-b6f0-793c7b978d58 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.823218 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1320/2626] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:07.827909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157d2ff-e1ca-433b-99b1-4cf393ac50f1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.838041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157d2ff-e1ca-433b-99b1-4cf393ac50f1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.844038 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8859ac7-b9d4-4569-8214-b76bdce9bcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.844951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8859ac7-b9d4-4569-8214-b76bdce9bcb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.845234 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8859ac7-b9d4-4569-8214-b76bdce9bcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.845511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8859ac7-b9d4-4569-8214-b76bdce9bcb3 admin admin] PATH_INFO: `/v3/projects/3fee0d5f3c9843daa9da10a8445042e8/users/3c69b3c070f044d2b683453c2d5e5608/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.861032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8859ac7-b9d4-4569-8214-b76bdce9bcb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fee0d5f3c9843daa9da10a8445042e8, user_id=3c69b3c070f044d2b683453c2d5e5608, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.863734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8859ac7-b9d4-4569-8214-b76bdce9bcb3 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.877533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1307/2627] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:07 2022] PUT /identity/v3/projects/3fee0d5f3c9843daa9da10a8445042e8/users/3c69b3c070f044d2b683453c2d5e5608/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:07.881283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d3679-0100-46eb-b6f0-793c7b978d58 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.891907 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d3679-0100-46eb-b6f0-793c7b978d58 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.945873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53bea1-2b65-4283-ac38-75d6b800ef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.946563 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53bea1-2b65-4283-ac38-75d6b800ef7c admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.946850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53bea1-2b65-4283-ac38-75d6b800ef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.947128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53bea1-2b65-4283-ac38-75d6b800ef7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.947852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53bea1-2b65-4283-ac38-75d6b800ef7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.950111 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53bea1-2b65-4283-ac38-75d6b800ef7c admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.959610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1321/2628] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:07.963745 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8859ac7-b9d4-4569-8214-b76bdce9bcb3 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:07.974483 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8859ac7-b9d4-4569-8214-b76bdce9bcb3 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:07.978972 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3a9b1-1a0e-4a4a-b1d9-1f9c2932621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:07.979867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3a9b1-1a0e-4a4a-b1d9-1f9c2932621f admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:07.980332 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3a9b1-1a0e-4a4a-b1d9-1f9c2932621f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:07.980611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3a9b1-1a0e-4a4a-b1d9-1f9c2932621f admin admin] PATH_INFO: `/v3/projects/3fee0d5f3c9843daa9da10a8445042e8/users/3c69b3c070f044d2b683453c2d5e5608/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:07.982579 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3a9b1-1a0e-4a4a-b1d9-1f9c2932621f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fee0d5f3c9843daa9da10a8445042e8, user_id=3c69b3c070f044d2b683453c2d5e5608, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:07.985270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3a9b1-1a0e-4a4a-b1d9-1f9c2932621f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:07.995338 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1308/2629] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:07 2022] PUT /identity/v3/projects/3fee0d5f3c9843daa9da10a8445042e8/users/3c69b3c070f044d2b683453c2d5e5608/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:08.006680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7eb86-c944-4e77-8a16-c4cfcc6520a7 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:08.007003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7eb86-c944-4e77-8a16-c4cfcc6520a7 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:08.007285 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7eb86-c944-4e77-8a16-c4cfcc6520a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:08.033604 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-50c7eb86-c944-4e77-8a16-c4cfcc6520a7 None None] MFA Rules not processed for user `3c69b3c070f044d2b683453c2d5e5608`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:08.034833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-50c7eb86-c944-4e77-8a16-c4cfcc6520a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:08.098721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1322/2630] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:08.109744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3a9b1-1a0e-4a4a-b1d9-1f9c2932621f admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:08.111638 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-67e3a9b1-1a0e-4a4a-b1d9-1f9c2932621f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:08.167244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3a9b1-1a0e-4a4a-b1d9-1f9c2932621f admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:08.171005 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e0444-91a9-4fd3-a4af-7cb14e326820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:08.171640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e0444-91a9-4fd3-a4af-7cb14e326820 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:08.171920 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e0444-91a9-4fd3-a4af-7cb14e326820 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:08.172193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e0444-91a9-4fd3-a4af-7cb14e326820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:08.180957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e0444-91a9-4fd3-a4af-7cb14e326820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:08.182412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e0444-91a9-4fd3-a4af-7cb14e326820 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:08.192191 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1309/2631] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:08.270746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7eb86-c944-4e77-8a16-c4cfcc6520a7 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:08.280193 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7eb86-c944-4e77-8a16-c4cfcc6520a7 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:08.283818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e60ce-4ca2-4d82-936f-62e25f25d5dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:08.284450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e60ce-4ca2-4d82-936f-62e25f25d5dc service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:08.284733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e60ce-4ca2-4d82-936f-62e25f25d5dc service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:08.285009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e60ce-4ca2-4d82-936f-62e25f25d5dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:08.339815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e60ce-4ca2-4d82-936f-62e25f25d5dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:08.341236 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e60ce-4ca2-4d82-936f-62e25f25d5dc service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:08.349765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1323/2632] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:11.015773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e0444-91a9-4fd3-a4af-7cb14e326820 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:11.017269 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2a5e0444-91a9-4fd3-a4af-7cb14e326820 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:11.033296 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e0444-91a9-4fd3-a4af-7cb14e326820 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:11.036973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677dbde-9d19-4c36-b46f-b6ee9ea09363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:11.037601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677dbde-9d19-4c36-b46f-b6ee9ea09363 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:11.037879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677dbde-9d19-4c36-b46f-b6ee9ea09363 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:11.038289 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677dbde-9d19-4c36-b46f-b6ee9ea09363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:11.040073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8677dbde-9d19-4c36-b46f-b6ee9ea09363 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:11.138400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677dbde-9d19-4c36-b46f-b6ee9ea09363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:11.138400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677dbde-9d19-4c36-b46f-b6ee9ea09363 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:11.154354 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1310/2633] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:17.365742 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e60ce-4ca2-4d82-936f-62e25f25d5dc service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:17.433409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e60ce-4ca2-4d82-936f-62e25f25d5dc service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:17.438465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:17.439390 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:17.444893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:17.444893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] PATH_INFO: `/v3/users/5cdfb42b535a4f4485f6bf4971f6d63f` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:17.444893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cdfb42b535a4f4485f6bf4971f6d63f)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:17.444893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:17.491522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cdfb42b535a4f4485f6bf4971f6d63f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:17.503279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cdfb42b535a4f4485f6bf4971f6d63f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:17.503964 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cdfb42b535a4f4485f6bf4971f6d63f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:17.504675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cdfb42b535a4f4485f6bf4971f6d63f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:17.512098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cdfb42b535a4f4485f6bf4971f6d63f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:17.524920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1324/2634] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:17 2022] DELETE /identity/v3/users/5cdfb42b535a4f4485f6bf4971f6d63f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:17.530351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca097b-7780-4876-9edb-08978c2a91b2 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:17.530844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca097b-7780-4876-9edb-08978c2a91b2 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:17.531084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca097b-7780-4876-9edb-08978c2a91b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:17.548886 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-87ca097b-7780-4876-9edb-08978c2a91b2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:17.550189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-87ca097b-7780-4876-9edb-08978c2a91b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:17.611356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1311/2635] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:58:17.623270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:17.624772 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:17.680398 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578a30c-3c91-4a11-b820-03a6978385a4 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:17.684720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a013e5d-de60-466c-8382-544f9da4d530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:17.685363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013e5d-de60-466c-8382-544f9da4d530 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:17.685643 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013e5d-de60-466c-8382-544f9da4d530 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:17.685917 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a013e5d-de60-466c-8382-544f9da4d530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:17.694833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a013e5d-de60-466c-8382-544f9da4d530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:17.696288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a013e5d-de60-466c-8382-544f9da4d530 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:17.705564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1325/2636] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:18.027934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca097b-7780-4876-9edb-08978c2a91b2 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:18.029471 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-87ca097b-7780-4876-9edb-08978c2a91b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:18.048354 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca097b-7780-4876-9edb-08978c2a91b2 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:18.053106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:18.053983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:18.054266 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:18.054568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] PATH_INFO: `/v3/projects/9453b028e1e04dafbb094dd3715d7b3d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:18.055791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9453b028e1e04dafbb094dd3715d7b3d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:18.058458 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:18.116877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9453b028e1e04dafbb094dd3715d7b3d', 'request_id': 'req-2ce85028-22da-4587-8c1c-cb311da3cebc'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.127236 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9453b028e1e04dafbb094dd3715d7b3d', 'request_id': 'req-2ce85028-22da-4587-8c1c-cb311da3cebc'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.135551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9453b028e1e04dafbb094dd3715d7b3d', 'request_id': 'req-2ce85028-22da-4587-8c1c-cb311da3cebc'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.147209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] The token cache is being invalidate because project 9453b028e1e04dafbb094dd3715d7b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:18.147438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.148165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.153203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1312/2637] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:18 2022] DELETE /identity/v3/projects/9453b028e1e04dafbb094dd3715d7b3d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:18.154145 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a013e5d-de60-466c-8382-544f9da4d530 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:18.164123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a013e5d-de60-466c-8382-544f9da4d530 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:18.222729 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01caf7-184a-413b-a5ea-2d6b580fc637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:18.223684 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01caf7-184a-413b-a5ea-2d6b580fc637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:18.224030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01caf7-184a-413b-a5ea-2d6b580fc637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:18.224368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01caf7-184a-413b-a5ea-2d6b580fc637 admin admin] PATH_INFO: `/v3/users/3c69b3c070f044d2b683453c2d5e5608` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:18.225644 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01caf7-184a-413b-a5ea-2d6b580fc637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c69b3c070f044d2b683453c2d5e5608)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:18.227678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01caf7-184a-413b-a5ea-2d6b580fc637 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:18.273532 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-5f01caf7-184a-413b-a5ea-2d6b580fc637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c69b3c070f044d2b683453c2d5e5608'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.285318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-5f01caf7-184a-413b-a5ea-2d6b580fc637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c69b3c070f044d2b683453c2d5e5608'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.286002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-5f01caf7-184a-413b-a5ea-2d6b580fc637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c69b3c070f044d2b683453c2d5e5608'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.286619 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-5f01caf7-184a-413b-a5ea-2d6b580fc637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c69b3c070f044d2b683453c2d5e5608'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.293272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-5f01caf7-184a-413b-a5ea-2d6b580fc637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c69b3c070f044d2b683453c2d5e5608'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.305696 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1326/2638] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:18 2022] DELETE /identity/v3/users/3c69b3c070f044d2b683453c2d5e5608 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:18.626200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:18.627831 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:18.641503 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce85028-22da-4587-8c1c-cb311da3cebc admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:18.701500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:18.702413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:18.702682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:18.702908 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] PATH_INFO: `/v3/projects/3fee0d5f3c9843daa9da10a8445042e8` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:18.704093 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fee0d5f3c9843daa9da10a8445042e8)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:18.706156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:18.754528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fee0d5f3c9843daa9da10a8445042e8', 'request_id': 'req-e33063ef-6780-4493-b61c-f5e68f03e096'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.762368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fee0d5f3c9843daa9da10a8445042e8', 'request_id': 'req-e33063ef-6780-4493-b61c-f5e68f03e096'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.768013 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fee0d5f3c9843daa9da10a8445042e8', 'request_id': 'req-e33063ef-6780-4493-b61c-f5e68f03e096'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.779941 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] The token cache is being invalidate because project 3fee0d5f3c9843daa9da10a8445042e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:18.780230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.780876 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e33063ef-6780-4493-b61c-f5e68f03e096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:18.782435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1313/2639] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:18 2022] DELETE /identity/v3/projects/3fee0d5f3c9843daa9da10a8445042e8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:18.788268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0555b-4973-44aa-9906-a05567db9831 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:18.788743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0555b-4973-44aa-9906-a05567db9831 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:18.788843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0555b-4973-44aa-9906-a05567db9831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:18.809238 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-2cb0555b-4973-44aa-9906-a05567db9831 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:18.810253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-2cb0555b-4973-44aa-9906-a05567db9831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:18.871926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1327/2640] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:18.879730 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ec9f-e321-4373-8d12-860e39823d60 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:18.880022 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ec9f-e321-4373-8d12-860e39823d60 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:18.880297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ec9f-e321-4373-8d12-860e39823d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:18.899411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7967ec9f-e321-4373-8d12-860e39823d60 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:18.900615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7967ec9f-e321-4373-8d12-860e39823d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:18.909631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1314/2641] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:58:18.913761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0555b-4973-44aa-9906-a05567db9831 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:18.925746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0555b-4973-44aa-9906-a05567db9831 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:18.930255 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05aca7-9db5-420e-be5e-076d4751282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:18.930953 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05aca7-9db5-420e-be5e-076d4751282b admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:18.931318 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05aca7-9db5-420e-be5e-076d4751282b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:18.931500 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05aca7-9db5-420e-be5e-076d4751282b admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:18.932242 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05aca7-9db5-420e-be5e-076d4751282b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:58:18.932543 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05aca7-9db5-420e-be5e-076d4751282b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:18.935015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05aca7-9db5-420e-be5e-076d4751282b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:18.947376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1328/2642] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:58:18.953079 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967ec9f-e321-4373-8d12-860e39823d60 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:18.962973 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967ec9f-e321-4373-8d12-860e39823d60 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:18.968140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b39104-d7ce-498e-966a-0df8a2afc149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:18.968791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b39104-d7ce-498e-966a-0df8a2afc149 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:18.969075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b39104-d7ce-498e-966a-0df8a2afc149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:18.969354 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b39104-d7ce-498e-966a-0df8a2afc149 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:18.970048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b39104-d7ce-498e-966a-0df8a2afc149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:18.972065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b39104-d7ce-498e-966a-0df8a2afc149 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.002853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1315/2643] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:58:18 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:19.004227 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05aca7-9db5-420e-be5e-076d4751282b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:19.014747 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05aca7-9db5-420e-be5e-076d4751282b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:19.069411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5cfff-0faa-41c3-bed3-b0cad70fe96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:19.070073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5cfff-0faa-41c3-bed3-b0cad70fe96b admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.070389 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5cfff-0faa-41c3-bed3-b0cad70fe96b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.070668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5cfff-0faa-41c3-bed3-b0cad70fe96b admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.071413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5cfff-0faa-41c3-bed3-b0cad70fe96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:19.073301 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5cfff-0faa-41c3-bed3-b0cad70fe96b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.091963 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1329/2644] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:58:19 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:19.095946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b39104-d7ce-498e-966a-0df8a2afc149 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:19.106427 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b39104-d7ce-498e-966a-0df8a2afc149 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:19.110936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cb68f-1486-47b3-a3c0-1c4616a43563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:19.111583 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb68f-1486-47b3-a3c0-1c4616a43563 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.111862 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb68f-1486-47b3-a3c0-1c4616a43563 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.112134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb68f-1486-47b3-a3c0-1c4616a43563 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.112847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cb68f-1486-47b3-a3c0-1c4616a43563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:19.114716 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cb68f-1486-47b3-a3c0-1c4616a43563 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.126161 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1316/2645] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:19.129972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5cfff-0faa-41c3-bed3-b0cad70fe96b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:19.140103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5cfff-0faa-41c3-bed3-b0cad70fe96b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:19.144707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5420d-6162-4727-bfd0-c1ba33114b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:19.145399 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5420d-6162-4727-bfd0-c1ba33114b6f admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.145681 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5420d-6162-4727-bfd0-c1ba33114b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.145961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5420d-6162-4727-bfd0-c1ba33114b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.146725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5420d-6162-4727-bfd0-c1ba33114b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:19.148315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5420d-6162-4727-bfd0-c1ba33114b6f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.158101 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1330/2646] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:19.162238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cb68f-1486-47b3-a3c0-1c4616a43563 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:19.172776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cb68f-1486-47b3-a3c0-1c4616a43563 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:19.177631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e3b84-4d3d-4c95-9326-194311b3ca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:19.178532 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e3b84-4d3d-4c95-9326-194311b3ca80 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.178812 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e3b84-4d3d-4c95-9326-194311b3ca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.179084 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e3b84-4d3d-4c95-9326-194311b3ca80 admin admin] PATH_INFO: `/v3/projects/0b49543f256d49ab981853921a41a306/users/0fba6343e05042459605f03143dee691/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.195068 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e3b84-4d3d-4c95-9326-194311b3ca80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b49543f256d49ab981853921a41a306, user_id=0fba6343e05042459605f03143dee691, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:19.197845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e3b84-4d3d-4c95-9326-194311b3ca80 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.210392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1317/2647] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:19 2022] PUT /identity/v3/projects/0b49543f256d49ab981853921a41a306/users/0fba6343e05042459605f03143dee691/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:19.221336 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20a49-2d59-4f97-b8d0-84e193a44a2e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.221627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20a49-2d59-4f97-b8d0-84e193a44a2e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.221910 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b20a49-2d59-4f97-b8d0-84e193a44a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.248649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-69b20a49-2d59-4f97-b8d0-84e193a44a2e None None] MFA Rules not processed for user `0fba6343e05042459605f03143dee691`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:19.249841 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-69b20a49-2d59-4f97-b8d0-84e193a44a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:19.310580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1331/2648] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:19.315087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e3b84-4d3d-4c95-9326-194311b3ca80 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:19.374405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e3b84-4d3d-4c95-9326-194311b3ca80 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:19.378985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0ac03-86ba-42a7-9513-7bc5b3f2608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:19.379626 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0ac03-86ba-42a7-9513-7bc5b3f2608c admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.379904 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0ac03-86ba-42a7-9513-7bc5b3f2608c admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.380180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0ac03-86ba-42a7-9513-7bc5b3f2608c admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.380859 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0ac03-86ba-42a7-9513-7bc5b3f2608c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:19.382779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0ac03-86ba-42a7-9513-7bc5b3f2608c admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.407368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1318/2649] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:58:19 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:19.411110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b20a49-2d59-4f97-b8d0-84e193a44a2e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:19.422093 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b20a49-2d59-4f97-b8d0-84e193a44a2e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:19.475213 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5fddb-9370-4209-b35a-6b10042f22eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:19.475882 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fddb-9370-4209-b35a-6b10042f22eb admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.476166 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fddb-9370-4209-b35a-6b10042f22eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.476438 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5fddb-9370-4209-b35a-6b10042f22eb admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.477124 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5fddb-9370-4209-b35a-6b10042f22eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:19.479110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5fddb-9370-4209-b35a-6b10042f22eb admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.499152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1332/2650] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:58:19 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:19.503178 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0ac03-86ba-42a7-9513-7bc5b3f2608c admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:19.513331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0ac03-86ba-42a7-9513-7bc5b3f2608c admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:19.517890 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c6ace-e11f-4ab3-acc2-595f9f5475b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:19.518585 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c6ace-e11f-4ab3-acc2-595f9f5475b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.518867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c6ace-e11f-4ab3-acc2-595f9f5475b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.519138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c6ace-e11f-4ab3-acc2-595f9f5475b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.519890 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c6ace-e11f-4ab3-acc2-595f9f5475b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:19.521473 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c6ace-e11f-4ab3-acc2-595f9f5475b4 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.532370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1319/2651] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:19.536305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5fddb-9370-4209-b35a-6b10042f22eb admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:19.546518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5fddb-9370-4209-b35a-6b10042f22eb admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:19.551126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfda5a-fce0-4bc9-a89a-56c9b4a53ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:19.551994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfda5a-fce0-4bc9-a89a-56c9b4a53ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.552274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfda5a-fce0-4bc9-a89a-56c9b4a53ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.552545 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfda5a-fce0-4bc9-a89a-56c9b4a53ed0 admin admin] PATH_INFO: `/v3/projects/3c52c315bd8f426383e43cc84b1ca8ea/users/3162c7e7592142d8b14828443fa84f65/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.567608 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfda5a-fce0-4bc9-a89a-56c9b4a53ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c52c315bd8f426383e43cc84b1ca8ea, user_id=3162c7e7592142d8b14828443fa84f65, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:19.570278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcfda5a-fce0-4bc9-a89a-56c9b4a53ed0 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.583423 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1333/2652] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:19 2022] PUT /identity/v3/projects/3c52c315bd8f426383e43cc84b1ca8ea/users/3162c7e7592142d8b14828443fa84f65/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:19.587500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c6ace-e11f-4ab3-acc2-595f9f5475b4 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:19.598227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c6ace-e11f-4ab3-acc2-595f9f5475b4 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:19.655725 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85646e57-a839-4873-91c4-7bc68dedd072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:19.656396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646e57-a839-4873-91c4-7bc68dedd072 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.656676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646e57-a839-4873-91c4-7bc68dedd072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.656951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85646e57-a839-4873-91c4-7bc68dedd072 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.657670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85646e57-a839-4873-91c4-7bc68dedd072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:19.659283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85646e57-a839-4873-91c4-7bc68dedd072 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.669664 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1320/2653] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 15:58:19.673638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfda5a-fce0-4bc9-a89a-56c9b4a53ed0 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:19.683496 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfda5a-fce0-4bc9-a89a-56c9b4a53ed0 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:19.688030 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dba25-68c3-42d6-988b-0fbc6e4776ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:19.688898 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dba25-68c3-42d6-988b-0fbc6e4776ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.689176 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dba25-68c3-42d6-988b-0fbc6e4776ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.689466 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22dba25-68c3-42d6-988b-0fbc6e4776ab admin admin] PATH_INFO: `/v3/projects/3c52c315bd8f426383e43cc84b1ca8ea/users/3162c7e7592142d8b14828443fa84f65/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.691404 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22dba25-68c3-42d6-988b-0fbc6e4776ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c52c315bd8f426383e43cc84b1ca8ea, user_id=3162c7e7592142d8b14828443fa84f65, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:19.694000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22dba25-68c3-42d6-988b-0fbc6e4776ab admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.705436 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1334/2654] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:19 2022] PUT /identity/v3/projects/3c52c315bd8f426383e43cc84b1ca8ea/users/3162c7e7592142d8b14828443fa84f65/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:19.716879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814ce5-76ed-426e-b730-d5e1409ec4cd None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.717166 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814ce5-76ed-426e-b730-d5e1409ec4cd None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.717440 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814ce5-76ed-426e-b730-d5e1409ec4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.742950 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-43814ce5-76ed-426e-b730-d5e1409ec4cd None None] MFA Rules not processed for user `3162c7e7592142d8b14828443fa84f65`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:19.744376 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-43814ce5-76ed-426e-b730-d5e1409ec4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:19.809695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1321/2655] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:19.820222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dba25-68c3-42d6-988b-0fbc6e4776ab admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:19.821966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b22dba25-68c3-42d6-988b-0fbc6e4776ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:19.878373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22dba25-68c3-42d6-988b-0fbc6e4776ab admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:19.881975 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a8c22-c219-4e1f-a641-8b1b7607c7c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:19.882642 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a8c22-c219-4e1f-a641-8b1b7607c7c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:19.882926 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a8c22-c219-4e1f-a641-8b1b7607c7c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:19.883203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a8c22-c219-4e1f-a641-8b1b7607c7c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:19.936954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a8c22-c219-4e1f-a641-8b1b7607c7c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:19.938329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a8c22-c219-4e1f-a641-8b1b7607c7c7 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:19.946806 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1335/2656] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:26.000415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43814ce5-76ed-426e-b730-d5e1409ec4cd None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:26.001792 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-43814ce5-76ed-426e-b730-d5e1409ec4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:26.058184 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43814ce5-76ed-426e-b730-d5e1409ec4cd None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:26.061742 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847259b-fbbf-4613-9e8e-339313071de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:26.062409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847259b-fbbf-4613-9e8e-339313071de1 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:26.062695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847259b-fbbf-4613-9e8e-339313071de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:26.062999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847259b-fbbf-4613-9e8e-339313071de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:26.064765 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2847259b-fbbf-4613-9e8e-339313071de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:26.126518 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847259b-fbbf-4613-9e8e-339313071de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:26.128200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847259b-fbbf-4613-9e8e-339313071de1 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:26.139520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1322/2657] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:26.219598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a8c22-c219-4e1f-a641-8b1b7607c7c7 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:26.220936 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-916a8c22-c219-4e1f-a641-8b1b7607c7c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:26.232715 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a8c22-c219-4e1f-a641-8b1b7607c7c7 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:26.236343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e178f8-a68b-4c7b-8a0f-9b7f1a39cbfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:26.236982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e178f8-a68b-4c7b-8a0f-9b7f1a39cbfe service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:26.237268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e178f8-a68b-4c7b-8a0f-9b7f1a39cbfe service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:26.237547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e178f8-a68b-4c7b-8a0f-9b7f1a39cbfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:26.246813 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e178f8-a68b-4c7b-8a0f-9b7f1a39cbfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:26.248243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e178f8-a68b-4c7b-8a0f-9b7f1a39cbfe service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:26.257765 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1336/2658] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:29.567302 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847259b-fbbf-4613-9e8e-339313071de1 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:29.568867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2847259b-fbbf-4613-9e8e-339313071de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:29.580974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847259b-fbbf-4613-9e8e-339313071de1 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:29.585642 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca40f5-1ae8-4dd2-b144-53dc32357ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:29.586619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca40f5-1ae8-4dd2-b144-53dc32357ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:29.586770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca40f5-1ae8-4dd2-b144-53dc32357ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:29.587042 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca40f5-1ae8-4dd2-b144-53dc32357ce5 admin admin] PATH_INFO: `/v3/users/58bfb7417bc94583963401ae0fe9d39a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:29.589264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca40f5-1ae8-4dd2-b144-53dc32357ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58bfb7417bc94583963401ae0fe9d39a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:29.591352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca40f5-1ae8-4dd2-b144-53dc32357ce5 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:29.638351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1dca40f5-1ae8-4dd2-b144-53dc32357ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58bfb7417bc94583963401ae0fe9d39a'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:29.650054 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1dca40f5-1ae8-4dd2-b144-53dc32357ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58bfb7417bc94583963401ae0fe9d39a'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:29.650721 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1dca40f5-1ae8-4dd2-b144-53dc32357ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58bfb7417bc94583963401ae0fe9d39a'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:29.651388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1dca40f5-1ae8-4dd2-b144-53dc32357ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58bfb7417bc94583963401ae0fe9d39a'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:29.658122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-1dca40f5-1ae8-4dd2-b144-53dc32357ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58bfb7417bc94583963401ae0fe9d39a'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:29.671557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1323/2659] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:29 2022] DELETE /identity/v3/users/58bfb7417bc94583963401ae0fe9d39a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:29.840202 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e178f8-a68b-4c7b-8a0f-9b7f1a39cbfe service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:29.854043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e178f8-a68b-4c7b-8a0f-9b7f1a39cbfe service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:29.925735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:29.926640 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:29.926927 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:29.927206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] PATH_INFO: `/v3/projects/0672be3fa3f7414da1c1a5b7300abbe7` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:29.928467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0672be3fa3f7414da1c1a5b7300abbe7)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:29.930457 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:29.980313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0672be3fa3f7414da1c1a5b7300abbe7', 'request_id': 'req-55d461c8-e230-4790-bee2-a61a83b0404e'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:29.986350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0672be3fa3f7414da1c1a5b7300abbe7', 'request_id': 'req-55d461c8-e230-4790-bee2-a61a83b0404e'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:29.994076 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0672be3fa3f7414da1c1a5b7300abbe7', 'request_id': 'req-55d461c8-e230-4790-bee2-a61a83b0404e'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:30.004690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] The token cache is being invalidate because project 0672be3fa3f7414da1c1a5b7300abbe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:30.004983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:30.005651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-55d461c8-e230-4790-bee2-a61a83b0404e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:30.007226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1337/2660] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:29 2022] DELETE /identity/v3/projects/0672be3fa3f7414da1c1a5b7300abbe7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:30.012934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02963c0-ee99-4d0f-b6ce-5b4fa4d44476 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:30.013441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02963c0-ee99-4d0f-b6ce-5b4fa4d44476 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:30.013741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02963c0-ee99-4d0f-b6ce-5b4fa4d44476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:30.033471 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b02963c0-ee99-4d0f-b6ce-5b4fa4d44476 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:30.034709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b02963c0-ee99-4d0f-b6ce-5b4fa4d44476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:30.101283 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1324/2661] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:30.109260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6bb68-3bc5-4ac9-889f-b86d9d35c147 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:30.109859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6bb68-3bc5-4ac9-889f-b86d9d35c147 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:30.110419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6bb68-3bc5-4ac9-889f-b86d9d35c147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:30.130402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-61d6bb68-3bc5-4ac9-889f-b86d9d35c147 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:30.131530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-61d6bb68-3bc5-4ac9-889f-b86d9d35c147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:30.140257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1338/2662] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:30.144734 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02963c0-ee99-4d0f-b6ce-5b4fa4d44476 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:30.155258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02963c0-ee99-4d0f-b6ce-5b4fa4d44476 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:30.159997 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d0fa8-dc5f-4184-898d-54eeeda4a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:30.160719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d0fa8-dc5f-4184-898d-54eeeda4a00c admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:30.161083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d0fa8-dc5f-4184-898d-54eeeda4a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:30.161419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d0fa8-dc5f-4184-898d-54eeeda4a00c admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:30.162278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d0fa8-dc5f-4184-898d-54eeeda4a00c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:58:30.162620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d0fa8-dc5f-4184-898d-54eeeda4a00c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:30.164256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d0fa8-dc5f-4184-898d-54eeeda4a00c admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:30.177039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1325/2663] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:58:30.181348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6bb68-3bc5-4ac9-889f-b86d9d35c147 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:30.190613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6bb68-3bc5-4ac9-889f-b86d9d35c147 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:30.195248 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dc53b-eb44-4c68-aefa-d2e7d950e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:30.195894 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dc53b-eb44-4c68-aefa-d2e7d950e82d admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:30.196174 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dc53b-eb44-4c68-aefa-d2e7d950e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:30.196451 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dc53b-eb44-4c68-aefa-d2e7d950e82d admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:30.197142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dc53b-eb44-4c68-aefa-d2e7d950e82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:30.199338 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dc53b-eb44-4c68-aefa-d2e7d950e82d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:30.224385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1339/2664] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:58:30 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:30.228676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d0fa8-dc5f-4184-898d-54eeeda4a00c admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:30.239792 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d0fa8-dc5f-4184-898d-54eeeda4a00c admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:30.297122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc24c-d631-4f39-8cf4-c74b3c10ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:30.297810 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc24c-d631-4f39-8cf4-c74b3c10ff3e admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:30.298097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc24c-d631-4f39-8cf4-c74b3c10ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:30.298404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddc24c-d631-4f39-8cf4-c74b3c10ff3e admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:30.299193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddc24c-d631-4f39-8cf4-c74b3c10ff3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:30.301144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddc24c-d631-4f39-8cf4-c74b3c10ff3e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:30.325386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1326/2665] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:58:30 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:30.326658 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dc53b-eb44-4c68-aefa-d2e7d950e82d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:30.336827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dc53b-eb44-4c68-aefa-d2e7d950e82d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:30.342360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441e14b-dd0b-4392-bb4c-027cd41f5fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:30.343026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441e14b-dd0b-4392-bb4c-027cd41f5fff admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:30.343312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441e14b-dd0b-4392-bb4c-027cd41f5fff admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:30.343590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441e14b-dd0b-4392-bb4c-027cd41f5fff admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:30.344329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441e14b-dd0b-4392-bb4c-027cd41f5fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:30.345942 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441e14b-dd0b-4392-bb4c-027cd41f5fff admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:30.358170 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1340/2666] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:30.362132 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc24c-d631-4f39-8cf4-c74b3c10ff3e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:30.373062 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddc24c-d631-4f39-8cf4-c74b3c10ff3e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:30.377990 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe67c-beb8-41c8-b7a2-74208b8ad4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:30.378664 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe67c-beb8-41c8-b7a2-74208b8ad4ae admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:30.378969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe67c-beb8-41c8-b7a2-74208b8ad4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:30.379243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe67c-beb8-41c8-b7a2-74208b8ad4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:30.379969 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fe67c-beb8-41c8-b7a2-74208b8ad4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:30.381676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fe67c-beb8-41c8-b7a2-74208b8ad4ae admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:30.392386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1327/2667] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:30.396817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441e14b-dd0b-4392-bb4c-027cd41f5fff admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:30.410376 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441e14b-dd0b-4392-bb4c-027cd41f5fff admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:30.416441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9791601-4873-44a2-91b7-2ed6b82a768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:30.417354 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9791601-4873-44a2-91b7-2ed6b82a768c admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:30.417669 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9791601-4873-44a2-91b7-2ed6b82a768c admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:30.417948 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9791601-4873-44a2-91b7-2ed6b82a768c admin admin] PATH_INFO: `/v3/projects/882808bd43644908a21ff8a58997c57f/users/742938d3a02a4c8babf518b7b6cf53a7/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:30.435211 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9791601-4873-44a2-91b7-2ed6b82a768c admin admin] RBAC: Authorizing `identity:create_grant(project_id=882808bd43644908a21ff8a58997c57f, user_id=742938d3a02a4c8babf518b7b6cf53a7, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:30.438459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9791601-4873-44a2-91b7-2ed6b82a768c admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:30.451744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1341/2668] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:30 2022] PUT /identity/v3/projects/882808bd43644908a21ff8a58997c57f/users/742938d3a02a4c8babf518b7b6cf53a7/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:30.456945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf3790-ddbc-43d1-8379-831a73113175 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:30.457288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf3790-ddbc-43d1-8379-831a73113175 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:30.457570 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf3790-ddbc-43d1-8379-831a73113175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:30.476702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c6cf3790-ddbc-43d1-8379-831a73113175 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:30.477886 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c6cf3790-ddbc-43d1-8379-831a73113175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:30.541419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1328/2669] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:30.551994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9791601-4873-44a2-91b7-2ed6b82a768c admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:30.553733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e9791601-4873-44a2-91b7-2ed6b82a768c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:30.616462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9791601-4873-44a2-91b7-2ed6b82a768c admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:30.621073 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d844140-930c-4ab8-bd27-f578bd5bb23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:30.621736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d844140-930c-4ab8-bd27-f578bd5bb23b service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:30.622022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d844140-930c-4ab8-bd27-f578bd5bb23b service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:30.622331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d844140-930c-4ab8-bd27-f578bd5bb23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:30.631540 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d844140-930c-4ab8-bd27-f578bd5bb23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:30.632978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d844140-930c-4ab8-bd27-f578bd5bb23b service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:30.642535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1342/2670] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:31.201310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf3790-ddbc-43d1-8379-831a73113175 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:31.202801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c6cf3790-ddbc-43d1-8379-831a73113175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:31.215479 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf3790-ddbc-43d1-8379-831a73113175 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:31.220297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:31.221245 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:31.221524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:31.221795 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] PATH_INFO: `/v3/users/0fba6343e05042459605f03143dee691` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:31.223090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fba6343e05042459605f03143dee691)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:31.225092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:31.274188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fba6343e05042459605f03143dee691'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:31.287100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fba6343e05042459605f03143dee691'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:31.287852 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fba6343e05042459605f03143dee691'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:31.288472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fba6343e05042459605f03143dee691'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:31.295750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fba6343e05042459605f03143dee691'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:31.309962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1329/2671] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:31 2022] DELETE /identity/v3/users/0fba6343e05042459605f03143dee691 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:31.314919 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4327-49da-4bd9-aed9-4909dba4a57a None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:31.315409 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4327-49da-4bd9-aed9-4909dba4a57a None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:31.315538 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d4327-49da-4bd9-aed9-4909dba4a57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:31.332882 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-832d4327-49da-4bd9-aed9-4909dba4a57a None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:31.334075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-832d4327-49da-4bd9-aed9-4909dba4a57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:31.394123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1343/2672] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:31.404208 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:31.406040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:31.465137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584aac3-fba8-48b1-b828-ea7e517b0210 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:31.468909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a713eb0-084a-443e-90b8-40a2d8a4bdf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:31.469557 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713eb0-084a-443e-90b8-40a2d8a4bdf4 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:31.469837 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713eb0-084a-443e-90b8-40a2d8a4bdf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:31.470108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a713eb0-084a-443e-90b8-40a2d8a4bdf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:31.479696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a713eb0-084a-443e-90b8-40a2d8a4bdf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:31.481229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a713eb0-084a-443e-90b8-40a2d8a4bdf4 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:31.494624 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1330/2673] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:58:32.090779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d4327-49da-4bd9-aed9-4909dba4a57a None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:32.092469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-832d4327-49da-4bd9-aed9-4909dba4a57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:32.113594 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d4327-49da-4bd9-aed9-4909dba4a57a None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:32.124714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:32.125846 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:32.126441 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:32.126875 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] PATH_INFO: `/v3/projects/0b49543f256d49ab981853921a41a306` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:32.129299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b49543f256d49ab981853921a41a306)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:32.133167 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:32.196578 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b49543f256d49ab981853921a41a306', 'request_id': 'req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.203258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b49543f256d49ab981853921a41a306', 'request_id': 'req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.212256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b49543f256d49ab981853921a41a306', 'request_id': 'req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.225462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] The token cache is being invalidate because project 0b49543f256d49ab981853921a41a306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:32.225886 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.230913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.235523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1344/2674] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:32 2022] DELETE /identity/v3/projects/0b49543f256d49ab981853921a41a306 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:32.236833 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a713eb0-084a-443e-90b8-40a2d8a4bdf4 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:32.249527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a713eb0-084a-443e-90b8-40a2d8a4bdf4 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:32.320265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4358f-284c-4382-ae27-1f0e3f7a2e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:32.321149 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4358f-284c-4382-ae27-1f0e3f7a2e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:32.321438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4358f-284c-4382-ae27-1f0e3f7a2e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:32.321719 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4358f-284c-4382-ae27-1f0e3f7a2e9f admin admin] PATH_INFO: `/v3/users/3162c7e7592142d8b14828443fa84f65` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:32.322979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4358f-284c-4382-ae27-1f0e3f7a2e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3162c7e7592142d8b14828443fa84f65)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:32.325104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4358f-284c-4382-ae27-1f0e3f7a2e9f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:32.379915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fdc4358f-284c-4382-ae27-1f0e3f7a2e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3162c7e7592142d8b14828443fa84f65'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.393940 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fdc4358f-284c-4382-ae27-1f0e3f7a2e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3162c7e7592142d8b14828443fa84f65'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.394928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fdc4358f-284c-4382-ae27-1f0e3f7a2e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3162c7e7592142d8b14828443fa84f65'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.395718 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fdc4358f-284c-4382-ae27-1f0e3f7a2e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3162c7e7592142d8b14828443fa84f65'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.403709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-fdc4358f-284c-4382-ae27-1f0e3f7a2e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3162c7e7592142d8b14828443fa84f65'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.431851 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1331/2675] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:32 2022] DELETE /identity/v3/users/3162c7e7592142d8b14828443fa84f65 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:32.736325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:32.738035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:32.753504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a59d4b-1192-40ff-9a1c-4b870aaadaa8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:32.816613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:32.817384 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:32.817667 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:32.817944 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] PATH_INFO: `/v3/projects/3c52c315bd8f426383e43cc84b1ca8ea` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:32.819240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c52c315bd8f426383e43cc84b1ca8ea)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:32.821204 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:32.870758 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c52c315bd8f426383e43cc84b1ca8ea', 'request_id': 'req-7827d377-515a-433e-826a-ba06d63fbc5a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.877402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c52c315bd8f426383e43cc84b1ca8ea', 'request_id': 'req-7827d377-515a-433e-826a-ba06d63fbc5a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.885081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c52c315bd8f426383e43cc84b1ca8ea', 'request_id': 'req-7827d377-515a-433e-826a-ba06d63fbc5a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.895549 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] The token cache is being invalidate because project 3c52c315bd8f426383e43cc84b1ca8ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:32.895833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.896464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-7827d377-515a-433e-826a-ba06d63fbc5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:32.898012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1345/2676] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:32 2022] DELETE /identity/v3/projects/3c52c315bd8f426383e43cc84b1ca8ea => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:32.904625 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81637fb-fd20-4cc5-897d-a9a548d5188d None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:32.904912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81637fb-fd20-4cc5-897d-a9a548d5188d None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:32.905186 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81637fb-fd20-4cc5-897d-a9a548d5188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:32.924538 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-a81637fb-fd20-4cc5-897d-a9a548d5188d None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:32.925877 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-a81637fb-fd20-4cc5-897d-a9a548d5188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:32.989500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1332/2677] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:32.998650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984073c-99ba-48a6-bc32-db6a35eff871 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:32.999033 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984073c-99ba-48a6-bc32-db6a35eff871 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:32.999394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984073c-99ba-48a6-bc32-db6a35eff871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:33.019840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-5984073c-99ba-48a6-bc32-db6a35eff871 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:33.021356 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-5984073c-99ba-48a6-bc32-db6a35eff871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:33.031622 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1346/2678] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:33.035854 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81637fb-fd20-4cc5-897d-a9a548d5188d None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:33.046896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81637fb-fd20-4cc5-897d-a9a548d5188d None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:33.052330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff7d79-d1ae-4d75-98e6-74a07de445f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:33.053160 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff7d79-d1ae-4d75-98e6-74a07de445f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:33.053448 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff7d79-d1ae-4d75-98e6-74a07de445f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:33.053725 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff7d79-d1ae-4d75-98e6-74a07de445f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:33.054512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff7d79-d1ae-4d75-98e6-74a07de445f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:58:33.054826 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff7d79-d1ae-4d75-98e6-74a07de445f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:33.056925 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff7d79-d1ae-4d75-98e6-74a07de445f8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:33.075869 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984073c-99ba-48a6-bc32-db6a35eff871 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:33.086226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984073c-99ba-48a6-bc32-db6a35eff871 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:33.087298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1333/2679] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 15:58:33.095478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce570eaf-b322-4552-9675-5f567ebcae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:33.096323 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce570eaf-b322-4552-9675-5f567ebcae8d admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:33.096323 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce570eaf-b322-4552-9675-5f567ebcae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:33.097069 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce570eaf-b322-4552-9675-5f567ebcae8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:33.097773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce570eaf-b322-4552-9675-5f567ebcae8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:33.100039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce570eaf-b322-4552-9675-5f567ebcae8d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:33.138253 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1347/2680] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:58:33 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:33.143258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff7d79-d1ae-4d75-98e6-74a07de445f8 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:33.158190 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff7d79-d1ae-4d75-98e6-74a07de445f8 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:33.227021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b6fad-58e2-4c70-9cb9-06947fb18933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:33.227760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b6fad-58e2-4c70-9cb9-06947fb18933 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:33.228050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b6fad-58e2-4c70-9cb9-06947fb18933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:33.228324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b6fad-58e2-4c70-9cb9-06947fb18933 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:33.229026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b6fad-58e2-4c70-9cb9-06947fb18933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:33.231575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b6fad-58e2-4c70-9cb9-06947fb18933 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:33.258100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1334/2681] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:58:33 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:33.263110 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce570eaf-b322-4552-9675-5f567ebcae8d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:33.276773 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce570eaf-b322-4552-9675-5f567ebcae8d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:33.283677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed039b9-d4bd-4eb3-a963-04f310a69592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:33.284425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed039b9-d4bd-4eb3-a963-04f310a69592 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:33.284881 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed039b9-d4bd-4eb3-a963-04f310a69592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:33.285980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed039b9-d4bd-4eb3-a963-04f310a69592 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:33.286912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed039b9-d4bd-4eb3-a963-04f310a69592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:33.289555 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed039b9-d4bd-4eb3-a963-04f310a69592 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:33.304013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1348/2682] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:33.307825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b6fad-58e2-4c70-9cb9-06947fb18933 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:33.320516 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b6fad-58e2-4c70-9cb9-06947fb18933 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:33.327260 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deca713-4d73-4552-91ff-ddf5346a8344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:33.328500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deca713-4d73-4552-91ff-ddf5346a8344 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:33.328500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deca713-4d73-4552-91ff-ddf5346a8344 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:33.328500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deca713-4d73-4552-91ff-ddf5346a8344 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:33.329117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deca713-4d73-4552-91ff-ddf5346a8344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:33.331446 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deca713-4d73-4552-91ff-ddf5346a8344 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:33.342741 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1335/2683] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:33.347154 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed039b9-d4bd-4eb3-a963-04f310a69592 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:33.358604 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed039b9-d4bd-4eb3-a963-04f310a69592 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:33.363419 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3262e-1505-466c-8110-cbba585ff463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:33.364371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3262e-1505-466c-8110-cbba585ff463 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:33.364722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3262e-1505-466c-8110-cbba585ff463 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:33.365095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3262e-1505-466c-8110-cbba585ff463 admin admin] PATH_INFO: `/v3/projects/1f998680083a40589f779613b4968ba6/users/b07038b3d1d04ef180035dbaf2c64df4/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:33.380994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3262e-1505-466c-8110-cbba585ff463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f998680083a40589f779613b4968ba6, user_id=b07038b3d1d04ef180035dbaf2c64df4, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:33.384380 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3262e-1505-466c-8110-cbba585ff463 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:33.411299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1349/2684] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:33 2022] PUT /identity/v3/projects/1f998680083a40589f779613b4968ba6/users/b07038b3d1d04ef180035dbaf2c64df4/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:33.412924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc6db0-aa74-4a76-b994-dfdaa1187a61 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:33.413541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc6db0-aa74-4a76-b994-dfdaa1187a61 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:33.413541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc6db0-aa74-4a76-b994-dfdaa1187a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:33.446131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-27bc6db0-aa74-4a76-b994-dfdaa1187a61 None None] MFA Rules not processed for user `b07038b3d1d04ef180035dbaf2c64df4`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:33.447456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-27bc6db0-aa74-4a76-b994-dfdaa1187a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:33.516170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1336/2685] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:58:33.528706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3262e-1505-466c-8110-cbba585ff463 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:33.530542 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-d4b3262e-1505-466c-8110-cbba585ff463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:33.608834 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3262e-1505-466c-8110-cbba585ff463 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:33.613379 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90f5dd-9cf5-48cf-a91c-ab27b8a3a9a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:33.614148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90f5dd-9cf5-48cf-a91c-ab27b8a3a9a1 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:33.614542 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90f5dd-9cf5-48cf-a91c-ab27b8a3a9a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:33.615055 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90f5dd-9cf5-48cf-a91c-ab27b8a3a9a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:33.627849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90f5dd-9cf5-48cf-a91c-ab27b8a3a9a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:33.629426 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90f5dd-9cf5-48cf-a91c-ab27b8a3a9a1 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:33.640938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1350/2686] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:33.662651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc6db0-aa74-4a76-b994-dfdaa1187a61 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:33.757878 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc6db0-aa74-4a76-b994-dfdaa1187a61 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:33.763943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:33.764842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:33.765131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:33.765408 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] PATH_INFO: `/v3/users/b07038b3d1d04ef180035dbaf2c64df4` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:33.766714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07038b3d1d04ef180035dbaf2c64df4)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:33.768656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:33.827230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07038b3d1d04ef180035dbaf2c64df4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:33.858164 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07038b3d1d04ef180035dbaf2c64df4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:33.859533 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07038b3d1d04ef180035dbaf2c64df4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:33.876032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07038b3d1d04ef180035dbaf2c64df4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:33.885293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07038b3d1d04ef180035dbaf2c64df4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:33.908160 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1337/2687] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:33 2022] DELETE /identity/v3/users/b07038b3d1d04ef180035dbaf2c64df4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:33.912850 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0ca0-8782-43e2-a1c0-8f291f988a53 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:33.913402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0ca0-8782-43e2-a1c0-8f291f988a53 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:33.913402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e0ca0-8782-43e2-a1c0-8f291f988a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:33.933877 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-8c8e0ca0-8782-43e2-a1c0-8f291f988a53 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:33.935163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8c8e0ca0-8782-43e2-a1c0-8f291f988a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:34.017605 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1351/2688] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:34.024032 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:34.025769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:34.091723 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d680bfd7-5479-491b-b1b3-0770444c484f admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:34.096059 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40672f29-3994-402a-a6e3-3c2fef94e42c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:34.096708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40672f29-3994-402a-a6e3-3c2fef94e42c service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:34.096986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40672f29-3994-402a-a6e3-3c2fef94e42c service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:34.097258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40672f29-3994-402a-a6e3-3c2fef94e42c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:34.110649 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40672f29-3994-402a-a6e3-3c2fef94e42c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:34.112104 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40672f29-3994-402a-a6e3-3c2fef94e42c service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:34.126894 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1338/2689] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:34.424907 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e0ca0-8782-43e2-a1c0-8f291f988a53 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:34.426525 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-8c8e0ca0-8782-43e2-a1c0-8f291f988a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:34.448047 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e0ca0-8782-43e2-a1c0-8f291f988a53 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:34.455123 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:34.456062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:34.456329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:34.456722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] PATH_INFO: `/v3/projects/1f998680083a40589f779613b4968ba6` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:34.458061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f998680083a40589f779613b4968ba6)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:34.460317 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:34.523250 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f998680083a40589f779613b4968ba6', 'request_id': 'req-35ac8a7a-af67-4330-b8ba-c7e53330696c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:34.535848 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f998680083a40589f779613b4968ba6', 'request_id': 'req-35ac8a7a-af67-4330-b8ba-c7e53330696c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:34.550947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f998680083a40589f779613b4968ba6', 'request_id': 'req-35ac8a7a-af67-4330-b8ba-c7e53330696c'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:34.565604 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] The token cache is being invalidate because project 1f998680083a40589f779613b4968ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:34.566006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:34.566846 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:34.581141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1352/2690] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:34 2022] DELETE /identity/v3/projects/1f998680083a40589f779613b4968ba6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:35.482474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9605-57d0-481b-8dc8-73719f1d8142 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:35.482952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9605-57d0-481b-8dc8-73719f1d8142 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:35.483067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9605-57d0-481b-8dc8-73719f1d8142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:35.510535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-9c2e9605-57d0-481b-8dc8-73719f1d8142 None None] MFA Rules not processed for user `742938d3a02a4c8babf518b7b6cf53a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:35.511832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9c2e9605-57d0-481b-8dc8-73719f1d8142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:35.583748 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1339/2691] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:35.598255 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:35.599698 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:35.674272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8a7a-af67-4330-b8ba-c7e53330696c admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:35.679981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd602-0d5a-4dec-a0a7-3c82582b48f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:35.680815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd602-0d5a-4dec-a0a7-3c82582b48f5 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:35.681096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd602-0d5a-4dec-a0a7-3c82582b48f5 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:35.681370 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd602-0d5a-4dec-a0a7-3c82582b48f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:35.690486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd602-0d5a-4dec-a0a7-3c82582b48f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:35.692092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd602-0d5a-4dec-a0a7-3c82582b48f5 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:35.701626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1353/2692] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:37.373019 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f27c0-3be6-400e-80f8-e22b93e8300a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:37.373510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f27c0-3be6-400e-80f8-e22b93e8300a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:37.373510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f27c0-3be6-400e-80f8-e22b93e8300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:37.394131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c94f27c0-3be6-400e-80f8-e22b93e8300a None None] MFA Rules not processed for user `742938d3a02a4c8babf518b7b6cf53a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:37.395380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c94f27c0-3be6-400e-80f8-e22b93e8300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:37.403352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1340/2693] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:37.787626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd602-0d5a-4dec-a0a7-3c82582b48f5 service nova] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:37.790287 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-cd9bd602-0d5a-4dec-a0a7-3c82582b48f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:37.856488 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd602-0d5a-4dec-a0a7-3c82582b48f5 service nova] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:37.860159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898a6bd-4f51-4574-8b1f-8cfa514f362d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:37.860826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898a6bd-4f51-4574-8b1f-8cfa514f362d service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:37.861107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898a6bd-4f51-4574-8b1f-8cfa514f362d service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:37.861550 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898a6bd-4f51-4574-8b1f-8cfa514f362d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:37.863540 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0898a6bd-4f51-4574-8b1f-8cfa514f362d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:37.874880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898a6bd-4f51-4574-8b1f-8cfa514f362d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:37.876721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898a6bd-4f51-4574-8b1f-8cfa514f362d service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:37.886675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1354/2694] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:58:57.505714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f27c0-3be6-400e-80f8-e22b93e8300a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:57.507189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c94f27c0-3be6-400e-80f8-e22b93e8300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:57.636212 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f27c0-3be6-400e-80f8-e22b93e8300a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:57.640635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c9a47-db42-4c6b-b02b-0a4b487056c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:57.641494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9a47-db42-4c6b-b02b-0a4b487056c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:57.641772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9a47-db42-4c6b-b02b-0a4b487056c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:57.642045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9a47-db42-4c6b-b02b-0a4b487056c7 admin admin] PATH_INFO: `/v3/users/d3e4193c9d9043c99ee5bee59f79f7a8` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:57.643262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c9a47-db42-4c6b-b02b-0a4b487056c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e4193c9d9043c99ee5bee59f79f7a8)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:57.645160 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c9a47-db42-4c6b-b02b-0a4b487056c7 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:57.688170 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0f3c9a47-db42-4c6b-b02b-0a4b487056c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e4193c9d9043c99ee5bee59f79f7a8'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:57.699756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0f3c9a47-db42-4c6b-b02b-0a4b487056c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e4193c9d9043c99ee5bee59f79f7a8'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:57.700396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0f3c9a47-db42-4c6b-b02b-0a4b487056c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e4193c9d9043c99ee5bee59f79f7a8'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:57.701001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0f3c9a47-db42-4c6b-b02b-0a4b487056c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e4193c9d9043c99ee5bee59f79f7a8'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:57.707708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0f3c9a47-db42-4c6b-b02b-0a4b487056c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e4193c9d9043c99ee5bee59f79f7a8'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:57.719637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1341/2695] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:58:57 2022] DELETE /identity/v3/users/d3e4193c9d9043c99ee5bee59f79f7a8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:57.889904 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898a6bd-4f51-4574-8b1f-8cfa514f362d service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:57.903983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898a6bd-4f51-4574-8b1f-8cfa514f362d service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:57.958245 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:57.959154 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:57.959436 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:57.959713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] PATH_INFO: `/v3/projects/4ad8088ecb8a4f72a98ad70fa8be02b3` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:57.961029 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad8088ecb8a4f72a98ad70fa8be02b3)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:57.963065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:58.007961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'request_id': 'req-0f205a96-7d5b-4386-aa51-b22bcaf3d250'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:58.014158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'request_id': 'req-0f205a96-7d5b-4386-aa51-b22bcaf3d250'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:58.021347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad8088ecb8a4f72a98ad70fa8be02b3', 'request_id': 'req-0f205a96-7d5b-4386-aa51-b22bcaf3d250'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:58.031450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] The token cache is being invalidate because project 4ad8088ecb8a4f72a98ad70fa8be02b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:58:58.031757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:58.032360 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-0f205a96-7d5b-4386-aa51-b22bcaf3d250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:58:58.034006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1355/2696] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:58:57 2022] DELETE /identity/v3/projects/4ad8088ecb8a4f72a98ad70fa8be02b3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:58:58.038902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a06c0a-55c5-421e-8e67-63ca4464690f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:58.039193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a06c0a-55c5-421e-8e67-63ca4464690f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:58.039474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a06c0a-55c5-421e-8e67-63ca4464690f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:58.084981 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-12a06c0a-55c5-421e-8e67-63ca4464690f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:58.086165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-12a06c0a-55c5-421e-8e67-63ca4464690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:58.144413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1342/2697] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:58.152125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef719b-d6aa-4e21-9b43-9da64cd67ec2 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:58.152431 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef719b-d6aa-4e21-9b43-9da64cd67ec2 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:58.152708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef719b-d6aa-4e21-9b43-9da64cd67ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:58.171045 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-33ef719b-d6aa-4e21-9b43-9da64cd67ec2 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:58.172234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-33ef719b-d6aa-4e21-9b43-9da64cd67ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:58.179970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1356/2698] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:58:58.184490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a06c0a-55c5-421e-8e67-63ca4464690f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:58.193923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a06c0a-55c5-421e-8e67-63ca4464690f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:58.199069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d268a67-66c3-4234-9d19-331215cba6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:58.199715 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268a67-66c3-4234-9d19-331215cba6cb admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:58.200001 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268a67-66c3-4234-9d19-331215cba6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:58.200274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268a67-66c3-4234-9d19-331215cba6cb admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:58.200999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d268a67-66c3-4234-9d19-331215cba6cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 15:58:58.201306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d268a67-66c3-4234-9d19-331215cba6cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:58.202930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d268a67-66c3-4234-9d19-331215cba6cb admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:58.215185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1343/2699] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 15:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 15:58:58.218733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef719b-d6aa-4e21-9b43-9da64cd67ec2 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:58.227666 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef719b-d6aa-4e21-9b43-9da64cd67ec2 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:58.232815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa559202-8545-4ab0-b106-1be9b242cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:58.233456 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa559202-8545-4ab0-b106-1be9b242cf84 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:58.233739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa559202-8545-4ab0-b106-1be9b242cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:58.234017 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa559202-8545-4ab0-b106-1be9b242cf84 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:58.234755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa559202-8545-4ab0-b106-1be9b242cf84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:58.236648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa559202-8545-4ab0-b106-1be9b242cf84 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:58.261783 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1357/2700] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 15:58:58 2022] POST /identity/v3/projects => generated 399 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:58.265791 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d268a67-66c3-4234-9d19-331215cba6cb admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:58.275355 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d268a67-66c3-4234-9d19-331215cba6cb admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:58.328846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068f684-0eb3-4692-b617-dfb16dc25366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:58.329498 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068f684-0eb3-4692-b617-dfb16dc25366 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:58.329779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068f684-0eb3-4692-b617-dfb16dc25366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:58.330051 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068f684-0eb3-4692-b617-dfb16dc25366 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:58.330769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068f684-0eb3-4692-b617-dfb16dc25366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:58.332646 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068f684-0eb3-4692-b617-dfb16dc25366 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:58.351902 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1344/2701] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 15:58:58 2022] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 15:58:58.356654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa559202-8545-4ab0-b106-1be9b242cf84 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:58.366650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa559202-8545-4ab0-b106-1be9b242cf84 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:58.372268 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2ef2-83e6-40f6-8359-6694dcf7a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:58.372920 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2ef2-83e6-40f6-8359-6694dcf7a59d admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:58.373210 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2ef2-83e6-40f6-8359-6694dcf7a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:58.373491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca2ef2-83e6-40f6-8359-6694dcf7a59d admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:58.374220 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2ef2-83e6-40f6-8359-6694dcf7a59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:58.375837 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca2ef2-83e6-40f6-8359-6694dcf7a59d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:58.385896 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1358/2702] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:58.389713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068f684-0eb3-4692-b617-dfb16dc25366 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:58.399453 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068f684-0eb3-4692-b617-dfb16dc25366 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:58.404574 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c3b5b-bf83-4e6b-8b44-57955c95cb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:58.405217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c3b5b-bf83-4e6b-8b44-57955c95cb5d admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:58.405499 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c3b5b-bf83-4e6b-8b44-57955c95cb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:58.405775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c3b5b-bf83-4e6b-8b44-57955c95cb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:58.406526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c3b5b-bf83-4e6b-8b44-57955c95cb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:58.408108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c3b5b-bf83-4e6b-8b44-57955c95cb5d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:58.418270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1345/2703] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 15:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 15:58:58.422411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2ef2-83e6-40f6-8359-6694dcf7a59d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:58.432359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca2ef2-83e6-40f6-8359-6694dcf7a59d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:58.436938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022e05b-713b-4703-8243-c0d933ba0ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:58.437796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022e05b-713b-4703-8243-c0d933ba0ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:58.438072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022e05b-713b-4703-8243-c0d933ba0ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:58.438372 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022e05b-713b-4703-8243-c0d933ba0ae4 admin admin] PATH_INFO: `/v3/projects/d3c8a5a0d27c455ba08d8abfa36d28d2/users/0038d86f6d6149a4a7c4fa9f4779b1f9/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:58.453718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022e05b-713b-4703-8243-c0d933ba0ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c8a5a0d27c455ba08d8abfa36d28d2, user_id=0038d86f6d6149a4a7c4fa9f4779b1f9, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:58.457272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022e05b-713b-4703-8243-c0d933ba0ae4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:58.470413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1359/2704] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 15:58:58 2022] PUT /identity/v3/projects/d3c8a5a0d27c455ba08d8abfa36d28d2/users/0038d86f6d6149a4a7c4fa9f4779b1f9/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 15:58:58.480685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10bf50-93b6-4f13-a48e-37962747a677 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:58.480974 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10bf50-93b6-4f13-a48e-37962747a677 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:58.481251 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10bf50-93b6-4f13-a48e-37962747a677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:58.507200 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-2a10bf50-93b6-4f13-a48e-37962747a677 None None] MFA Rules not processed for user `0038d86f6d6149a4a7c4fa9f4779b1f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:58:58.508370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2a10bf50-93b6-4f13-a48e-37962747a677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:58.570384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1346/2705] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 15:58:58.582626 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022e05b-713b-4703-8243-c0d933ba0ae4 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:58:58.584331 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-5022e05b-713b-4703-8243-c0d933ba0ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:58:58.654393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022e05b-713b-4703-8243-c0d933ba0ae4 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:58:58.658000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103c535-b2f3-41e8-a690-c14951a41b9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:58:58.658662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103c535-b2f3-41e8-a690-c14951a41b9a service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:58:58.658942 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103c535-b2f3-41e8-a690-c14951a41b9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:58:58.659216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103c535-b2f3-41e8-a690-c14951a41b9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:58:58.667260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103c535-b2f3-41e8-a690-c14951a41b9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:58:58.668681 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103c535-b2f3-41e8-a690-c14951a41b9a service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:58:58.677091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1360/2706] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:58:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 15:59:08.723881 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10bf50-93b6-4f13-a48e-37962747a677 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:59:08.784690 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10bf50-93b6-4f13-a48e-37962747a677 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:59:08.789099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:59:08.789947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:59:08.790227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:59:08.790523 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] PATH_INFO: `/v3/users/0038d86f6d6149a4a7c4fa9f4779b1f9` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:59:08.791684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0038d86f6d6149a4a7c4fa9f4779b1f9)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:59:08.793577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:59:08.837847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0038d86f6d6149a4a7c4fa9f4779b1f9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:59:08.849638 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0038d86f6d6149a4a7c4fa9f4779b1f9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:59:08.850299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0038d86f6d6149a4a7c4fa9f4779b1f9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:59:08.850923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0038d86f6d6149a4a7c4fa9f4779b1f9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:59:08.857474 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0038d86f6d6149a4a7c4fa9f4779b1f9'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:59:08.870342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1347/2707] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 15:59:08 2022] DELETE /identity/v3/users/0038d86f6d6149a4a7c4fa9f4779b1f9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:59:08.875522 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b53d10-0736-4508-9d02-6d7bd4f254cc None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:59:08.876000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b53d10-0736-4508-9d02-6d7bd4f254cc None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:59:08.876086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b53d10-0736-4508-9d02-6d7bd4f254cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:59:08.894911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-74b53d10-0736-4508-9d02-6d7bd4f254cc None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 15:59:08.896126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-74b53d10-0736-4508-9d02-6d7bd4f254cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:59:08.954557 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1361/2708] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 15:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 15:59:08.965527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:59:08.967185 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:59:09.043372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75685b96-f8f4-47ba-8e52-0a48e167a072 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:59:09.047100 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc49eef-13de-4f02-963b-f0e0e063e323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:59:09.047731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc49eef-13de-4f02-963b-f0e0e063e323 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:59:09.048008 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc49eef-13de-4f02-963b-f0e0e063e323 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:59:09.048276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc49eef-13de-4f02-963b-f0e0e063e323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:59:09.057207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc49eef-13de-4f02-963b-f0e0e063e323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:59:09.058665 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc49eef-13de-4f02-963b-f0e0e063e323 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:59:09.068441 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1348/2709] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 15:59:09.327573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b53d10-0736-4508-9d02-6d7bd4f254cc None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:59:09.329012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-74b53d10-0736-4508-9d02-6d7bd4f254cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:59:09.341115 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b53d10-0736-4508-9d02-6d7bd4f254cc None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:59:09.346663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:59:09.347613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:59:09.347922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:59:09.348200 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] PATH_INFO: `/v3/projects/d3c8a5a0d27c455ba08d8abfa36d28d2` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:59:09.349406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c8a5a0d27c455ba08d8abfa36d28d2)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:59:09.351529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:59:09.396777 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c8a5a0d27c455ba08d8abfa36d28d2', 'request_id': 'req-70c20aff-9841-4b5f-87d9-5ea4697fd18f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:59:09.402663 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c8a5a0d27c455ba08d8abfa36d28d2', 'request_id': 'req-70c20aff-9841-4b5f-87d9-5ea4697fd18f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:59:09.409574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c8a5a0d27c455ba08d8abfa36d28d2', 'request_id': 'req-70c20aff-9841-4b5f-87d9-5ea4697fd18f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:59:09.419956 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] The token cache is being invalidate because project d3c8a5a0d27c455ba08d8abfa36d28d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 15:59:09.420237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:59:09.420851 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 15:59:09.422394 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1362/2710] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 15:59:09 2022] DELETE /identity/v3/projects/d3c8a5a0d27c455ba08d8abfa36d28d2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 15:59:35.103697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc49eef-13de-4f02-963b-f0e0e063e323 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 15:59:35.105147 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ecc49eef-13de-4f02-963b-f0e0e063e323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:59:35.197235 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc49eef-13de-4f02-963b-f0e0e063e323 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 15:59:35.267218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f41d6-0e7f-45a8-882c-1589862a1cd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fac310b740a40718191e905723222ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 15:59:35.267873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f41d6-0e7f-45a8-882c-1589862a1cd7 service placement] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 15:59:35.268159 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f41d6-0e7f-45a8-882c-1589862a1cd7 service placement] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 15:59:35.268436 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f41d6-0e7f-45a8-882c-1589862a1cd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 15:59:35.270207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-119f41d6-0e7f-45a8-882c-1589862a1cd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 15:59:35.285279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f41d6-0e7f-45a8-882c-1589862a1cd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 15:59:35.287072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f41d6-0e7f-45a8-882c-1589862a1cd7 service placement] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 15:59:35.298080 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1349/2711] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 15:59:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:00:19.299843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:00:19.301261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:00:19.357062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c20aff-9841-4b5f-87d9-5ea4697fd18f admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:00:19.360653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ce336-f712-4b3e-aa60-269f69b3e76a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:00:19.361292 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ce336-f712-4b3e-aa60-269f69b3e76a service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:00:19.361575 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ce336-f712-4b3e-aa60-269f69b3e76a service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:00:19.361849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ce336-f712-4b3e-aa60-269f69b3e76a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:00:19.363633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-382ce336-f712-4b3e-aa60-269f69b3e76a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:00:19.425458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ce336-f712-4b3e-aa60-269f69b3e76a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:00:19.426938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ce336-f712-4b3e-aa60-269f69b3e76a service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:00:19.437022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1363/2712] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:00:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:00:25.877036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f41d6-0e7f-45a8-882c-1589862a1cd7 service placement] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:00:25.878597 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-119f41d6-0e7f-45a8-882c-1589862a1cd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:00:25.892942 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f41d6-0e7f-45a8-882c-1589862a1cd7 service placement] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:00:25.897657 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:00:25.898562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:00:25.898846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:00:25.899120 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] PATH_INFO: `/v3/users/568f6783dd4d43398a70a9ffa58ff660` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:00:25.912855 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=568f6783dd4d43398a70a9ffa58ff660)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:00:25.914816 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:00:25.959242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568f6783dd4d43398a70a9ffa58ff660'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:25.971048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568f6783dd4d43398a70a9ffa58ff660'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:25.971706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568f6783dd4d43398a70a9ffa58ff660'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:25.972304 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568f6783dd4d43398a70a9ffa58ff660'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:25.978806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568f6783dd4d43398a70a9ffa58ff660'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:25.990986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1350/2713] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:00:25 2022] DELETE /identity/v3/users/568f6783dd4d43398a70a9ffa58ff660 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:00:26.165266 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ce336-f712-4b3e-aa60-269f69b3e76a service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:00:26.175511 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ce336-f712-4b3e-aa60-269f69b3e76a service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:00:26.234100 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:00:26.234989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:00:26.235270 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:00:26.235546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] PATH_INFO: `/v3/projects/7a3a2b5dee7a404a8445c8aa434b5a43` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:00:26.246583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3a2b5dee7a404a8445c8aa434b5a43)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:00:26.248501 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:00:26.295061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3a2b5dee7a404a8445c8aa434b5a43', 'request_id': 'req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.301514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3a2b5dee7a404a8445c8aa434b5a43', 'request_id': 'req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.309201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3a2b5dee7a404a8445c8aa434b5a43', 'request_id': 'req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.319141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] The token cache is being invalidate because project 7a3a2b5dee7a404a8445c8aa434b5a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:00:26.319418 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.320031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.321574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1364/2714] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:00:26 2022] DELETE /identity/v3/projects/7a3a2b5dee7a404a8445c8aa434b5a43 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:00:26.325740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:00:26.327150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:00:26.341162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0589-4137-4a97-a462-bf36590f5616 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:00:26.394397 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:00:26.395180 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:00:26.395460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:00:26.395740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] PATH_INFO: `/v3/users/20f8b8e0614746bb89f3837d8cd46f24` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:00:26.409293 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f8b8e0614746bb89f3837d8cd46f24)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:00:26.411353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:00:26.453421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f8b8e0614746bb89f3837d8cd46f24'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.465461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f8b8e0614746bb89f3837d8cd46f24'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.466158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f8b8e0614746bb89f3837d8cd46f24'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.466798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f8b8e0614746bb89f3837d8cd46f24'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.473286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f8b8e0614746bb89f3837d8cd46f24'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.486047 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1351/2715] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:00:26 2022] DELETE /identity/v3/users/20f8b8e0614746bb89f3837d8cd46f24 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:00:26.654133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:00:26.655703 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:00:26.669484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8a68d-b6bd-45d1-8d95-59d4459c1480 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:00:26.724261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:00:26.725142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:00:26.725422 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:00:26.725695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] PATH_INFO: `/v3/projects/f418dee8090d4399b5f8e4bd45886f0d` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:00:26.736485 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f418dee8090d4399b5f8e4bd45886f0d)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:00:26.738406 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:00:26.782386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f418dee8090d4399b5f8e4bd45886f0d', 'request_id': 'req-c4c83ce0-76ad-4f81-9411-dce62c65335f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.788828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f418dee8090d4399b5f8e4bd45886f0d', 'request_id': 'req-c4c83ce0-76ad-4f81-9411-dce62c65335f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.796493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f418dee8090d4399b5f8e4bd45886f0d', 'request_id': 'req-c4c83ce0-76ad-4f81-9411-dce62c65335f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.806392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] The token cache is being invalidate because project f418dee8090d4399b5f8e4bd45886f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:00:26.806680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.807308 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:00:26.809368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1365/2716] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:00:26 2022] DELETE /identity/v3/projects/f418dee8090d4399b5f8e4bd45886f0d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:01:41.576368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:01:41.578284 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:01:41.654122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7be90e-5dd9-4738-a378-a9f5b0c91aac admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:01:41.700140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9e44f-0705-495c-acc9-1e78903954c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:01:41.700770 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9e44f-0705-495c-acc9-1e78903954c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:01:41.701050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9e44f-0705-495c-acc9-1e78903954c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:01:41.701321 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9e44f-0705-495c-acc9-1e78903954c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:01:41.703739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-5db9e44f-0705-495c-acc9-1e78903954c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:01:41.788039 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9e44f-0705-495c-acc9-1e78903954c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:01:41.789388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9e44f-0705-495c-acc9-1e78903954c5 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:01:41.808768 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1352/2717] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:01:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:01:44.366257 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:01:44.367678 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:01:44.423413 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c83ce0-76ad-4f81-9411-dce62c65335f admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:01:44.427067 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64263f-eeeb-47b4-b535-c319bf904b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:01:44.427707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64263f-eeeb-47b4-b535-c319bf904b9f service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:01:44.427990 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64263f-eeeb-47b4-b535-c319bf904b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:01:44.428265 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64263f-eeeb-47b4-b535-c319bf904b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:01:44.430019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ee64263f-eeeb-47b4-b535-c319bf904b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:01:44.443596 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64263f-eeeb-47b4-b535-c319bf904b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:01:44.445024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64263f-eeeb-47b4-b535-c319bf904b9f service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:01:44.455649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1366/2718] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:01:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:02:33.834204 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9e44f-0705-495c-acc9-1e78903954c5 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:02:33.836342 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-5db9e44f-0705-495c-acc9-1e78903954c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:02:33.848340 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9e44f-0705-495c-acc9-1e78903954c5 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:02:33.852107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15de361-1ec4-40e3-a354-ca8dca31cbe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:02:33.852740 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15de361-1ec4-40e3-a354-ca8dca31cbe2 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:02:33.853017 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15de361-1ec4-40e3-a354-ca8dca31cbe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:02:33.853287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15de361-1ec4-40e3-a354-ca8dca31cbe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:02:33.855027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f15de361-1ec4-40e3-a354-ca8dca31cbe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:02:33.864988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15de361-1ec4-40e3-a354-ca8dca31cbe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:02:33.866435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15de361-1ec4-40e3-a354-ca8dca31cbe2 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:02:33.874635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1353/2719] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:02:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:03:01.711291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64263f-eeeb-47b4-b535-c319bf904b9f service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:03:01.713066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ee64263f-eeeb-47b4-b535-c319bf904b9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:03:01.727291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64263f-eeeb-47b4-b535-c319bf904b9f service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:03:01.737963 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4286e09-8f40-493e-af1f-e9608a0b9941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:03:01.738826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286e09-8f40-493e-af1f-e9608a0b9941 service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:03:01.739206 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286e09-8f40-493e-af1f-e9608a0b9941 service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:03:01.739616 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4286e09-8f40-493e-af1f-e9608a0b9941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:03:01.741661 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e4286e09-8f40-493e-af1f-e9608a0b9941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:03:01.759371 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4286e09-8f40-493e-af1f-e9608a0b9941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:03:01.761651 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4286e09-8f40-493e-af1f-e9608a0b9941 service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:03:01.778137 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1367/2720] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:03:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:03:05.227595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19a932-71f2-4ddb-94ff-0dbf97f6bd3c None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:03:05.228113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19a932-71f2-4ddb-94ff-0dbf97f6bd3c None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:03:05.228221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19a932-71f2-4ddb-94ff-0dbf97f6bd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:03:05.246975 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-9e19a932-71f2-4ddb-94ff-0dbf97f6bd3c None None] MFA Rules not processed for user `742938d3a02a4c8babf518b7b6cf53a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:03:05.248155 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9e19a932-71f2-4ddb-94ff-0dbf97f6bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:03:05.300845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1354/2721] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:03:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:03:06.154553 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4286e09-8f40-493e-af1f-e9608a0b9941 service nova] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:03:06.155997 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e4286e09-8f40-493e-af1f-e9608a0b9941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:03:06.224617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4286e09-8f40-493e-af1f-e9608a0b9941 service nova] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:03:06.229593 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa692fa-9433-4a88-8ab8-b2b6e7c35239 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fac310b740a40718191e905723222ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:03:06.230239 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa692fa-9433-4a88-8ab8-b2b6e7c35239 service placement] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:03:06.230552 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa692fa-9433-4a88-8ab8-b2b6e7c35239 service placement] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:03:06.230831 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa692fa-9433-4a88-8ab8-b2b6e7c35239 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:03:06.232618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-dfa692fa-9433-4a88-8ab8-b2b6e7c35239 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:03:06.244429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa692fa-9433-4a88-8ab8-b2b6e7c35239 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:03:06.246035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa692fa-9433-4a88-8ab8-b2b6e7c35239 service placement] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:03:06.256628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1368/2722] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:03:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:03:15.547846 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19a932-71f2-4ddb-94ff-0dbf97f6bd3c None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:03:15.549261 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9e19a932-71f2-4ddb-94ff-0dbf97f6bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:03:15.566676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19a932-71f2-4ddb-94ff-0dbf97f6bd3c None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:03:15.572095 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a779d9-0a68-48e1-b356-96279d06c61a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:03:15.572733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a779d9-0a68-48e1-b356-96279d06c61a service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:03:15.573020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a779d9-0a68-48e1-b356-96279d06c61a service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:03:15.573288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a779d9-0a68-48e1-b356-96279d06c61a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:03:15.575061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-06a779d9-0a68-48e1-b356-96279d06c61a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:03:15.587211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a779d9-0a68-48e1-b356-96279d06c61a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:03:15.588804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a779d9-0a68-48e1-b356-96279d06c61a service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:03:15.600449 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1355/2723] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:03:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:03:18.806433 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa692fa-9433-4a88-8ab8-b2b6e7c35239 service placement] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:03:18.818648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa692fa-9433-4a88-8ab8-b2b6e7c35239 service placement] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:03:18.824057 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf32ec-6196-44c3-a284-59d133ce02bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:03:18.824695 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf32ec-6196-44c3-a284-59d133ce02bc service nova] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:03:18.824981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf32ec-6196-44c3-a284-59d133ce02bc service nova] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:03:18.825258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf32ec-6196-44c3-a284-59d133ce02bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:03:18.827042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-dddf32ec-6196-44c3-a284-59d133ce02bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:03:18.844771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf32ec-6196-44c3-a284-59d133ce02bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:03:18.846484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf32ec-6196-44c3-a284-59d133ce02bc service nova] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:03:18.857825 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1369/2724] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:03:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:04:34.256276 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a779d9-0a68-48e1-b356-96279d06c61a service nova] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:04:34.267282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a779d9-0a68-48e1-b356-96279d06c61a service nova] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:04:34.273985 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89d46e-e3f1-426d-9f9a-c7e457bd3109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebefa53d595b4e6486ce409f2ac47ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:04:34.274655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89d46e-e3f1-426d-9f9a-c7e457bd3109 service nova] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:04:34.274942 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89d46e-e3f1-426d-9f9a-c7e457bd3109 service nova] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:04:34.275221 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89d46e-e3f1-426d-9f9a-c7e457bd3109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:04:34.276998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-cf89d46e-e3f1-426d-9f9a-c7e457bd3109 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:04:34.289843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89d46e-e3f1-426d-9f9a-c7e457bd3109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:04:34.291460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89d46e-e3f1-426d-9f9a-c7e457bd3109 service nova] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:04:34.300129 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1356/2725] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:04:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 16:04:41.078757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf32ec-6196-44c3-a284-59d133ce02bc service nova] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:04:41.080136 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-dddf32ec-6196-44c3-a284-59d133ce02bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:04:41.093790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf32ec-6196-44c3-a284-59d133ce02bc service nova] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:04:41.098676 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e295059-def5-45b1-964f-02fe970211a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fac310b740a40718191e905723222ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:04:41.099442 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e295059-def5-45b1-964f-02fe970211a3 service placement] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:04:41.099751 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e295059-def5-45b1-964f-02fe970211a3 service placement] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:04:41.100032 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e295059-def5-45b1-964f-02fe970211a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:04:41.101745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-3e295059-def5-45b1-964f-02fe970211a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:04:41.112681 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e295059-def5-45b1-964f-02fe970211a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:04:41.114243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e295059-def5-45b1-964f-02fe970211a3 service placement] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:04:41.124938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1370/2726] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:04:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:03.393449 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89d46e-e3f1-426d-9f9a-c7e457bd3109 service nova] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:03.402609 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89d46e-e3f1-426d-9f9a-c7e457bd3109 service nova] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:03.406125 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5511f6-686f-4b96-ada5-350d0dcda33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:03.406783 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5511f6-686f-4b96-ada5-350d0dcda33f service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:03.407061 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5511f6-686f-4b96-ada5-350d0dcda33f service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:03.407329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5511f6-686f-4b96-ada5-350d0dcda33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:03.409068 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-db5511f6-686f-4b96-ada5-350d0dcda33f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:03.470097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5511f6-686f-4b96-ada5-350d0dcda33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:03.471562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5511f6-686f-4b96-ada5-350d0dcda33f service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:03.481217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1357/2727] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 16:05:06.649159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e295059-def5-45b1-964f-02fe970211a3 service placement] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:06.650708 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-3e295059-def5-45b1-964f-02fe970211a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:06.668004 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e295059-def5-45b1-964f-02fe970211a3 service placement] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:06.672491 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af669899-ba9f-4cf6-83f1-e6e847a451da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:06.673363 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af669899-ba9f-4cf6-83f1-e6e847a451da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:06.673645 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af669899-ba9f-4cf6-83f1-e6e847a451da admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:06.673922 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af669899-ba9f-4cf6-83f1-e6e847a451da admin admin] PATH_INFO: `/v3/users/742938d3a02a4c8babf518b7b6cf53a7` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:06.675158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af669899-ba9f-4cf6-83f1-e6e847a451da admin admin] RBAC: Authorizing `identity:delete_user(user_id=742938d3a02a4c8babf518b7b6cf53a7)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:06.677062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af669899-ba9f-4cf6-83f1-e6e847a451da admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:06.728815 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-af669899-ba9f-4cf6-83f1-e6e847a451da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742938d3a02a4c8babf518b7b6cf53a7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:06.744722 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-af669899-ba9f-4cf6-83f1-e6e847a451da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742938d3a02a4c8babf518b7b6cf53a7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:06.745415 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-af669899-ba9f-4cf6-83f1-e6e847a451da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742938d3a02a4c8babf518b7b6cf53a7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:06.746009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-af669899-ba9f-4cf6-83f1-e6e847a451da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742938d3a02a4c8babf518b7b6cf53a7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:06.752829 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-af669899-ba9f-4cf6-83f1-e6e847a451da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742938d3a02a4c8babf518b7b6cf53a7'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:06.765275 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1371/2728] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:06 2022] DELETE /identity/v3/users/742938d3a02a4c8babf518b7b6cf53a7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:06.938076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5511f6-686f-4b96-ada5-350d0dcda33f service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:06.948869 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5511f6-686f-4b96-ada5-350d0dcda33f service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.005268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.006905 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.007196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.007475 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] PATH_INFO: `/v3/projects/882808bd43644908a21ff8a58997c57f` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.008658 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882808bd43644908a21ff8a58997c57f)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.010616 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.054182 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882808bd43644908a21ff8a58997c57f', 'request_id': 'req-78115bb3-6d7f-43f7-a977-7690ca48ba87'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:07.060423 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882808bd43644908a21ff8a58997c57f', 'request_id': 'req-78115bb3-6d7f-43f7-a977-7690ca48ba87'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:07.065977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882808bd43644908a21ff8a58997c57f', 'request_id': 'req-78115bb3-6d7f-43f7-a977-7690ca48ba87'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:07.077371 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] The token cache is being invalidate because project 882808bd43644908a21ff8a58997c57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:07.077780 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:07.078432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-78115bb3-6d7f-43f7-a977-7690ca48ba87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:07.079952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1358/2729] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:06 2022] DELETE /identity/v3/projects/882808bd43644908a21ff8a58997c57f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:07.085432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2e9e8-5bdd-46fb-8824-3025f16d1eab None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.085720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2e9e8-5bdd-46fb-8824-3025f16d1eab None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.085994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2e9e8-5bdd-46fb-8824-3025f16d1eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.114015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-66e2e9e8-5bdd-46fb-8824-3025f16d1eab None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:07.115252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-66e2e9e8-5bdd-46fb-8824-3025f16d1eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:07.174215 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1372/2730] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:07.182921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5a0c-33c6-47f8-82b4-5a68e89f56b8 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.183151 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5a0c-33c6-47f8-82b4-5a68e89f56b8 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.183430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5a0c-33c6-47f8-82b4-5a68e89f56b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.202193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-7d4a5a0c-33c6-47f8-82b4-5a68e89f56b8 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:07.203414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7d4a5a0c-33c6-47f8-82b4-5a68e89f56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:07.212451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1359/2731] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:07.216646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2e9e8-5bdd-46fb-8824-3025f16d1eab None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.226226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2e9e8-5bdd-46fb-8824-3025f16d1eab None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.230798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20b657-cede-473e-a2e8-df9d58ac99c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.231439 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20b657-cede-473e-a2e8-df9d58ac99c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.231719 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20b657-cede-473e-a2e8-df9d58ac99c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.231995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20b657-cede-473e-a2e8-df9d58ac99c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.232718 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20b657-cede-473e-a2e8-df9d58ac99c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 16:05:07.233020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20b657-cede-473e-a2e8-df9d58ac99c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.234639 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20b657-cede-473e-a2e8-df9d58ac99c7 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.246207 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1373/2732] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 16:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 16:05:07.250561 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a5a0c-33c6-47f8-82b4-5a68e89f56b8 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.260469 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a5a0c-33c6-47f8-82b4-5a68e89f56b8 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.265244 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c7d2d-0162-4b0c-9278-c9c1c9ba044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.265888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7d2d-0162-4b0c-9278-c9c1c9ba044f admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.266175 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7d2d-0162-4b0c-9278-c9c1c9ba044f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.266501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c7d2d-0162-4b0c-9278-c9c1c9ba044f admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.267320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c7d2d-0162-4b0c-9278-c9c1c9ba044f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.269216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c7d2d-0162-4b0c-9278-c9c1c9ba044f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.309265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1360/2733] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:07 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:07.313459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20b657-cede-473e-a2e8-df9d58ac99c7 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.324486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20b657-cede-473e-a2e8-df9d58ac99c7 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.380492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79422ce7-db64-46d0-8a64-431023d7e408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.381798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79422ce7-db64-46d0-8a64-431023d7e408 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.381798 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79422ce7-db64-46d0-8a64-431023d7e408 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.382585 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79422ce7-db64-46d0-8a64-431023d7e408 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.383299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79422ce7-db64-46d0-8a64-431023d7e408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.385385 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79422ce7-db64-46d0-8a64-431023d7e408 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.408305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1374/2734] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:07 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:07.410158 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c7d2d-0162-4b0c-9278-c9c1c9ba044f admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.421183 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c7d2d-0162-4b0c-9278-c9c1c9ba044f admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.425815 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15f1ad-8324-41c1-a892-cf4e8b2fc464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.426507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f1ad-8324-41c1-a892-cf4e8b2fc464 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.426792 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f1ad-8324-41c1-a892-cf4e8b2fc464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.427069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f1ad-8324-41c1-a892-cf4e8b2fc464 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.427785 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15f1ad-8324-41c1-a892-cf4e8b2fc464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.429912 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15f1ad-8324-41c1-a892-cf4e8b2fc464 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.439737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1361/2735] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:07.443864 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79422ce7-db64-46d0-8a64-431023d7e408 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.453533 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79422ce7-db64-46d0-8a64-431023d7e408 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.458107 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171cdc1-b57e-4bd3-8592-4f276f2f439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.458796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171cdc1-b57e-4bd3-8592-4f276f2f439d admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.459578 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171cdc1-b57e-4bd3-8592-4f276f2f439d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.460026 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171cdc1-b57e-4bd3-8592-4f276f2f439d admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.460892 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171cdc1-b57e-4bd3-8592-4f276f2f439d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.462518 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171cdc1-b57e-4bd3-8592-4f276f2f439d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.472425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1375/2736] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:07.477135 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15f1ad-8324-41c1-a892-cf4e8b2fc464 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.486892 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15f1ad-8324-41c1-a892-cf4e8b2fc464 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.491642 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cd0d5-c8e7-4871-8709-a987114915e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.492535 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd0d5-c8e7-4871-8709-a987114915e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.492801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd0d5-c8e7-4871-8709-a987114915e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.493065 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd0d5-c8e7-4871-8709-a987114915e1 admin admin] PATH_INFO: `/v3/projects/2f0780e4a0024eca9cb57499f07c51b6/users/ca8aef4bea8e418a95a37ab587234e8b/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.507804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cd0d5-c8e7-4871-8709-a987114915e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0780e4a0024eca9cb57499f07c51b6, user_id=ca8aef4bea8e418a95a37ab587234e8b, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.510460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cd0d5-c8e7-4871-8709-a987114915e1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.523295 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1362/2737] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:07 2022] PUT /identity/v3/projects/2f0780e4a0024eca9cb57499f07c51b6/users/ca8aef4bea8e418a95a37ab587234e8b/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:07.533085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b30b-9d67-4863-a777-931db4819b26 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.533374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b30b-9d67-4863-a777-931db4819b26 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.533653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b30b-9d67-4863-a777-931db4819b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.560343 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7a49b30b-9d67-4863-a777-931db4819b26 None None] MFA Rules not processed for user `ca8aef4bea8e418a95a37ab587234e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:07.561523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7a49b30b-9d67-4863-a777-931db4819b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:07.622283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1376/2738] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:07.626990 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cd0d5-c8e7-4871-8709-a987114915e1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.687522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cd0d5-c8e7-4871-8709-a987114915e1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.692156 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab45c6-fcfe-422b-9d19-e9681d53ecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.692731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab45c6-fcfe-422b-9d19-e9681d53ecd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.693012 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab45c6-fcfe-422b-9d19-e9681d53ecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.693287 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab45c6-fcfe-422b-9d19-e9681d53ecd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.694548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab45c6-fcfe-422b-9d19-e9681d53ecd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.696450 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab45c6-fcfe-422b-9d19-e9681d53ecd1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.720901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1363/2739] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:07 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:07.724925 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49b30b-9d67-4863-a777-931db4819b26 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.735265 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49b30b-9d67-4863-a777-931db4819b26 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.788977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb7688-5790-4a57-80dc-dd8f45b8d6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.789650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb7688-5790-4a57-80dc-dd8f45b8d6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.789915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb7688-5790-4a57-80dc-dd8f45b8d6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.790189 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb7688-5790-4a57-80dc-dd8f45b8d6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.790936 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb7688-5790-4a57-80dc-dd8f45b8d6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.792799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb7688-5790-4a57-80dc-dd8f45b8d6b6 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.811955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1377/2740] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:07 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:07.815901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab45c6-fcfe-422b-9d19-e9681d53ecd1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.826359 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab45c6-fcfe-422b-9d19-e9681d53ecd1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.830872 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb23a93-a672-4e16-8b6a-05a0b5e63031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.831524 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb23a93-a672-4e16-8b6a-05a0b5e63031 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.831807 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb23a93-a672-4e16-8b6a-05a0b5e63031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.832079 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb23a93-a672-4e16-8b6a-05a0b5e63031 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.832798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb23a93-a672-4e16-8b6a-05a0b5e63031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.834487 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb23a93-a672-4e16-8b6a-05a0b5e63031 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.844907 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1364/2741] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:07.849112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb7688-5790-4a57-80dc-dd8f45b8d6b6 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.859429 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb7688-5790-4a57-80dc-dd8f45b8d6b6 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.864000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8f4a6-9cd3-4f5b-84b9-28806cc68c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.864867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8f4a6-9cd3-4f5b-84b9-28806cc68c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.865150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8f4a6-9cd3-4f5b-84b9-28806cc68c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.865693 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8f4a6-9cd3-4f5b-84b9-28806cc68c2a admin admin] PATH_INFO: `/v3/projects/dacdc48f743144e7948923cd53aaf1d8/users/3ce2cb799f9a4322a03ca1deda6d2905/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.880043 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8f4a6-9cd3-4f5b-84b9-28806cc68c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dacdc48f743144e7948923cd53aaf1d8, user_id=3ce2cb799f9a4322a03ca1deda6d2905, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.883452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8f4a6-9cd3-4f5b-84b9-28806cc68c2a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.896704 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1378/2742] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:07 2022] PUT /identity/v3/projects/dacdc48f743144e7948923cd53aaf1d8/users/3ce2cb799f9a4322a03ca1deda6d2905/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:07.900796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb23a93-a672-4e16-8b6a-05a0b5e63031 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.910598 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb23a93-a672-4e16-8b6a-05a0b5e63031 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.965007 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707bffd-5e25-44f2-be89-116c6c660718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.965607 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707bffd-5e25-44f2-be89-116c6c660718 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.965860 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707bffd-5e25-44f2-be89-116c6c660718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.966134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707bffd-5e25-44f2-be89-116c6c660718 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:07.966888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707bffd-5e25-44f2-be89-116c6c660718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:07.968465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707bffd-5e25-44f2-be89-116c6c660718 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:07.978553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1365/2743] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:07.982534 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8f4a6-9cd3-4f5b-84b9-28806cc68c2a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:07.992530 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8f4a6-9cd3-4f5b-84b9-28806cc68c2a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:07.997109 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333f091-fb67-44b7-9143-18c023e5e019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:07.998236 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333f091-fb67-44b7-9143-18c023e5e019 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:07.998544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333f091-fb67-44b7-9143-18c023e5e019 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:07.998821 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333f091-fb67-44b7-9143-18c023e5e019 admin admin] PATH_INFO: `/v3/projects/dacdc48f743144e7948923cd53aaf1d8/users/3ce2cb799f9a4322a03ca1deda6d2905/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:08.000778 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333f091-fb67-44b7-9143-18c023e5e019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dacdc48f743144e7948923cd53aaf1d8, user_id=3ce2cb799f9a4322a03ca1deda6d2905, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:08.003427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333f091-fb67-44b7-9143-18c023e5e019 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:08.013672 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1379/2744] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:07 2022] PUT /identity/v3/projects/dacdc48f743144e7948923cd53aaf1d8/users/3ce2cb799f9a4322a03ca1deda6d2905/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:08.025296 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ca26-e91c-45d7-b2d2-72b1dd59fdbe None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:08.025588 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ca26-e91c-45d7-b2d2-72b1dd59fdbe None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:08.025867 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090ca26-e91c-45d7-b2d2-72b1dd59fdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:08.051988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-6090ca26-e91c-45d7-b2d2-72b1dd59fdbe None None] MFA Rules not processed for user `3ce2cb799f9a4322a03ca1deda6d2905`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:08.053531 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6090ca26-e91c-45d7-b2d2-72b1dd59fdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:08.118842 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1366/2745] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:08.130330 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333f091-fb67-44b7-9143-18c023e5e019 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:08.131991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-4333f091-fb67-44b7-9143-18c023e5e019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:08.186729 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333f091-fb67-44b7-9143-18c023e5e019 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:08.190299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edb024-4d5c-4011-9db2-28c3fd8702cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:08.190955 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edb024-4d5c-4011-9db2-28c3fd8702cb service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:08.191235 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edb024-4d5c-4011-9db2-28c3fd8702cb service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:08.191509 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edb024-4d5c-4011-9db2-28c3fd8702cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:08.201092 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edb024-4d5c-4011-9db2-28c3fd8702cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:08.202562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edb024-4d5c-4011-9db2-28c3fd8702cb service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:08.211957 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1380/2746] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:08.281714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090ca26-e91c-45d7-b2d2-72b1dd59fdbe None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:08.291576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090ca26-e91c-45d7-b2d2-72b1dd59fdbe None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:08.295163 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3543b1-a809-4e85-a214-fc87a3aea763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:08.295798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3543b1-a809-4e85-a214-fc87a3aea763 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:08.296075 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3543b1-a809-4e85-a214-fc87a3aea763 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:08.296347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3543b1-a809-4e85-a214-fc87a3aea763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:08.350462 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3543b1-a809-4e85-a214-fc87a3aea763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:08.352113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3543b1-a809-4e85-a214-fc87a3aea763 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:08.360873 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1367/2747] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:19.110424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edb024-4d5c-4011-9db2-28c3fd8702cb service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:19.169947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edb024-4d5c-4011-9db2-28c3fd8702cb service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:19.174464 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:19.175321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:19.175606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:19.175884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] PATH_INFO: `/v3/users/ca8aef4bea8e418a95a37ab587234e8b` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:19.177067 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8aef4bea8e418a95a37ab587234e8b)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:19.179190 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:19.224093 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8aef4bea8e418a95a37ab587234e8b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.235251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8aef4bea8e418a95a37ab587234e8b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.235908 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8aef4bea8e418a95a37ab587234e8b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.236510 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8aef4bea8e418a95a37ab587234e8b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.243074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8aef4bea8e418a95a37ab587234e8b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.255312 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1381/2748] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:19 2022] DELETE /identity/v3/users/ca8aef4bea8e418a95a37ab587234e8b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:19.260392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43974a-a935-43d2-8d05-854007678589 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:19.260921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43974a-a935-43d2-8d05-854007678589 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:19.260921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43974a-a935-43d2-8d05-854007678589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:19.277858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-2a43974a-a935-43d2-8d05-854007678589 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:19.279341 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2a43974a-a935-43d2-8d05-854007678589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:19.336201 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1368/2749] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:19.345792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:19.347192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:19.402420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3d9f0-4e39-4b0d-9216-46f753284092 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:19.406035 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be1ba8-ff68-4438-bd82-f86ac434a016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:19.406713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be1ba8-ff68-4438-bd82-f86ac434a016 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:19.406998 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be1ba8-ff68-4438-bd82-f86ac434a016 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:19.407274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be1ba8-ff68-4438-bd82-f86ac434a016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:19.416650 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be1ba8-ff68-4438-bd82-f86ac434a016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:19.418075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be1ba8-ff68-4438-bd82-f86ac434a016 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:19.427294 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1382/2750] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:19.687640 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43974a-a935-43d2-8d05-854007678589 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:19.689066 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-2a43974a-a935-43d2-8d05-854007678589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:19.701853 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43974a-a935-43d2-8d05-854007678589 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:19.706590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:19.707411 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:19.707695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:19.707970 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] PATH_INFO: `/v3/projects/2f0780e4a0024eca9cb57499f07c51b6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:19.710409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0780e4a0024eca9cb57499f07c51b6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:19.712351 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:19.758196 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0780e4a0024eca9cb57499f07c51b6', 'request_id': 'req-7aa60b32-dfde-467c-8c9f-844aa3600e87'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.765247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0780e4a0024eca9cb57499f07c51b6', 'request_id': 'req-7aa60b32-dfde-467c-8c9f-844aa3600e87'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.770446 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0780e4a0024eca9cb57499f07c51b6', 'request_id': 'req-7aa60b32-dfde-467c-8c9f-844aa3600e87'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.781304 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] The token cache is being invalidate because project 2f0780e4a0024eca9cb57499f07c51b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:19.781590 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.782207 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.783737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1369/2751] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:19 2022] DELETE /identity/v3/projects/2f0780e4a0024eca9cb57499f07c51b6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 16:05:19.787662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be1ba8-ff68-4438-bd82-f86ac434a016 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:19.797967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be1ba8-ff68-4438-bd82-f86ac434a016 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:19.854000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecc767-70da-459e-a3e2-614532b98ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:19.854903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc767-70da-459e-a3e2-614532b98ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:19.855190 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc767-70da-459e-a3e2-614532b98ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:19.855471 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecc767-70da-459e-a3e2-614532b98ab1 admin admin] PATH_INFO: `/v3/users/3ce2cb799f9a4322a03ca1deda6d2905` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:19.856659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecc767-70da-459e-a3e2-614532b98ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ce2cb799f9a4322a03ca1deda6d2905)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:19.858606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecc767-70da-459e-a3e2-614532b98ab1 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:19.903357 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d8ecc767-70da-459e-a3e2-614532b98ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ce2cb799f9a4322a03ca1deda6d2905'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.915493 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d8ecc767-70da-459e-a3e2-614532b98ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ce2cb799f9a4322a03ca1deda6d2905'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.916159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d8ecc767-70da-459e-a3e2-614532b98ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ce2cb799f9a4322a03ca1deda6d2905'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.916761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d8ecc767-70da-459e-a3e2-614532b98ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ce2cb799f9a4322a03ca1deda6d2905'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.923352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d8ecc767-70da-459e-a3e2-614532b98ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ce2cb799f9a4322a03ca1deda6d2905'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:19.935335 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1383/2752] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:19 2022] DELETE /identity/v3/users/3ce2cb799f9a4322a03ca1deda6d2905 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:20.208259 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:20.209418 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:20.222057 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa60b32-dfde-467c-8c9f-844aa3600e87 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:20.278978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:20.279836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:20.280121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:20.280396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] PATH_INFO: `/v3/projects/dacdc48f743144e7948923cd53aaf1d8` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:20.281581 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dacdc48f743144e7948923cd53aaf1d8)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:20.283544 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:20.327203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dacdc48f743144e7948923cd53aaf1d8', 'request_id': 'req-325c2300-8b1a-4505-8e61-bc79343f7048'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:20.333963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dacdc48f743144e7948923cd53aaf1d8', 'request_id': 'req-325c2300-8b1a-4505-8e61-bc79343f7048'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:20.340008 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dacdc48f743144e7948923cd53aaf1d8', 'request_id': 'req-325c2300-8b1a-4505-8e61-bc79343f7048'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:20.351016 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] The token cache is being invalidate because project dacdc48f743144e7948923cd53aaf1d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:20.351383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:20.351942 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-325c2300-8b1a-4505-8e61-bc79343f7048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:20.353463 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1370/2753] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:20 2022] DELETE /identity/v3/projects/dacdc48f743144e7948923cd53aaf1d8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:20.358515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e008c-ebd4-4676-841b-b36b2f9e3bc1 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:20.358980 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e008c-ebd4-4676-841b-b36b2f9e3bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:20.359097 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e008c-ebd4-4676-841b-b36b2f9e3bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:20.378479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-f67e008c-ebd4-4676-841b-b36b2f9e3bc1 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:20.379668 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f67e008c-ebd4-4676-841b-b36b2f9e3bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:20.436852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1384/2754] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:20.445133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb92d5-d7e2-407a-841f-d95ae5fcec33 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:20.445526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb92d5-d7e2-407a-841f-d95ae5fcec33 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:20.445812 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb92d5-d7e2-407a-841f-d95ae5fcec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:20.464978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-3ccb92d5-d7e2-407a-841f-d95ae5fcec33 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:20.466113 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3ccb92d5-d7e2-407a-841f-d95ae5fcec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:20.474138 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1371/2755] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:20.479470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e008c-ebd4-4676-841b-b36b2f9e3bc1 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:20.489692 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e008c-ebd4-4676-841b-b36b2f9e3bc1 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:20.496159 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642936d2-c43a-496d-8dcc-0b9258c8df7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:20.496820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642936d2-c43a-496d-8dcc-0b9258c8df7b admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:20.497105 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642936d2-c43a-496d-8dcc-0b9258c8df7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:20.497381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642936d2-c43a-496d-8dcc-0b9258c8df7b admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:20.498673 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642936d2-c43a-496d-8dcc-0b9258c8df7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 16:05:20.499135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642936d2-c43a-496d-8dcc-0b9258c8df7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:20.501293 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642936d2-c43a-496d-8dcc-0b9258c8df7b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:20.514240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1385/2756] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 16:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 16:05:20.518573 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb92d5-d7e2-407a-841f-d95ae5fcec33 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:20.528438 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb92d5-d7e2-407a-841f-d95ae5fcec33 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:20.533109 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44afea-2d4b-4623-8bff-d033bb79bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:20.533759 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44afea-2d4b-4623-8bff-d033bb79bd34 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:20.534041 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44afea-2d4b-4623-8bff-d033bb79bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:20.534327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44afea-2d4b-4623-8bff-d033bb79bd34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:20.535040 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44afea-2d4b-4623-8bff-d033bb79bd34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:20.536928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44afea-2d4b-4623-8bff-d033bb79bd34 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:20.561258 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1372/2757] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:20 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:20.565291 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642936d2-c43a-496d-8dcc-0b9258c8df7b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:20.575031 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642936d2-c43a-496d-8dcc-0b9258c8df7b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:20.631278 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c075a-5c50-4c20-938c-a98033af228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:20.632012 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c075a-5c50-4c20-938c-a98033af228b admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:20.632329 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c075a-5c50-4c20-938c-a98033af228b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:20.632532 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c075a-5c50-4c20-938c-a98033af228b admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:20.633259 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c075a-5c50-4c20-938c-a98033af228b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:20.635191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c075a-5c50-4c20-938c-a98033af228b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:20.653862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1386/2758] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:20 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 16:05:20.658194 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44afea-2d4b-4623-8bff-d033bb79bd34 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:20.669064 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44afea-2d4b-4623-8bff-d033bb79bd34 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:20.673924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4c61d-b6e6-40d0-adef-1214d2644061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:20.674603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4c61d-b6e6-40d0-adef-1214d2644061 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:20.674888 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4c61d-b6e6-40d0-adef-1214d2644061 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:20.675164 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4c61d-b6e6-40d0-adef-1214d2644061 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:20.675891 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4c61d-b6e6-40d0-adef-1214d2644061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:20.677476 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4c61d-b6e6-40d0-adef-1214d2644061 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:20.687696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1373/2759] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:20.691654 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c075a-5c50-4c20-938c-a98033af228b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:20.702475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c075a-5c50-4c20-938c-a98033af228b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:20.707090 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e5164-4d39-4c38-9c83-c243bff925e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:20.707741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e5164-4d39-4c38-9c83-c243bff925e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:20.708133 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e5164-4d39-4c38-9c83-c243bff925e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:20.708295 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e5164-4d39-4c38-9c83-c243bff925e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:20.709023 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e5164-4d39-4c38-9c83-c243bff925e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:20.711741 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e5164-4d39-4c38-9c83-c243bff925e7 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:20.721408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1387/2760] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:20.725463 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4c61d-b6e6-40d0-adef-1214d2644061 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:20.735114 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4c61d-b6e6-40d0-adef-1214d2644061 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:20.739680 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b609ac-5a86-407c-9156-31e08c4e9d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:20.740548 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b609ac-5a86-407c-9156-31e08c4e9d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:20.740844 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b609ac-5a86-407c-9156-31e08c4e9d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:20.741124 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b609ac-5a86-407c-9156-31e08c4e9d69 admin admin] PATH_INFO: `/v3/projects/c16c1a90f83841feaf24785297772e81/users/f644239cee584f7680acde3c4fb0ff63/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:20.755211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b609ac-5a86-407c-9156-31e08c4e9d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16c1a90f83841feaf24785297772e81, user_id=f644239cee584f7680acde3c4fb0ff63, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:20.758457 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b609ac-5a86-407c-9156-31e08c4e9d69 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:20.770572 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1374/2761] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:20 2022] PUT /identity/v3/projects/c16c1a90f83841feaf24785297772e81/users/f644239cee584f7680acde3c4fb0ff63/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:20.782333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9632381-d9a2-4855-9d80-767c91c6d29c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:20.782635 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9632381-d9a2-4855-9d80-767c91c6d29c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:20.782961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9632381-d9a2-4855-9d80-767c91c6d29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:20.808579 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-b9632381-d9a2-4855-9d80-767c91c6d29c None None] MFA Rules not processed for user `f644239cee584f7680acde3c4fb0ff63`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:20.809782 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-b9632381-d9a2-4855-9d80-767c91c6d29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:20.871833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1388/2762] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:20.876644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b609ac-5a86-407c-9156-31e08c4e9d69 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:20.935252 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b609ac-5a86-407c-9156-31e08c4e9d69 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:20.939776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a8753-2a53-40e6-ad56-5ce6fb211b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:20.940415 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a8753-2a53-40e6-ad56-5ce6fb211b3b admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:20.940693 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a8753-2a53-40e6-ad56-5ce6fb211b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:20.940962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a8753-2a53-40e6-ad56-5ce6fb211b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:20.941651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a8753-2a53-40e6-ad56-5ce6fb211b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:20.943562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a8753-2a53-40e6-ad56-5ce6fb211b3b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:20.968509 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1375/2763] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:20 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:20.972995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9632381-d9a2-4855-9d80-767c91c6d29c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:20.983723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9632381-d9a2-4855-9d80-767c91c6d29c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:21.037332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc5050-6ff1-4668-9210-c9d3b8a2c15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:21.037983 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc5050-6ff1-4668-9210-c9d3b8a2c15d admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:21.038262 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc5050-6ff1-4668-9210-c9d3b8a2c15d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:21.038564 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc5050-6ff1-4668-9210-c9d3b8a2c15d admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:21.039252 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc5050-6ff1-4668-9210-c9d3b8a2c15d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:21.041163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc5050-6ff1-4668-9210-c9d3b8a2c15d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:21.060475 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1389/2764] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:20 2022] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 16:05:21.064945 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a8753-2a53-40e6-ad56-5ce6fb211b3b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:21.075828 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a8753-2a53-40e6-ad56-5ce6fb211b3b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:21.080410 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af085e3c-5377-4186-a0e1-7f9382b27820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:21.081056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085e3c-5377-4186-a0e1-7f9382b27820 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:21.081336 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085e3c-5377-4186-a0e1-7f9382b27820 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:21.081609 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af085e3c-5377-4186-a0e1-7f9382b27820 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:21.082355 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af085e3c-5377-4186-a0e1-7f9382b27820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:21.083960 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af085e3c-5377-4186-a0e1-7f9382b27820 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:21.094270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1376/2765] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:21.098462 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc5050-6ff1-4668-9210-c9d3b8a2c15d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:21.108361 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc5050-6ff1-4668-9210-c9d3b8a2c15d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:21.112913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc1161-0994-4d66-a02d-66aabaf25d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:21.113779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc1161-0994-4d66-a02d-66aabaf25d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:21.114056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc1161-0994-4d66-a02d-66aabaf25d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:21.114348 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc1161-0994-4d66-a02d-66aabaf25d9f admin admin] PATH_INFO: `/v3/projects/934ff1325e8b422eabe84c3cf480fb08/users/c5d17dfe13b24976a575489190da785d/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:21.129272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc1161-0994-4d66-a02d-66aabaf25d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=934ff1325e8b422eabe84c3cf480fb08, user_id=c5d17dfe13b24976a575489190da785d, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:21.132485 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc1161-0994-4d66-a02d-66aabaf25d9f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:21.144571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1390/2766] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:21 2022] PUT /identity/v3/projects/934ff1325e8b422eabe84c3cf480fb08/users/c5d17dfe13b24976a575489190da785d/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 16:05:21.148751 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af085e3c-5377-4186-a0e1-7f9382b27820 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:21.158587 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af085e3c-5377-4186-a0e1-7f9382b27820 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:21.214404 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab397f5b-dc99-4c36-bfde-be81b62cdeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:21.215073 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab397f5b-dc99-4c36-bfde-be81b62cdeee admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:21.215353 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab397f5b-dc99-4c36-bfde-be81b62cdeee admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:21.215630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab397f5b-dc99-4c36-bfde-be81b62cdeee admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:21.216363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab397f5b-dc99-4c36-bfde-be81b62cdeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:21.218111 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab397f5b-dc99-4c36-bfde-be81b62cdeee admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:21.228123 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1377/2767] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:21.232109 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc1161-0994-4d66-a02d-66aabaf25d9f admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:21.242580 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc1161-0994-4d66-a02d-66aabaf25d9f admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:21.247075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88c1ce-9af6-48e5-bed3-30671dc338c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:21.248187 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88c1ce-9af6-48e5-bed3-30671dc338c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:21.248465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88c1ce-9af6-48e5-bed3-30671dc338c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:21.248733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88c1ce-9af6-48e5-bed3-30671dc338c1 admin admin] PATH_INFO: `/v3/projects/934ff1325e8b422eabe84c3cf480fb08/users/c5d17dfe13b24976a575489190da785d/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:21.250702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88c1ce-9af6-48e5-bed3-30671dc338c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934ff1325e8b422eabe84c3cf480fb08, user_id=c5d17dfe13b24976a575489190da785d, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:21.253307 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88c1ce-9af6-48e5-bed3-30671dc338c1 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:21.263799 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1391/2768] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:21 2022] PUT /identity/v3/projects/934ff1325e8b422eabe84c3cf480fb08/users/c5d17dfe13b24976a575489190da785d/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:21.274069 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe04a1e-7922-435a-9ac4-7fca59799b52 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:21.274390 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe04a1e-7922-435a-9ac4-7fca59799b52 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:21.274678 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe04a1e-7922-435a-9ac4-7fca59799b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:21.300684 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-1fe04a1e-7922-435a-9ac4-7fca59799b52 None None] MFA Rules not processed for user `c5d17dfe13b24976a575489190da785d`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:21.301896 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-1fe04a1e-7922-435a-9ac4-7fca59799b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:21.369539 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1378/2769] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:21.380833 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88c1ce-9af6-48e5-bed3-30671dc338c1 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:21.383273 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-ec88c1ce-9af6-48e5-bed3-30671dc338c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:21.437912 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88c1ce-9af6-48e5-bed3-30671dc338c1 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:21.441630 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f28726-b836-4a1c-892d-23b6ce771465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:21.442264 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f28726-b836-4a1c-892d-23b6ce771465 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:21.442578 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f28726-b836-4a1c-892d-23b6ce771465 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:21.442858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f28726-b836-4a1c-892d-23b6ce771465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:21.452282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f28726-b836-4a1c-892d-23b6ce771465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:21.453705 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f28726-b836-4a1c-892d-23b6ce771465 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:21.463080 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1392/2770] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:21.490685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe04a1e-7922-435a-9ac4-7fca59799b52 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:21.549775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe04a1e-7922-435a-9ac4-7fca59799b52 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:21.555243 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:21.556099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:21.556380 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:21.556656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] PATH_INFO: `/v3/users/f644239cee584f7680acde3c4fb0ff63` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:21.557841 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f644239cee584f7680acde3c4fb0ff63)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:21.559778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:21.603566 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f644239cee584f7680acde3c4fb0ff63'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:21.615053 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f644239cee584f7680acde3c4fb0ff63'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:21.615717 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f644239cee584f7680acde3c4fb0ff63'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:21.617076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f644239cee584f7680acde3c4fb0ff63'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:21.623824 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f644239cee584f7680acde3c4fb0ff63'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:21.636355 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1379/2771] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:21 2022] DELETE /identity/v3/users/f644239cee584f7680acde3c4fb0ff63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:21.640880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee40a4-0159-4206-a47a-c982d43fec17 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:21.641243 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee40a4-0159-4206-a47a-c982d43fec17 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:21.641527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee40a4-0159-4206-a47a-c982d43fec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:21.660981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-57ee40a4-0159-4206-a47a-c982d43fec17 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:21.662161 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-57ee40a4-0159-4206-a47a-c982d43fec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:21.719714 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1393/2772] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:21.730087 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:21.731526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:21.786891 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bc3d2-7c13-4f1e-bfc9-2e7652b476bd admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:21.791034 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9cf1-aafa-4c55-b3e8-ebdf84a1a3ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:21.791666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9cf1-aafa-4c55-b3e8-ebdf84a1a3ae service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:21.791946 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9cf1-aafa-4c55-b3e8-ebdf84a1a3ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:21.792242 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b9cf1-aafa-4c55-b3e8-ebdf84a1a3ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:21.801077 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b9cf1-aafa-4c55-b3e8-ebdf84a1a3ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:21.802559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b9cf1-aafa-4c55-b3e8-ebdf84a1a3ae service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:21.812369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1380/2773] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:22.069989 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee40a4-0159-4206-a47a-c982d43fec17 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:22.071469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-57ee40a4-0159-4206-a47a-c982d43fec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:22.085374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee40a4-0159-4206-a47a-c982d43fec17 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:22.090853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:22.092054 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:22.092341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:22.092691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] PATH_INFO: `/v3/projects/c16c1a90f83841feaf24785297772e81` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:22.093810 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16c1a90f83841feaf24785297772e81)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:22.095736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:22.140759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16c1a90f83841feaf24785297772e81', 'request_id': 'req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.146820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16c1a90f83841feaf24785297772e81', 'request_id': 'req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.154381 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16c1a90f83841feaf24785297772e81', 'request_id': 'req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.165260 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] The token cache is being invalidate because project c16c1a90f83841feaf24785297772e81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:22.165578 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.166216 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.167816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1394/2774] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:22 2022] DELETE /identity/v3/projects/c16c1a90f83841feaf24785297772e81 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:22.171706 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9cf1-aafa-4c55-b3e8-ebdf84a1a3ae service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:22.181735 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b9cf1-aafa-4c55-b3e8-ebdf84a1a3ae service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:22.234798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacb7b6-2954-4d6b-88f4-52d58d8da869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:22.235663 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb7b6-2954-4d6b-88f4-52d58d8da869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:22.235947 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb7b6-2954-4d6b-88f4-52d58d8da869 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:22.236226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacb7b6-2954-4d6b-88f4-52d58d8da869 admin admin] PATH_INFO: `/v3/users/c5d17dfe13b24976a575489190da785d` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:22.237460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacb7b6-2954-4d6b-88f4-52d58d8da869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d17dfe13b24976a575489190da785d)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:22.239413 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacb7b6-2954-4d6b-88f4-52d58d8da869 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:22.282630 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0aacb7b6-2954-4d6b-88f4-52d58d8da869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d17dfe13b24976a575489190da785d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.294282 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0aacb7b6-2954-4d6b-88f4-52d58d8da869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d17dfe13b24976a575489190da785d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.294951 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0aacb7b6-2954-4d6b-88f4-52d58d8da869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d17dfe13b24976a575489190da785d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.295553 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0aacb7b6-2954-4d6b-88f4-52d58d8da869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d17dfe13b24976a575489190da785d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.302048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-0aacb7b6-2954-4d6b-88f4-52d58d8da869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d17dfe13b24976a575489190da785d'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.314862 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1381/2775] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:22 2022] DELETE /identity/v3/users/c5d17dfe13b24976a575489190da785d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:22.592064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:22.593622 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:22.607573 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d744c9-faf1-4e36-a4f9-433b6f2c8c2f admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:22.663022 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:22.663974 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:22.664256 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:22.664529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] PATH_INFO: `/v3/projects/934ff1325e8b422eabe84c3cf480fb08` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:22.665702 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=934ff1325e8b422eabe84c3cf480fb08)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:22.667639 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:22.712430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934ff1325e8b422eabe84c3cf480fb08', 'request_id': 'req-002b7f51-45e5-4fe4-9667-6c01b5c00152'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.718334 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934ff1325e8b422eabe84c3cf480fb08', 'request_id': 'req-002b7f51-45e5-4fe4-9667-6c01b5c00152'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.725234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934ff1325e8b422eabe84c3cf480fb08', 'request_id': 'req-002b7f51-45e5-4fe4-9667-6c01b5c00152'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.735138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] The token cache is being invalidate because project 934ff1325e8b422eabe84c3cf480fb08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:22.735424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.736056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-002b7f51-45e5-4fe4-9667-6c01b5c00152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:22.737576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1395/2776] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:22 2022] DELETE /identity/v3/projects/934ff1325e8b422eabe84c3cf480fb08 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:22.743195 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54087cb-97fc-4f15-a3e6-dccb6ed7d93b None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:22.743484 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54087cb-97fc-4f15-a3e6-dccb6ed7d93b None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:22.743788 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54087cb-97fc-4f15-a3e6-dccb6ed7d93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:22.762089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b54087cb-97fc-4f15-a3e6-dccb6ed7d93b None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:22.763306 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b54087cb-97fc-4f15-a3e6-dccb6ed7d93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:22.820779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1382/2777] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:22.828662 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb438a-51bc-4f45-8243-79ae9fd1071e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:22.828951 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb438a-51bc-4f45-8243-79ae9fd1071e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:22.829226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb438a-51bc-4f45-8243-79ae9fd1071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:22.847368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7fdb438a-51bc-4f45-8243-79ae9fd1071e None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:22.848547 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7fdb438a-51bc-4f45-8243-79ae9fd1071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:22.856448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1396/2778] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:22.860673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54087cb-97fc-4f15-a3e6-dccb6ed7d93b None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:22.870979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54087cb-97fc-4f15-a3e6-dccb6ed7d93b None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:22.876099 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ff5b3-f3e6-4240-95c2-37824eed1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:22.876784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ff5b3-f3e6-4240-95c2-37824eed1c3d admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:22.877067 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ff5b3-f3e6-4240-95c2-37824eed1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:22.877343 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ff5b3-f3e6-4240-95c2-37824eed1c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:22.878072 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ff5b3-f3e6-4240-95c2-37824eed1c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 16:05:22.878414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ff5b3-f3e6-4240-95c2-37824eed1c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:22.880051 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ff5b3-f3e6-4240-95c2-37824eed1c3d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:22.891964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1383/2779] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 16:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 16:05:22.896128 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb438a-51bc-4f45-8243-79ae9fd1071e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:22.905800 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb438a-51bc-4f45-8243-79ae9fd1071e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:22.910424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94286c-ae80-436a-b781-51d0c21e50b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:22.911065 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94286c-ae80-436a-b781-51d0c21e50b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:22.911346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94286c-ae80-436a-b781-51d0c21e50b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:22.911619 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94286c-ae80-436a-b781-51d0c21e50b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:22.912463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94286c-ae80-436a-b781-51d0c21e50b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:22.915013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94286c-ae80-436a-b781-51d0c21e50b9 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:22.939478 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1397/2780] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:22 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:22.943456 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ff5b3-f3e6-4240-95c2-37824eed1c3d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:22.953655 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ff5b3-f3e6-4240-95c2-37824eed1c3d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.007870 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d6c25-9b33-4b31-bd38-000a60c7dc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.008528 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6c25-9b33-4b31-bd38-000a60c7dc71 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.008813 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6c25-9b33-4b31-bd38-000a60c7dc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.009090 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d6c25-9b33-4b31-bd38-000a60c7dc71 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.009784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d6c25-9b33-4b31-bd38-000a60c7dc71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.011744 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d6c25-9b33-4b31-bd38-000a60c7dc71 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.030520 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1384/2781] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:22 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:23.034450 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94286c-ae80-436a-b781-51d0c21e50b9 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.044571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94286c-ae80-436a-b781-51d0c21e50b9 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.049130 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1cff2-cf96-44ed-981d-5130869cc0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.049779 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1cff2-cf96-44ed-981d-5130869cc0fb admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.050061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1cff2-cf96-44ed-981d-5130869cc0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.050362 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1cff2-cf96-44ed-981d-5130869cc0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.051094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1cff2-cf96-44ed-981d-5130869cc0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.052677 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1cff2-cf96-44ed-981d-5130869cc0fb admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.062746 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1398/2782] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:23.066416 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d6c25-9b33-4b31-bd38-000a60c7dc71 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.076662 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d6c25-9b33-4b31-bd38-000a60c7dc71 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.081540 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a0bd5-5074-4bf4-a586-2fbf0ed0608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.082188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a0bd5-5074-4bf4-a586-2fbf0ed0608b admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.082501 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a0bd5-5074-4bf4-a586-2fbf0ed0608b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.082775 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a0bd5-5074-4bf4-a586-2fbf0ed0608b admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.083494 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a0bd5-5074-4bf4-a586-2fbf0ed0608b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.086005 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a0bd5-5074-4bf4-a586-2fbf0ed0608b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.095483 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1385/2783] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:23.099313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1cff2-cf96-44ed-981d-5130869cc0fb admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.108971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1cff2-cf96-44ed-981d-5130869cc0fb admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.113526 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc747240-8830-4abe-9942-a1136111139e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.114407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc747240-8830-4abe-9942-a1136111139e admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.114691 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc747240-8830-4abe-9942-a1136111139e admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.114961 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc747240-8830-4abe-9942-a1136111139e admin admin] PATH_INFO: `/v3/projects/5dd9b41a6d92489a93bc9aabb5827f1b/users/cf0ff5111bf7481da177fb03c8735ee1/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.129374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc747240-8830-4abe-9942-a1136111139e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd9b41a6d92489a93bc9aabb5827f1b, user_id=cf0ff5111bf7481da177fb03c8735ee1, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.132660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc747240-8830-4abe-9942-a1136111139e admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.145064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1399/2784] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:23 2022] PUT /identity/v3/projects/5dd9b41a6d92489a93bc9aabb5827f1b/users/cf0ff5111bf7481da177fb03c8735ee1/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:23.156229 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c0bfa-5191-453b-a07c-9fe0995194fa None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.156516 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c0bfa-5191-453b-a07c-9fe0995194fa None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.156789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c0bfa-5191-453b-a07c-9fe0995194fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.184379 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-cd5c0bfa-5191-453b-a07c-9fe0995194fa None None] MFA Rules not processed for user `cf0ff5111bf7481da177fb03c8735ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:23.185567 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-cd5c0bfa-5191-453b-a07c-9fe0995194fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:23.245701 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1386/2785] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:23.250352 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc747240-8830-4abe-9942-a1136111139e admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.308486 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc747240-8830-4abe-9942-a1136111139e admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.313063 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5a036-788e-4e03-8dc3-7e85f67a3d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.313707 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a036-788e-4e03-8dc3-7e85f67a3d6d admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.313993 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a036-788e-4e03-8dc3-7e85f67a3d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.314263 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5a036-788e-4e03-8dc3-7e85f67a3d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.314982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5a036-788e-4e03-8dc3-7e85f67a3d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.316859 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5a036-788e-4e03-8dc3-7e85f67a3d6d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.341351 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1400/2786] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:23 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:23.345459 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c0bfa-5191-453b-a07c-9fe0995194fa None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.356414 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c0bfa-5191-453b-a07c-9fe0995194fa None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.410092 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a18d07-315a-4867-9f0f-25f646db3eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.410835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a18d07-315a-4867-9f0f-25f646db3eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.411429 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a18d07-315a-4867-9f0f-25f646db3eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.411710 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a18d07-315a-4867-9f0f-25f646db3eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.412392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a18d07-315a-4867-9f0f-25f646db3eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.414923 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a18d07-315a-4867-9f0f-25f646db3eb8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.435748 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1387/2787] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:23 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 16:05:23.439634 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5a036-788e-4e03-8dc3-7e85f67a3d6d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.449649 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5a036-788e-4e03-8dc3-7e85f67a3d6d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.454121 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fe748-bd67-476f-b4a4-83cb7e3c44b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.454814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fe748-bd67-476f-b4a4-83cb7e3c44b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.455098 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fe748-bd67-476f-b4a4-83cb7e3c44b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.455407 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fe748-bd67-476f-b4a4-83cb7e3c44b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.456177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fe748-bd67-476f-b4a4-83cb7e3c44b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.457757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fe748-bd67-476f-b4a4-83cb7e3c44b8 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.477158 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1401/2788] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:23.481137 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a18d07-315a-4867-9f0f-25f646db3eb8 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.491119 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a18d07-315a-4867-9f0f-25f646db3eb8 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.495817 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249098de-a80a-4edc-877e-d72529e73081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.496488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249098de-a80a-4edc-877e-d72529e73081 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.496766 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249098de-a80a-4edc-877e-d72529e73081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.497035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249098de-a80a-4edc-877e-d72529e73081 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.498015 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249098de-a80a-4edc-877e-d72529e73081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.499622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249098de-a80a-4edc-877e-d72529e73081 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.509286 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1388/2789] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:23.513181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fe748-bd67-476f-b4a4-83cb7e3c44b8 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.523995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fe748-bd67-476f-b4a4-83cb7e3c44b8 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.528653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62826ee5-0730-45cf-b618-71b4175bc805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.529519 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62826ee5-0730-45cf-b618-71b4175bc805 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.529801 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62826ee5-0730-45cf-b618-71b4175bc805 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.530075 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62826ee5-0730-45cf-b618-71b4175bc805 admin admin] PATH_INFO: `/v3/projects/b162d7e5f612443e83b6eb274e7ae0bf/users/4aae217b7e9e47679dd3d748bfb448c7/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.544897 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62826ee5-0730-45cf-b618-71b4175bc805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b162d7e5f612443e83b6eb274e7ae0bf, user_id=4aae217b7e9e47679dd3d748bfb448c7, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.547593 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62826ee5-0730-45cf-b618-71b4175bc805 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.560024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1402/2790] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:23 2022] PUT /identity/v3/projects/b162d7e5f612443e83b6eb274e7ae0bf/users/4aae217b7e9e47679dd3d748bfb448c7/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:23.570383 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020bb55-c16f-405c-9141-1be28df4d3ad None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.570671 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020bb55-c16f-405c-9141-1be28df4d3ad None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.570944 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020bb55-c16f-405c-9141-1be28df4d3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.596468 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-8020bb55-c16f-405c-9141-1be28df4d3ad None None] MFA Rules not processed for user `4aae217b7e9e47679dd3d748bfb448c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:23.597579 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-8020bb55-c16f-405c-9141-1be28df4d3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:23.659565 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1389/2791] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:23.665061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62826ee5-0730-45cf-b618-71b4175bc805 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.723941 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62826ee5-0730-45cf-b618-71b4175bc805 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.728614 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1f1b3-6888-41d6-99f5-48d4efbf5c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.729258 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f1b3-6888-41d6-99f5-48d4efbf5c47 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.729541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f1b3-6888-41d6-99f5-48d4efbf5c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.729814 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f1b3-6888-41d6-99f5-48d4efbf5c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.730527 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1f1b3-6888-41d6-99f5-48d4efbf5c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.732424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1f1b3-6888-41d6-99f5-48d4efbf5c47 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.756272 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1403/2792] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:23 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 16:05:23.761005 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020bb55-c16f-405c-9141-1be28df4d3ad None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.771324 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020bb55-c16f-405c-9141-1be28df4d3ad None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.827405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1e646-f9f3-4a9c-9ca9-1fa114de6eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.828107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1e646-f9f3-4a9c-9ca9-1fa114de6eea admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.828395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1e646-f9f3-4a9c-9ca9-1fa114de6eea admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.828676 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1e646-f9f3-4a9c-9ca9-1fa114de6eea admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.829850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1e646-f9f3-4a9c-9ca9-1fa114de6eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.831884 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1e646-f9f3-4a9c-9ca9-1fa114de6eea admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.853820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1390/2793] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:23 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:23.857056 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1f1b3-6888-41d6-99f5-48d4efbf5c47 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.867279 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1f1b3-6888-41d6-99f5-48d4efbf5c47 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.871933 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a495529-f7f5-440a-884a-b3b1927ac554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.872589 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a495529-f7f5-440a-884a-b3b1927ac554 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.873141 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a495529-f7f5-440a-884a-b3b1927ac554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.873420 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a495529-f7f5-440a-884a-b3b1927ac554 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.874150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a495529-f7f5-440a-884a-b3b1927ac554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.875785 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a495529-f7f5-440a-884a-b3b1927ac554 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.886636 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1404/2794] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:23.890709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1e646-f9f3-4a9c-9ca9-1fa114de6eea admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.901058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1e646-f9f3-4a9c-9ca9-1fa114de6eea admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:23.905697 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3bd78-5d0e-482c-a537-a05726337c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:23.906595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3bd78-5d0e-482c-a537-a05726337c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:23.906875 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3bd78-5d0e-482c-a537-a05726337c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:23.907148 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3bd78-5d0e-482c-a537-a05726337c03 admin admin] PATH_INFO: `/v3/projects/2e023819d5394d2fb354eb566eecfc6d/users/1d3b0a1a2cb7424597104c3ea06db23e/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:23.921347 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3bd78-5d0e-482c-a537-a05726337c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e023819d5394d2fb354eb566eecfc6d, user_id=1d3b0a1a2cb7424597104c3ea06db23e, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:23.924262 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3bd78-5d0e-482c-a537-a05726337c03 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:23.936226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1391/2795] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:23 2022] PUT /identity/v3/projects/2e023819d5394d2fb354eb566eecfc6d/users/1d3b0a1a2cb7424597104c3ea06db23e/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:23.940180 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a495529-f7f5-440a-884a-b3b1927ac554 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:23.950931 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a495529-f7f5-440a-884a-b3b1927ac554 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:24.004298 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6823458-57c2-476a-b2a9-4150ba1ddf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:24.004954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823458-57c2-476a-b2a9-4150ba1ddf94 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:24.005237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823458-57c2-476a-b2a9-4150ba1ddf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:24.005515 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6823458-57c2-476a-b2a9-4150ba1ddf94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:24.006238 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6823458-57c2-476a-b2a9-4150ba1ddf94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:24.008374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6823458-57c2-476a-b2a9-4150ba1ddf94 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:24.017610 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1405/2796] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:24.021691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3bd78-5d0e-482c-a537-a05726337c03 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:24.032707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3bd78-5d0e-482c-a537-a05726337c03 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:24.037363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092eebaf-3ccf-4d45-82a5-1c54ac251e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:24.038238 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eebaf-3ccf-4d45-82a5-1c54ac251e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:24.038555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eebaf-3ccf-4d45-82a5-1c54ac251e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:24.038832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092eebaf-3ccf-4d45-82a5-1c54ac251e5b admin admin] PATH_INFO: `/v3/projects/2e023819d5394d2fb354eb566eecfc6d/users/1d3b0a1a2cb7424597104c3ea06db23e/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:24.040829 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092eebaf-3ccf-4d45-82a5-1c54ac251e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e023819d5394d2fb354eb566eecfc6d, user_id=1d3b0a1a2cb7424597104c3ea06db23e, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:24.043495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092eebaf-3ccf-4d45-82a5-1c54ac251e5b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:24.053858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1392/2797] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:24 2022] PUT /identity/v3/projects/2e023819d5394d2fb354eb566eecfc6d/users/1d3b0a1a2cb7424597104c3ea06db23e/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:24.067424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eed31-efb0-44e3-862d-da833c8e4868 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:24.067717 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eed31-efb0-44e3-862d-da833c8e4868 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:24.067994 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3eed31-efb0-44e3-862d-da833c8e4868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:24.094629 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7f3eed31-efb0-44e3-862d-da833c8e4868 None None] MFA Rules not processed for user `1d3b0a1a2cb7424597104c3ea06db23e`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:24.095821 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7f3eed31-efb0-44e3-862d-da833c8e4868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:24.160770 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1406/2798] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:24.171843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092eebaf-3ccf-4d45-82a5-1c54ac251e5b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:24.173541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-092eebaf-3ccf-4d45-82a5-1c54ac251e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:24.228606 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092eebaf-3ccf-4d45-82a5-1c54ac251e5b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:24.232284 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b874ef4-7de1-47c4-90eb-77abc423fc05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:24.232925 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b874ef4-7de1-47c4-90eb-77abc423fc05 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:24.233211 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b874ef4-7de1-47c4-90eb-77abc423fc05 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:24.233490 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b874ef4-7de1-47c4-90eb-77abc423fc05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:24.242977 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b874ef4-7de1-47c4-90eb-77abc423fc05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:24.244402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b874ef4-7de1-47c4-90eb-77abc423fc05 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:24.253830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1393/2799] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:24.294554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3eed31-efb0-44e3-862d-da833c8e4868 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:24.295915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7f3eed31-efb0-44e3-862d-da833c8e4868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:24.307979 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3eed31-efb0-44e3-862d-da833c8e4868 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:24.312066 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f64ee-1a0a-457e-9ad5-81b3a3ed55fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:24.312679 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f64ee-1a0a-457e-9ad5-81b3a3ed55fc service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:24.312978 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f64ee-1a0a-457e-9ad5-81b3a3ed55fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:24.313230 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f64ee-1a0a-457e-9ad5-81b3a3ed55fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:24.368345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f64ee-1a0a-457e-9ad5-81b3a3ed55fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:24.369800 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f64ee-1a0a-457e-9ad5-81b3a3ed55fc service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:24.378621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1407/2800] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:27.207541 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b874ef4-7de1-47c4-90eb-77abc423fc05 service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:27.269518 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b874ef4-7de1-47c4-90eb-77abc423fc05 service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:27.275165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:27.276026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:27.276308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:27.276581 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] PATH_INFO: `/v3/users/cf0ff5111bf7481da177fb03c8735ee1` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:27.277760 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf0ff5111bf7481da177fb03c8735ee1)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:27.279709 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:27.324820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf0ff5111bf7481da177fb03c8735ee1'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:27.336963 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf0ff5111bf7481da177fb03c8735ee1'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:27.337620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf0ff5111bf7481da177fb03c8735ee1'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:27.338230 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf0ff5111bf7481da177fb03c8735ee1'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:27.344836 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf0ff5111bf7481da177fb03c8735ee1'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:27.357746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1394/2801] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:27 2022] DELETE /identity/v3/users/cf0ff5111bf7481da177fb03c8735ee1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:27.362492 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebd3e1-8426-4475-bd37-acd058bf0c49 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:27.362972 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebd3e1-8426-4475-bd37-acd058bf0c49 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:27.363095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebd3e1-8426-4475-bd37-acd058bf0c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:27.380505 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-9aebd3e1-8426-4475-bd37-acd058bf0c49 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:27.381688 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9aebd3e1-8426-4475-bd37-acd058bf0c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:27.438396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1408/2802] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:27.448601 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:27.449998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:27.505279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b7a90-3b3f-483a-a21f-06ff7eecef84 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:27.509776 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d627f-d99b-478f-9b35-1cfa298f4cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:27.510445 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d627f-d99b-478f-9b35-1cfa298f4cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:27.510731 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d627f-d99b-478f-9b35-1cfa298f4cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:27.511004 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d627f-d99b-478f-9b35-1cfa298f4cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:27.519845 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d627f-d99b-478f-9b35-1cfa298f4cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:27.521278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d627f-d99b-478f-9b35-1cfa298f4cd9 service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:27.531327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1395/2803] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:27.789760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebd3e1-8426-4475-bd37-acd058bf0c49 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:27.791223 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-9aebd3e1-8426-4475-bd37-acd058bf0c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:27.802954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebd3e1-8426-4475-bd37-acd058bf0c49 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:27.808482 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:27.809349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:27.809638 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:27.809915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] PATH_INFO: `/v3/projects/5dd9b41a6d92489a93bc9aabb5827f1b` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:27.811231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd9b41a6d92489a93bc9aabb5827f1b)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:27.813688 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:27.859733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd9b41a6d92489a93bc9aabb5827f1b', 'request_id': 'req-590686ea-6e10-4cd0-8a47-c129c5458c2d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:27.865584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd9b41a6d92489a93bc9aabb5827f1b', 'request_id': 'req-590686ea-6e10-4cd0-8a47-c129c5458c2d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:27.873939 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd9b41a6d92489a93bc9aabb5827f1b', 'request_id': 'req-590686ea-6e10-4cd0-8a47-c129c5458c2d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:27.884485 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] The token cache is being invalidate because project 5dd9b41a6d92489a93bc9aabb5827f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:27.884771 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:27.885386 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:27.887041 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1409/2804] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:27 2022] DELETE /identity/v3/projects/5dd9b41a6d92489a93bc9aabb5827f1b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:27.890964 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d627f-d99b-478f-9b35-1cfa298f4cd9 service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:27.900838 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d627f-d99b-478f-9b35-1cfa298f4cd9 service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:27.956471 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:27.957280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:27.957561 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:27.957830 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] PATH_INFO: `/v3/users/4aae217b7e9e47679dd3d748bfb448c7` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:27.958998 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aae217b7e9e47679dd3d748bfb448c7)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:27.961107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:28.005396 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aae217b7e9e47679dd3d748bfb448c7'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.016993 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aae217b7e9e47679dd3d748bfb448c7'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.017772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aae217b7e9e47679dd3d748bfb448c7'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.018492 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aae217b7e9e47679dd3d748bfb448c7'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.026037 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aae217b7e9e47679dd3d748bfb448c7'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.038761 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1396/2805] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:27 2022] DELETE /identity/v3/users/4aae217b7e9e47679dd3d748bfb448c7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:28.298326 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:28.299812 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:28.313903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590686ea-6e10-4cd0-8a47-c129c5458c2d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:28.368470 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:28.369321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:28.369599 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:28.369873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] PATH_INFO: `/v3/projects/b162d7e5f612443e83b6eb274e7ae0bf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:28.371064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b162d7e5f612443e83b6eb274e7ae0bf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:28.373205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:28.417345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b162d7e5f612443e83b6eb274e7ae0bf', 'request_id': 'req-c147fa68-6107-4d78-8169-12a42d21a4fb'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.423411 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b162d7e5f612443e83b6eb274e7ae0bf', 'request_id': 'req-c147fa68-6107-4d78-8169-12a42d21a4fb'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.431005 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b162d7e5f612443e83b6eb274e7ae0bf', 'request_id': 'req-c147fa68-6107-4d78-8169-12a42d21a4fb'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.440896 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] The token cache is being invalidate because project b162d7e5f612443e83b6eb274e7ae0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:28.441178 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.441787 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.443341 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1410/2806] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:28 2022] DELETE /identity/v3/projects/b162d7e5f612443e83b6eb274e7ae0bf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:28.447361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:28.448815 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:28.461804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea012e-cf5b-483d-b2e1-3bc646133e5c admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:28.517337 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d46f1b-b570-4274-ae5a-26f23726e2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:28.518117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d46f1b-b570-4274-ae5a-26f23726e2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:28.518435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d46f1b-b570-4274-ae5a-26f23726e2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:28.518711 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d46f1b-b570-4274-ae5a-26f23726e2c2 admin admin] PATH_INFO: `/v3/users/1d3b0a1a2cb7424597104c3ea06db23e` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:28.519879 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d46f1b-b570-4274-ae5a-26f23726e2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d3b0a1a2cb7424597104c3ea06db23e)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:28.521773 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d46f1b-b570-4274-ae5a-26f23726e2c2 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:28.564264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f1d46f1b-b570-4274-ae5a-26f23726e2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d3b0a1a2cb7424597104c3ea06db23e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.575285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f1d46f1b-b570-4274-ae5a-26f23726e2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d3b0a1a2cb7424597104c3ea06db23e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.575928 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f1d46f1b-b570-4274-ae5a-26f23726e2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d3b0a1a2cb7424597104c3ea06db23e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.576526 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f1d46f1b-b570-4274-ae5a-26f23726e2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d3b0a1a2cb7424597104c3ea06db23e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.583188 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-f1d46f1b-b570-4274-ae5a-26f23726e2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d3b0a1a2cb7424597104c3ea06db23e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.596058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1397/2807] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:28 2022] DELETE /identity/v3/users/1d3b0a1a2cb7424597104c3ea06db23e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:28.855349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:28.856903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:28.870374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147fa68-6107-4d78-8169-12a42d21a4fb admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:28.925350 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:28.926197 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:28.926500 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:28.926796 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] PATH_INFO: `/v3/projects/2e023819d5394d2fb354eb566eecfc6d` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:28.928027 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e023819d5394d2fb354eb566eecfc6d)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:28.930469 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:28.973359 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e023819d5394d2fb354eb566eecfc6d', 'request_id': 'req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.980053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e023819d5394d2fb354eb566eecfc6d', 'request_id': 'req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.987952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e023819d5394d2fb354eb566eecfc6d', 'request_id': 'req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.999019 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] The token cache is being invalidate because project 2e023819d5394d2fb354eb566eecfc6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:28.999306 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:28.999941 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-d3198f7b-00f9-408c-9cfe-0967f4bf5d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:29.001452 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1411/2808] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:28 2022] DELETE /identity/v3/projects/2e023819d5394d2fb354eb566eecfc6d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:29.007363 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaba98-3bcb-436a-ac6d-5b6f3526721f None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.007650 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaba98-3bcb-436a-ac6d-5b6f3526721f None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.007926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaba98-3bcb-436a-ac6d-5b6f3526721f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.025771 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-f8aaba98-3bcb-436a-ac6d-5b6f3526721f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:29.026990 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-f8aaba98-3bcb-436a-ac6d-5b6f3526721f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:29.084009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1398/2809] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:29.093315 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25323ae9-476b-4b54-9835-f0072faa5a54 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.093602 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25323ae9-476b-4b54-9835-f0072faa5a54 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.093880 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25323ae9-476b-4b54-9835-f0072faa5a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.112171 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-25323ae9-476b-4b54-9835-f0072faa5a54 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:29.113347 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-25323ae9-476b-4b54-9835-f0072faa5a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:29.121621 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1412/2810] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:29.125983 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaba98-3bcb-436a-ac6d-5b6f3526721f None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.135658 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaba98-3bcb-436a-ac6d-5b6f3526721f None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.140193 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bbacb-931f-48e9-b3d9-8e4a31282620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.140832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bbacb-931f-48e9-b3d9-8e4a31282620 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.141124 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bbacb-931f-48e9-b3d9-8e4a31282620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.141395 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bbacb-931f-48e9-b3d9-8e4a31282620 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.142117 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bbacb-931f-48e9-b3d9-8e4a31282620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 16:05:29.142452 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bbacb-931f-48e9-b3d9-8e4a31282620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.144036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bbacb-931f-48e9-b3d9-8e4a31282620 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.155058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1399/2811] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 16:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 16:05:29.159391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25323ae9-476b-4b54-9835-f0072faa5a54 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.168790 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25323ae9-476b-4b54-9835-f0072faa5a54 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.173368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f268817-2bba-4c2b-8c47-b36fa176376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.174002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268817-2bba-4c2b-8c47-b36fa176376d admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.174282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268817-2bba-4c2b-8c47-b36fa176376d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.174584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268817-2bba-4c2b-8c47-b36fa176376d admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.175280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f268817-2bba-4c2b-8c47-b36fa176376d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.177170 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f268817-2bba-4c2b-8c47-b36fa176376d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.201982 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1413/2812] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:29 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 16:05:29.206241 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bbacb-931f-48e9-b3d9-8e4a31282620 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.216637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bbacb-931f-48e9-b3d9-8e4a31282620 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.270652 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140a4cf-e317-4d16-a375-f1cbba2fbc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.271308 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140a4cf-e317-4d16-a375-f1cbba2fbc35 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.271586 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140a4cf-e317-4d16-a375-f1cbba2fbc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.271883 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140a4cf-e317-4d16-a375-f1cbba2fbc35 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.272738 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140a4cf-e317-4d16-a375-f1cbba2fbc35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.274673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140a4cf-e317-4d16-a375-f1cbba2fbc35 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.294600 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1400/2813] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:29 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:29.298820 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f268817-2bba-4c2b-8c47-b36fa176376d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.308816 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f268817-2bba-4c2b-8c47-b36fa176376d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.313392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3067fc6-814f-4937-8f60-631cca12e181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.314072 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067fc6-814f-4937-8f60-631cca12e181 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.314373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067fc6-814f-4937-8f60-631cca12e181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.314648 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3067fc6-814f-4937-8f60-631cca12e181 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.315373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3067fc6-814f-4937-8f60-631cca12e181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.316954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3067fc6-814f-4937-8f60-631cca12e181 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.327225 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1414/2814] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:29.331327 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140a4cf-e317-4d16-a375-f1cbba2fbc35 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.341499 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140a4cf-e317-4d16-a375-f1cbba2fbc35 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.346035 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3beb2-7d9c-4418-9bd1-d09034be76ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.346712 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3beb2-7d9c-4418-9bd1-d09034be76ce admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.346995 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3beb2-7d9c-4418-9bd1-d09034be76ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.347270 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3beb2-7d9c-4418-9bd1-d09034be76ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.347990 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3beb2-7d9c-4418-9bd1-d09034be76ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.349559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3beb2-7d9c-4418-9bd1-d09034be76ce admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.359749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1401/2815] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 14 16:05:29.363807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3067fc6-814f-4937-8f60-631cca12e181 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.373647 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3067fc6-814f-4937-8f60-631cca12e181 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.378231 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a11a5-6fc0-4274-af6f-d75579f9ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.379125 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a11a5-6fc0-4274-af6f-d75579f9ce61 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.379405 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a11a5-6fc0-4274-af6f-d75579f9ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.379675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a11a5-6fc0-4274-af6f-d75579f9ce61 admin admin] PATH_INFO: `/v3/projects/d06d91ecd10a485b915e8a64190b0105/users/511c7739f0064f8286973d61c6f99ce4/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.394126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a11a5-6fc0-4274-af6f-d75579f9ce61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06d91ecd10a485b915e8a64190b0105, user_id=511c7739f0064f8286973d61c6f99ce4, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.397314 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a11a5-6fc0-4274-af6f-d75579f9ce61 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.410402 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1415/2816] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:29 2022] PUT /identity/v3/projects/d06d91ecd10a485b915e8a64190b0105/users/511c7739f0064f8286973d61c6f99ce4/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 16:05:29.422385 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24acad-2092-4d08-a520-35451759d715 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.422688 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24acad-2092-4d08-a520-35451759d715 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.422957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24acad-2092-4d08-a520-35451759d715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.448694 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-ef24acad-2092-4d08-a520-35451759d715 None None] MFA Rules not processed for user `511c7739f0064f8286973d61c6f99ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:29.449890 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-ef24acad-2092-4d08-a520-35451759d715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:29.513162 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1402/2817] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:29.517776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a11a5-6fc0-4274-af6f-d75579f9ce61 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.576928 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a11a5-6fc0-4274-af6f-d75579f9ce61 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.581504 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab8c30-dfd6-4af7-8a42-69e9fc185f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.582152 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab8c30-dfd6-4af7-8a42-69e9fc185f39 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.582467 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab8c30-dfd6-4af7-8a42-69e9fc185f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.582745 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab8c30-dfd6-4af7-8a42-69e9fc185f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.583425 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab8c30-dfd6-4af7-8a42-69e9fc185f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.585487 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab8c30-dfd6-4af7-8a42-69e9fc185f39 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.609495 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1416/2818] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:29 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:29.613595 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24acad-2092-4d08-a520-35451759d715 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.625179 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24acad-2092-4d08-a520-35451759d715 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.679409 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dae6ae-a620-4054-820c-326b58bb9dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.680063 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae6ae-a620-4054-820c-326b58bb9dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.680346 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae6ae-a620-4054-820c-326b58bb9dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.680621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dae6ae-a620-4054-820c-326b58bb9dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.681310 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dae6ae-a620-4054-820c-326b58bb9dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.683248 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dae6ae-a620-4054-820c-326b58bb9dc2 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.702713 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1403/2819] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:29 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:29.706818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab8c30-dfd6-4af7-8a42-69e9fc185f39 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.716954 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab8c30-dfd6-4af7-8a42-69e9fc185f39 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.721595 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224783e-34b9-409a-b0ba-ae67c9ca0506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.722274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224783e-34b9-409a-b0ba-ae67c9ca0506 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.722611 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224783e-34b9-409a-b0ba-ae67c9ca0506 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.722884 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224783e-34b9-409a-b0ba-ae67c9ca0506 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.723612 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224783e-34b9-409a-b0ba-ae67c9ca0506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.725817 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224783e-34b9-409a-b0ba-ae67c9ca0506 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.736047 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1417/2820] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:29.740085 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dae6ae-a620-4054-820c-326b58bb9dc2 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.750782 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dae6ae-a620-4054-820c-326b58bb9dc2 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.755304 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc5399-be0f-40e9-85fa-0b609d3f4e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.756274 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc5399-be0f-40e9-85fa-0b609d3f4e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.756512 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc5399-be0f-40e9-85fa-0b609d3f4e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.756934 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc5399-be0f-40e9-85fa-0b609d3f4e3e admin admin] PATH_INFO: `/v3/projects/f4d449f80f1b4637a5f465a4446739a3/users/e3982c7cdcad45819e400b7bc0309a8e/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.770882 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc5399-be0f-40e9-85fa-0b609d3f4e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d449f80f1b4637a5f465a4446739a3, user_id=e3982c7cdcad45819e400b7bc0309a8e, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.773708 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc5399-be0f-40e9-85fa-0b609d3f4e3e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.785832 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1404/2821] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:29 2022] PUT /identity/v3/projects/f4d449f80f1b4637a5f465a4446739a3/users/e3982c7cdcad45819e400b7bc0309a8e/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:29.790299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224783e-34b9-409a-b0ba-ae67c9ca0506 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.800087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224783e-34b9-409a-b0ba-ae67c9ca0506 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.856562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb9720-9762-48ad-a64a-68d7c0a5d14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.857226 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb9720-9762-48ad-a64a-68d7c0a5d14b admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.857517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb9720-9762-48ad-a64a-68d7c0a5d14b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.857793 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb9720-9762-48ad-a64a-68d7c0a5d14b admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.858587 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb9720-9762-48ad-a64a-68d7c0a5d14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.860222 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb9720-9762-48ad-a64a-68d7c0a5d14b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.870456 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1418/2822] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:29.874797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc5399-be0f-40e9-85fa-0b609d3f4e3e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:29.885165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc5399-be0f-40e9-85fa-0b609d3f4e3e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:29.889797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15913c-d4b7-4c4f-9200-2afbabe9e1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:29.890707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15913c-d4b7-4c4f-9200-2afbabe9e1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.890994 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15913c-d4b7-4c4f-9200-2afbabe9e1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.891268 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15913c-d4b7-4c4f-9200-2afbabe9e1ba admin admin] PATH_INFO: `/v3/projects/f4d449f80f1b4637a5f465a4446739a3/users/e3982c7cdcad45819e400b7bc0309a8e/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.894412 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15913c-d4b7-4c4f-9200-2afbabe9e1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d449f80f1b4637a5f465a4446739a3, user_id=e3982c7cdcad45819e400b7bc0309a8e, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:29.897088 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15913c-d4b7-4c4f-9200-2afbabe9e1ba admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:29.907050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1405/2823] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:29 2022] PUT /identity/v3/projects/f4d449f80f1b4637a5f465a4446739a3/users/e3982c7cdcad45819e400b7bc0309a8e/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 16:05:29.918690 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc35305-484e-43fc-984c-ec51c7df6110 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:29.918981 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc35305-484e-43fc-984c-ec51c7df6110 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:29.919254 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc35305-484e-43fc-984c-ec51c7df6110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:29.945576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-0fc35305-484e-43fc-984c-ec51c7df6110 None None] MFA Rules not processed for user `e3982c7cdcad45819e400b7bc0309a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:29.946824 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-0fc35305-484e-43fc-984c-ec51c7df6110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:30.011461 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1419/2824] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:30.022801 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15913c-d4b7-4c4f-9200-2afbabe9e1ba admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:30.024562 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-7b15913c-d4b7-4c4f-9200-2afbabe9e1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:30.081267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15913c-d4b7-4c4f-9200-2afbabe9e1ba admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:30.085419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e042ce-dbc1-48ef-9540-a3a8d51b93ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:30.086045 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e042ce-dbc1-48ef-9540-a3a8d51b93ff service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:30.086348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e042ce-dbc1-48ef-9540-a3a8d51b93ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:30.086629 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e042ce-dbc1-48ef-9540-a3a8d51b93ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:30.095430 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e042ce-dbc1-48ef-9540-a3a8d51b93ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:30.096847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e042ce-dbc1-48ef-9540-a3a8d51b93ff service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:30.106673 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1406/2825] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:30.176537 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc35305-484e-43fc-984c-ec51c7df6110 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:30.186002 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc35305-484e-43fc-984c-ec51c7df6110 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:30.189551 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a475680-c603-4e89-87b5-ec8e2b8004a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:30.190184 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a475680-c603-4e89-87b5-ec8e2b8004a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:30.190531 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a475680-c603-4e89-87b5-ec8e2b8004a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:30.190807 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a475680-c603-4e89-87b5-ec8e2b8004a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:30.247280 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a475680-c603-4e89-87b5-ec8e2b8004a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:30.248970 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a475680-c603-4e89-87b5-ec8e2b8004a7 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:30.257934 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1420/2826] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:30.558144 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e042ce-dbc1-48ef-9540-a3a8d51b93ff service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:30.616863 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e042ce-dbc1-48ef-9540-a3a8d51b93ff service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:30.622028 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:30.623139 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:30.623417 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:30.623686 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] PATH_INFO: `/v3/users/511c7739f0064f8286973d61c6f99ce4` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:30.624889 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] RBAC: Authorizing `identity:delete_user(user_id=511c7739f0064f8286973d61c6f99ce4)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:30.626854 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:30.670675 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '511c7739f0064f8286973d61c6f99ce4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:30.682488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '511c7739f0064f8286973d61c6f99ce4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:30.683150 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '511c7739f0064f8286973d61c6f99ce4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:30.683754 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '511c7739f0064f8286973d61c6f99ce4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:30.690227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '511c7739f0064f8286973d61c6f99ce4'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:30.701856 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1407/2827] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:30 2022] DELETE /identity/v3/users/511c7739f0064f8286973d61c6f99ce4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:30.706373 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59113bb-c029-4f3e-86cd-fe806f8453ad None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:30.706914 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59113bb-c029-4f3e-86cd-fe806f8453ad None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:30.707020 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59113bb-c029-4f3e-86cd-fe806f8453ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:30.723361 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-a59113bb-c029-4f3e-86cd-fe806f8453ad None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:30.724584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a59113bb-c029-4f3e-86cd-fe806f8453ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:30.782088 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1421/2828] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:30.792122 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:30.793593 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:30.851789 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfaf01-29b4-4dca-bf25-bb8e4d94298b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:30.855393 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e067a5-97d7-4166-a3c7-072441d774ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:30.856031 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e067a5-97d7-4166-a3c7-072441d774ad service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:30.856307 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e067a5-97d7-4166-a3c7-072441d774ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:30.856576 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e067a5-97d7-4166-a3c7-072441d774ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:30.865267 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e067a5-97d7-4166-a3c7-072441d774ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:30.866858 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e067a5-97d7-4166-a3c7-072441d774ad service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:30.876386 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1408/2829] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:31.131700 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59113bb-c029-4f3e-86cd-fe806f8453ad None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:31.133177 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-a59113bb-c029-4f3e-86cd-fe806f8453ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:31.150757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59113bb-c029-4f3e-86cd-fe806f8453ad None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:31.155424 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:31.156297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:31.156544 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:31.156938 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] PATH_INFO: `/v3/projects/d06d91ecd10a485b915e8a64190b0105` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:31.158209 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06d91ecd10a485b915e8a64190b0105)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:31.160051 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:31.205743 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06d91ecd10a485b915e8a64190b0105', 'request_id': 'req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.212217 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06d91ecd10a485b915e8a64190b0105', 'request_id': 'req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.219408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06d91ecd10a485b915e8a64190b0105', 'request_id': 'req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.229739 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] The token cache is being invalidate because project d06d91ecd10a485b915e8a64190b0105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:31.230025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.230653 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.232175 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1422/2830] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:31 2022] DELETE /identity/v3/projects/d06d91ecd10a485b915e8a64190b0105 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:31.236101 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e067a5-97d7-4166-a3c7-072441d774ad service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:31.245578 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e067a5-97d7-4166-a3c7-072441d774ad service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:31.299714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c89f8-1c73-4c4d-87ec-cb56d3bf4f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:31.300584 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c89f8-1c73-4c4d-87ec-cb56d3bf4f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:31.300866 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c89f8-1c73-4c4d-87ec-cb56d3bf4f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:31.301139 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c89f8-1c73-4c4d-87ec-cb56d3bf4f9b admin admin] PATH_INFO: `/v3/users/e3982c7cdcad45819e400b7bc0309a8e` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:31.302326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c89f8-1c73-4c4d-87ec-cb56d3bf4f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3982c7cdcad45819e400b7bc0309a8e)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:31.304505 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c89f8-1c73-4c4d-87ec-cb56d3bf4f9b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:31.348666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e26c89f8-1c73-4c4d-87ec-cb56d3bf4f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3982c7cdcad45819e400b7bc0309a8e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.359843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e26c89f8-1c73-4c4d-87ec-cb56d3bf4f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3982c7cdcad45819e400b7bc0309a8e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.360495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e26c89f8-1c73-4c4d-87ec-cb56d3bf4f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3982c7cdcad45819e400b7bc0309a8e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.361097 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e26c89f8-1c73-4c4d-87ec-cb56d3bf4f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3982c7cdcad45819e400b7bc0309a8e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.367806 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-e26c89f8-1c73-4c4d-87ec-cb56d3bf4f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3982c7cdcad45819e400b7bc0309a8e'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.380149 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1409/2831] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:31 2022] DELETE /identity/v3/users/e3982c7cdcad45819e400b7bc0309a8e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:31.639601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:31.641179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:31.654776 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47b91-6fc7-4b6c-a64e-d5f4d574f75b admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:31.710468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:31.711321 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:31.711598 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:31.711868 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] PATH_INFO: `/v3/projects/f4d449f80f1b4637a5f465a4446739a3` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:31.713042 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d449f80f1b4637a5f465a4446739a3)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:31.714966 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:31.760319 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d449f80f1b4637a5f465a4446739a3', 'request_id': 'req-784e6280-c6b6-4402-9be4-0b93bfa0b04f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.766126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d449f80f1b4637a5f465a4446739a3', 'request_id': 'req-784e6280-c6b6-4402-9be4-0b93bfa0b04f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.772794 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d449f80f1b4637a5f465a4446739a3', 'request_id': 'req-784e6280-c6b6-4402-9be4-0b93bfa0b04f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.782941 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] The token cache is being invalidate because project f4d449f80f1b4637a5f465a4446739a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:31.783229 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.783852 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-784e6280-c6b6-4402-9be4-0b93bfa0b04f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:31.785374 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1423/2832] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:31 2022] DELETE /identity/v3/projects/f4d449f80f1b4637a5f465a4446739a3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:31.790237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82510-f6fb-40af-bede-80a741cbf520 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:31.790733 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82510-f6fb-40af-bede-80a741cbf520 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:31.790851 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b82510-f6fb-40af-bede-80a741cbf520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:31.809118 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-03b82510-f6fb-40af-bede-80a741cbf520 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:31.810331 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-03b82510-f6fb-40af-bede-80a741cbf520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:31.869702 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1410/2833] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:31.877706 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d1e96-9924-48b1-bb88-cae0622d080f None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:31.877995 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d1e96-9924-48b1-bb88-cae0622d080f None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:31.878274 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d1e96-9924-48b1-bb88-cae0622d080f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:31.896009 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-566d1e96-9924-48b1-bb88-cae0622d080f None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:31.897641 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-566d1e96-9924-48b1-bb88-cae0622d080f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:31.906368 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1424/2834] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:31.910403 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b82510-f6fb-40af-bede-80a741cbf520 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:31.920662 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b82510-f6fb-40af-bede-80a741cbf520 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:31.925297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f5e49-571b-4516-8177-ff9c1c22e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:31.925935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f5e49-571b-4516-8177-ff9c1c22e544 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:31.926213 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f5e49-571b-4516-8177-ff9c1c22e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:31.926510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f5e49-571b-4516-8177-ff9c1c22e544 admin admin] PATH_INFO: `/v3/domains` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:31.927227 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f5e49-571b-4516-8177-ff9c1c22e544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86463) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 16:05:31.927522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f5e49-571b-4516-8177-ff9c1c22e544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:31.929106 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f5e49-571b-4516-8177-ff9c1c22e544 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:31.940140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1411/2835] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 16:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 14 16:05:31.944913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d1e96-9924-48b1-bb88-cae0622d080f None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:31.953861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d1e96-9924-48b1-bb88-cae0622d080f None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:31.958440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16042c-9019-408f-bd25-cb63629e6f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:31.959074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16042c-9019-408f-bd25-cb63629e6f89 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:31.960003 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16042c-9019-408f-bd25-cb63629e6f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:31.960283 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16042c-9019-408f-bd25-cb63629e6f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:31.960967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16042c-9019-408f-bd25-cb63629e6f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:31.962893 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16042c-9019-408f-bd25-cb63629e6f89 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:31.989074 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1425/2836] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:31 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:31.990584 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f5e49-571b-4516-8177-ff9c1c22e544 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.001935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f5e49-571b-4516-8177-ff9c1c22e544 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.056978 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a3c3-d039-4ff6-85e6-651a464b18b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.057633 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a3c3-d039-4ff6-85e6-651a464b18b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.057915 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a3c3-d039-4ff6-85e6-651a464b18b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.058187 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775a3c3-d039-4ff6-85e6-651a464b18b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.058909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775a3c3-d039-4ff6-85e6-651a464b18b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.060812 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775a3c3-d039-4ff6-85e6-651a464b18b0 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.079564 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1412/2837] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:31 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:32.083591 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16042c-9019-408f-bd25-cb63629e6f89 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.093606 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16042c-9019-408f-bd25-cb63629e6f89 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.098391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5329fb1-ce7e-4680-9f79-a2b44992e4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.099047 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5329fb1-ce7e-4680-9f79-a2b44992e4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.099325 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5329fb1-ce7e-4680-9f79-a2b44992e4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.099628 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5329fb1-ce7e-4680-9f79-a2b44992e4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.101087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5329fb1-ce7e-4680-9f79-a2b44992e4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.102963 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5329fb1-ce7e-4680-9f79-a2b44992e4c4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.113046 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1426/2838] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:32.117551 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a3c3-d039-4ff6-85e6-651a464b18b0 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.127320 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775a3c3-d039-4ff6-85e6-651a464b18b0 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.131929 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa8053-2914-4a78-8e24-fde6037564e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.132571 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa8053-2914-4a78-8e24-fde6037564e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.132850 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa8053-2914-4a78-8e24-fde6037564e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.133152 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa8053-2914-4a78-8e24-fde6037564e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.133874 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa8053-2914-4a78-8e24-fde6037564e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.135499 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa8053-2914-4a78-8e24-fde6037564e8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.144901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1413/2839] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:32.149732 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5329fb1-ce7e-4680-9f79-a2b44992e4c4 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.159455 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5329fb1-ce7e-4680-9f79-a2b44992e4c4 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.164967 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74fcc5-37d5-4c6e-a7af-0137cd237325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.165862 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74fcc5-37d5-4c6e-a7af-0137cd237325 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.166151 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74fcc5-37d5-4c6e-a7af-0137cd237325 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.166480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74fcc5-37d5-4c6e-a7af-0137cd237325 admin admin] PATH_INFO: `/v3/projects/7b3a0698ffe3407089e552cfceee8a7b/users/2c536c72dd944364a68d8a1a465591ce/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.181761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74fcc5-37d5-4c6e-a7af-0137cd237325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3a0698ffe3407089e552cfceee8a7b, user_id=2c536c72dd944364a68d8a1a465591ce, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.184501 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74fcc5-37d5-4c6e-a7af-0137cd237325 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.197201 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1427/2840] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:32 2022] PUT /identity/v3/projects/7b3a0698ffe3407089e552cfceee8a7b/users/2c536c72dd944364a68d8a1a465591ce/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:32.207326 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6c08b-556e-4187-87d5-89f900b28070 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.207615 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6c08b-556e-4187-87d5-89f900b28070 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.207909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6c08b-556e-4187-87d5-89f900b28070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.234036 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-40c6c08b-556e-4187-87d5-89f900b28070 None None] MFA Rules not processed for user `2c536c72dd944364a68d8a1a465591ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:32.235247 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-40c6c08b-556e-4187-87d5-89f900b28070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:32.296711 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1414/2841] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:32.301140 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74fcc5-37d5-4c6e-a7af-0137cd237325 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.360680 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74fcc5-37d5-4c6e-a7af-0137cd237325 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.365430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de59dc-b9a5-446c-adaa-66446002f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.366135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de59dc-b9a5-446c-adaa-66446002f641 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.366448 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de59dc-b9a5-446c-adaa-66446002f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.366725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de59dc-b9a5-446c-adaa-66446002f641 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.367421 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de59dc-b9a5-446c-adaa-66446002f641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.369313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de59dc-b9a5-446c-adaa-66446002f641 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.393039 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1428/2842] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:32 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 16:05:32.397554 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6c08b-556e-4187-87d5-89f900b28070 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.407982 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6c08b-556e-4187-87d5-89f900b28070 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.462530 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2315b-e0f5-4628-91a4-34e0ba433c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.463189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2315b-e0f5-4628-91a4-34e0ba433c4e admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.463467 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2315b-e0f5-4628-91a4-34e0ba433c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.463736 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2315b-e0f5-4628-91a4-34e0ba433c4e admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.464424 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2315b-e0f5-4628-91a4-34e0ba433c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.466356 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2315b-e0f5-4628-91a4-34e0ba433c4e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.485454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1415/2843] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:32 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 16:05:32.489458 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de59dc-b9a5-446c-adaa-66446002f641 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.500282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de59dc-b9a5-446c-adaa-66446002f641 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.504849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae8d5e-dbc8-4d4c-9e32-1adf8bc4a4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.505497 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae8d5e-dbc8-4d4c-9e32-1adf8bc4a4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.505784 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae8d5e-dbc8-4d4c-9e32-1adf8bc4a4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.506060 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae8d5e-dbc8-4d4c-9e32-1adf8bc4a4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.507585 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae8d5e-dbc8-4d4c-9e32-1adf8bc4a4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.509168 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae8d5e-dbc8-4d4c-9e32-1adf8bc4a4e6 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.520845 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1429/2844] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:32.525372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2315b-e0f5-4628-91a4-34e0ba433c4e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.535330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2315b-e0f5-4628-91a4-34e0ba433c4e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.541071 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20f8d9-6f8c-41e4-8276-06e448d358d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.541724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20f8d9-6f8c-41e4-8276-06e448d358d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.542009 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20f8d9-6f8c-41e4-8276-06e448d358d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.542288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20f8d9-6f8c-41e4-8276-06e448d358d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.543056 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20f8d9-6f8c-41e4-8276-06e448d358d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.544644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20f8d9-6f8c-41e4-8276-06e448d358d9 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.555644 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1416/2845] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:32.559728 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae8d5e-dbc8-4d4c-9e32-1adf8bc4a4e6 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.570142 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae8d5e-dbc8-4d4c-9e32-1adf8bc4a4e6 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.574766 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271d654-a2c3-4c3b-ab82-da4489ceb849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.575627 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271d654-a2c3-4c3b-ab82-da4489ceb849 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.575909 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271d654-a2c3-4c3b-ab82-da4489ceb849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.576182 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271d654-a2c3-4c3b-ab82-da4489ceb849 admin admin] PATH_INFO: `/v3/projects/6e09bb7c9d6647eb9feedeb216f3abb2/users/26275d80a89f4e1889c5404c90388454/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.590061 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271d654-a2c3-4c3b-ab82-da4489ceb849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e09bb7c9d6647eb9feedeb216f3abb2, user_id=26275d80a89f4e1889c5404c90388454, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.592733 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271d654-a2c3-4c3b-ab82-da4489ceb849 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.606205 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1430/2846] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:32 2022] PUT /identity/v3/projects/6e09bb7c9d6647eb9feedeb216f3abb2/users/26275d80a89f4e1889c5404c90388454/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 16:05:32.618237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020346f5-e695-4ad0-9a57-be32688cc55a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.618568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020346f5-e695-4ad0-9a57-be32688cc55a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.618848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020346f5-e695-4ad0-9a57-be32688cc55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.646534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-020346f5-e695-4ad0-9a57-be32688cc55a None None] MFA Rules not processed for user `26275d80a89f4e1889c5404c90388454`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:32.648233 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-020346f5-e695-4ad0-9a57-be32688cc55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:32.710611 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1417/2847] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:32.715058 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271d654-a2c3-4c3b-ab82-da4489ceb849 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.775984 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271d654-a2c3-4c3b-ab82-da4489ceb849 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.780646 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe611af-ed85-47ef-a620-8065c0d2e678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.781297 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe611af-ed85-47ef-a620-8065c0d2e678 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.781584 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe611af-ed85-47ef-a620-8065c0d2e678 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.781867 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe611af-ed85-47ef-a620-8065c0d2e678 admin admin] PATH_INFO: `/v3/projects` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.782581 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe611af-ed85-47ef-a620-8065c0d2e678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.784482 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe611af-ed85-47ef-a620-8065c0d2e678 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.809725 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1431/2848] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:32 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:32.813869 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020346f5-e695-4ad0-9a57-be32688cc55a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.824749 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020346f5-e695-4ad0-9a57-be32688cc55a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.879619 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613595b2-6381-4ad3-afb6-998114a3b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.880280 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613595b2-6381-4ad3-afb6-998114a3b744 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.880561 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613595b2-6381-4ad3-afb6-998114a3b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.880834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613595b2-6381-4ad3-afb6-998114a3b744 admin admin] PATH_INFO: `/v3/users` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.881714 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613595b2-6381-4ad3-afb6-998114a3b744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.883691 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613595b2-6381-4ad3-afb6-998114a3b744 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.902460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1418/2849] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:32 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:32.906436 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe611af-ed85-47ef-a620-8065c0d2e678 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.916977 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe611af-ed85-47ef-a620-8065c0d2e678 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.921775 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0b5f6-609d-4fef-ab92-96a80ec11114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.922465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0b5f6-609d-4fef-ab92-96a80ec11114 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.922754 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0b5f6-609d-4fef-ab92-96a80ec11114 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.923032 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0b5f6-609d-4fef-ab92-96a80ec11114 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.923760 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0b5f6-609d-4fef-ab92-96a80ec11114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.925349 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0b5f6-609d-4fef-ab92-96a80ec11114 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.936240 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1432/2850] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:32.940513 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613595b2-6381-4ad3-afb6-998114a3b744 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:32.950632 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613595b2-6381-4ad3-afb6-998114a3b744 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:32.955330 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7165631-8d88-4c28-907e-894d2649b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:32.956205 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165631-8d88-4c28-907e-894d2649b289 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:32.956489 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165631-8d88-4c28-907e-894d2649b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:32.956764 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7165631-8d88-4c28-907e-894d2649b289 admin admin] PATH_INFO: `/v3/projects/cd6676b7795b4d4ca7634d26923977f0/users/60c12f002c494e6382922668526fae5a/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:32.970921 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7165631-8d88-4c28-907e-894d2649b289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6676b7795b4d4ca7634d26923977f0, user_id=60c12f002c494e6382922668526fae5a, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:32.973475 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7165631-8d88-4c28-907e-894d2649b289 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:32.986451 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1419/2851] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:32 2022] PUT /identity/v3/projects/cd6676b7795b4d4ca7634d26923977f0/users/60c12f002c494e6382922668526fae5a/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:32.990430 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0b5f6-609d-4fef-ab92-96a80ec11114 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:33.000947 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0b5f6-609d-4fef-ab92-96a80ec11114 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:33.054396 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc792c-2bfd-45ce-8964-9fa0640b1bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:33.055052 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc792c-2bfd-45ce-8964-9fa0640b1bef admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:33.055339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc792c-2bfd-45ce-8964-9fa0640b1bef admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:33.055618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc792c-2bfd-45ce-8964-9fa0640b1bef admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:33.056333 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc792c-2bfd-45ce-8964-9fa0640b1bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:33.057940 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc792c-2bfd-45ce-8964-9fa0640b1bef admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:33.067187 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1433/2852] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:33.071484 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7165631-8d88-4c28-907e-894d2649b289 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:33.081555 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7165631-8d88-4c28-907e-894d2649b289 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:33.086778 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a755281-9889-4ae6-bd05-fdf01f4ff84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:33.087651 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a755281-9889-4ae6-bd05-fdf01f4ff84b admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:33.087930 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a755281-9889-4ae6-bd05-fdf01f4ff84b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:33.088203 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a755281-9889-4ae6-bd05-fdf01f4ff84b admin admin] PATH_INFO: `/v3/projects/cd6676b7795b4d4ca7634d26923977f0/users/60c12f002c494e6382922668526fae5a/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:33.090142 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a755281-9889-4ae6-bd05-fdf01f4ff84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6676b7795b4d4ca7634d26923977f0, user_id=60c12f002c494e6382922668526fae5a, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:33.092779 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a755281-9889-4ae6-bd05-fdf01f4ff84b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:33.103167 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1420/2853] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:33 2022] PUT /identity/v3/projects/cd6676b7795b4d4ca7634d26923977f0/users/60c12f002c494e6382922668526fae5a/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:33.113011 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae9805-4992-4383-be14-cd694aceca7e None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:33.113305 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae9805-4992-4383-be14-cd694aceca7e None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:33.113618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae9805-4992-4383-be14-cd694aceca7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:33.139633 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-fbae9805-4992-4383-be14-cd694aceca7e None None] MFA Rules not processed for user `60c12f002c494e6382922668526fae5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:33.140821 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-fbae9805-4992-4383-be14-cd694aceca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:33.206184 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1434/2854] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 14 16:05:33.217603 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a755281-9889-4ae6-bd05-fdf01f4ff84b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:33.219278 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-3a755281-9889-4ae6-bd05-fdf01f4ff84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:33.274955 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a755281-9889-4ae6-bd05-fdf01f4ff84b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:33.278488 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee252c-5664-4447-83b2-792f69c52ecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:33.279121 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee252c-5664-4447-83b2-792f69c52ecf service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:33.279402 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee252c-5664-4447-83b2-792f69c52ecf service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:33.279675 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee252c-5664-4447-83b2-792f69c52ecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:33.335999 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee252c-5664-4447-83b2-792f69c52ecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:33.337466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee252c-5664-4447-83b2-792f69c52ecf service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:33.346219 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1421/2855] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:34.817432 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae9805-4992-4383-be14-cd694aceca7e None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:34.819536 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-fbae9805-4992-4383-be14-cd694aceca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:34.831459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae9805-4992-4383-be14-cd694aceca7e None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:34.835346 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9ec17-accb-4bf5-bcb0-a203633ed70a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:34.836517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ec17-accb-4bf5-bcb0-a203633ed70a service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:34.836517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ec17-accb-4bf5-bcb0-a203633ed70a service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:34.836517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ec17-accb-4bf5-bcb0-a203633ed70a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:34.891755 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9ec17-accb-4bf5-bcb0-a203633ed70a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:34.893138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9ec17-accb-4bf5-bcb0-a203633ed70a service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:34.902135 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1435/2856] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:35.410335 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee252c-5664-4447-83b2-792f69c52ecf service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:35.422038 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee252c-5664-4447-83b2-792f69c52ecf service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:35.425698 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469901b9-53c8-4e4c-8434-c38691ac4649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:35.426355 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469901b9-53c8-4e4c-8434-c38691ac4649 service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:35.426639 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469901b9-53c8-4e4c-8434-c38691ac4649 service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:35.426909 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469901b9-53c8-4e4c-8434-c38691ac4649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:35.435886 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469901b9-53c8-4e4c-8434-c38691ac4649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:35.437297 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469901b9-53c8-4e4c-8434-c38691ac4649 service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:35.446558 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1422/2857] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:39.259342 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9ec17-accb-4bf5-bcb0-a203633ed70a service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:39.319913 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9ec17-accb-4bf5-bcb0-a203633ed70a service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:39.324440 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:39.325332 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:39.325617 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:39.325897 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] PATH_INFO: `/v3/users/2c536c72dd944364a68d8a1a465591ce` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:39.327119 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c536c72dd944364a68d8a1a465591ce)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:39.329025 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:39.373834 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c536c72dd944364a68d8a1a465591ce'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:39.385825 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c536c72dd944364a68d8a1a465591ce'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:39.386517 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c536c72dd944364a68d8a1a465591ce'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:39.387126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c536c72dd944364a68d8a1a465591ce'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:39.393675 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c536c72dd944364a68d8a1a465591ce'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:39.406077 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1436/2858] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:39 2022] DELETE /identity/v3/users/2c536c72dd944364a68d8a1a465591ce => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:39.410571 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3d76-a7c7-4b9c-ad82-13a4a4225a23 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:39.411050 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3d76-a7c7-4b9c-ad82-13a4a4225a23 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:39.411166 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a3d76-a7c7-4b9c-ad82-13a4a4225a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:39.428435 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-aa2a3d76-a7c7-4b9c-ad82-13a4a4225a23 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:39.429756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-aa2a3d76-a7c7-4b9c-ad82-13a4a4225a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:39.485835 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1423/2859] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:39.495949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:39.497309 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:39.550870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38512e9-d79f-43d1-b2ba-557f36a7d0f4 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:39.555104 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd492f-d7f0-43f9-8b39-81df657e9b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:39.555736 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd492f-d7f0-43f9-8b39-81df657e9b92 service neutron] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:39.556015 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd492f-d7f0-43f9-8b39-81df657e9b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:39.556288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd492f-d7f0-43f9-8b39-81df657e9b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:39.564915 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd492f-d7f0-43f9-8b39-81df657e9b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:39.566339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd492f-d7f0-43f9-8b39-81df657e9b92 service neutron] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:39.575480 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1437/2860] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:39.826210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3d76-a7c7-4b9c-ad82-13a4a4225a23 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:39.827924 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-aa2a3d76-a7c7-4b9c-ad82-13a4a4225a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:39.846797 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a3d76-a7c7-4b9c-ad82-13a4a4225a23 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:39.852131 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:39.852989 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:39.853288 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:39.853510 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] PATH_INFO: `/v3/projects/7b3a0698ffe3407089e552cfceee8a7b` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:39.854820 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3a0698ffe3407089e552cfceee8a7b)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:39.856637 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:39.902033 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3a0698ffe3407089e552cfceee8a7b', 'request_id': 'req-9404c425-9a94-4700-8bc2-483b5aef2368'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:39.908910 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3a0698ffe3407089e552cfceee8a7b', 'request_id': 'req-9404c425-9a94-4700-8bc2-483b5aef2368'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:39.915405 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3a0698ffe3407089e552cfceee8a7b', 'request_id': 'req-9404c425-9a94-4700-8bc2-483b5aef2368'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:39.925943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] The token cache is being invalidate because project 7b3a0698ffe3407089e552cfceee8a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:39.926239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:39.926895 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:39.929048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1424/2861] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:39 2022] DELETE /identity/v3/projects/7b3a0698ffe3407089e552cfceee8a7b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:39.933013 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd492f-d7f0-43f9-8b39-81df657e9b92 service neutron] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:39.942574 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd492f-d7f0-43f9-8b39-81df657e9b92 service neutron] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:39.997050 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:39.998203 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:39.998590 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:39.998868 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] PATH_INFO: `/v3/users/26275d80a89f4e1889c5404c90388454` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:40.000059 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26275d80a89f4e1889c5404c90388454)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:40.001960 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:40.047261 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26275d80a89f4e1889c5404c90388454'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.058418 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26275d80a89f4e1889c5404c90388454'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.059064 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26275d80a89f4e1889c5404c90388454'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.059660 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26275d80a89f4e1889c5404c90388454'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.066155 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26275d80a89f4e1889c5404c90388454'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.078792 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1438/2862] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:39 2022] DELETE /identity/v3/users/26275d80a89f4e1889c5404c90388454 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:40.336803 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:40.338372 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:40.351796 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404c425-9a94-4700-8bc2-483b5aef2368 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:40.406189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:40.407068 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:40.407348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:40.407623 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] PATH_INFO: `/v3/projects/6e09bb7c9d6647eb9feedeb216f3abb2` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:40.408798 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e09bb7c9d6647eb9feedeb216f3abb2)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:40.410739 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:40.454499 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e09bb7c9d6647eb9feedeb216f3abb2', 'request_id': 'req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.461071 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e09bb7c9d6647eb9feedeb216f3abb2', 'request_id': 'req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.466389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e09bb7c9d6647eb9feedeb216f3abb2', 'request_id': 'req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.477299 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] The token cache is being invalidate because project 6e09bb7c9d6647eb9feedeb216f3abb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:40.477586 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.478209 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.479769 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1425/2863] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:40 2022] DELETE /identity/v3/projects/6e09bb7c9d6647eb9feedeb216f3abb2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:40.483664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:40.485095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:40.499562 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02d564-e7c7-43fb-add3-3b4f7d57fb0d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:40.554138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326492e1-0515-46b8-83d6-700d736a3b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:40.555024 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326492e1-0515-46b8-83d6-700d736a3b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:40.555299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326492e1-0515-46b8-83d6-700d736a3b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:40.555566 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326492e1-0515-46b8-83d6-700d736a3b70 admin admin] PATH_INFO: `/v3/users/60c12f002c494e6382922668526fae5a` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:40.556753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326492e1-0515-46b8-83d6-700d736a3b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c12f002c494e6382922668526fae5a)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:40.558679 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326492e1-0515-46b8-83d6-700d736a3b70 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:40.606303 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-326492e1-0515-46b8-83d6-700d736a3b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c12f002c494e6382922668526fae5a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.618060 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-326492e1-0515-46b8-83d6-700d736a3b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c12f002c494e6382922668526fae5a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.618735 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-326492e1-0515-46b8-83d6-700d736a3b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c12f002c494e6382922668526fae5a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.619323 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-326492e1-0515-46b8-83d6-700d736a3b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c12f002c494e6382922668526fae5a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.626085 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-326492e1-0515-46b8-83d6-700d736a3b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c12f002c494e6382922668526fae5a'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:40.639299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1439/2864] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:40 2022] DELETE /identity/v3/users/60c12f002c494e6382922668526fae5a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:40.893522 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:40.895027 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:40.910298 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01d8ba-65d3-4be7-a315-5f0c4a6e886f admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:40.968868 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:40.969727 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:40.970062 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:40.970365 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] PATH_INFO: `/v3/projects/cd6676b7795b4d4ca7634d26923977f0` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:40.971559 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6676b7795b4d4ca7634d26923977f0)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:40.973466 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.017095 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6676b7795b4d4ca7634d26923977f0', 'request_id': 'req-6544abe1-e202-42bb-8a60-1177a6315b69'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:41.024173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6676b7795b4d4ca7634d26923977f0', 'request_id': 'req-6544abe1-e202-42bb-8a60-1177a6315b69'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:41.029622 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6676b7795b4d4ca7634d26923977f0', 'request_id': 'req-6544abe1-e202-42bb-8a60-1177a6315b69'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:41.040232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] The token cache is being invalidate because project cd6676b7795b4d4ca7634d26923977f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86463) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:41.040519 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:41.041140 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6544abe1-e202-42bb-8a60-1177a6315b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:41.042724 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1426/2865] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:40 2022] DELETE /identity/v3/projects/cd6676b7795b4d4ca7634d26923977f0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:41.047582 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3ba0-c68d-470e-a4a3-428dfbe31b25 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.047870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3ba0-c68d-470e-a4a3-428dfbe31b25 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.048148 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c3ba0-c68d-470e-a4a3-428dfbe31b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.065182 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-c21c3ba0-c68d-470e-a4a3-428dfbe31b25 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:41.066392 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-c21c3ba0-c68d-470e-a4a3-428dfbe31b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:41.122106 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1440/2866] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:41.130071 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efbd95-8fa3-41bd-88da-caf8e8537d77 None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.130389 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efbd95-8fa3-41bd-88da-caf8e8537d77 None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.130666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efbd95-8fa3-41bd-88da-caf8e8537d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.149683 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-c3efbd95-8fa3-41bd-88da-caf8e8537d77 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:41.150814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-c3efbd95-8fa3-41bd-88da-caf8e8537d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:41.158621 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1427/2867] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:41.162969 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c3ba0-c68d-470e-a4a3-428dfbe31b25 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:41.172377 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c3ba0-c68d-470e-a4a3-428dfbe31b25 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:41.176924 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a06495-4da6-4c4f-a5d5-6be9b4d6cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:41.177572 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a06495-4da6-4c4f-a5d5-6be9b4d6cdad admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.177873 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a06495-4da6-4c4f-a5d5-6be9b4d6cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.178237 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a06495-4da6-4c4f-a5d5-6be9b4d6cdad admin admin] PATH_INFO: `/v3/domains` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.179096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a06495-4da6-4c4f-a5d5-6be9b4d6cdad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86464) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 14 16:05:41.179408 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a06495-4da6-4c4f-a5d5-6be9b4d6cdad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:41.181006 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a06495-4da6-4c4f-a5d5-6be9b4d6cdad admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.192126 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1441/2868] 10.222.0.61 () {58 vars in 1152 bytes} [Sat May 14 16:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 14 16:05:41.196990 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efbd95-8fa3-41bd-88da-caf8e8537d77 None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:41.206119 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efbd95-8fa3-41bd-88da-caf8e8537d77 None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:41.211465 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd15c72-5cd5-4012-83a2-c920f76748b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:41.212107 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd15c72-5cd5-4012-83a2-c920f76748b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.212384 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd15c72-5cd5-4012-83a2-c920f76748b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.212656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd15c72-5cd5-4012-83a2-c920f76748b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.213369 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd15c72-5cd5-4012-83a2-c920f76748b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:41.215345 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd15c72-5cd5-4012-83a2-c920f76748b8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.238758 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1428/2869] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:41 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:41.242991 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a06495-4da6-4c4f-a5d5-6be9b4d6cdad admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:41.252701 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a06495-4da6-4c4f-a5d5-6be9b4d6cdad admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:41.307062 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d0d44-88ca-4cca-a9fd-04dae770ac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:41.307711 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0d44-88ca-4cca-a9fd-04dae770ac40 admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.307992 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0d44-88ca-4cca-a9fd-04dae770ac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.308267 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d0d44-88ca-4cca-a9fd-04dae770ac40 admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.308971 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d0d44-88ca-4cca-a9fd-04dae770ac40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:41.310909 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d0d44-88ca-4cca-a9fd-04dae770ac40 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.330164 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1442/2870] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:41 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 16:05:41.334437 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd15c72-5cd5-4012-83a2-c920f76748b8 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:41.344511 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd15c72-5cd5-4012-83a2-c920f76748b8 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:41.349000 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235b445-0785-45cd-8071-33170562031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:41.349666 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235b445-0785-45cd-8071-33170562031d admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.349943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235b445-0785-45cd-8071-33170562031d admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.350217 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235b445-0785-45cd-8071-33170562031d admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.350957 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235b445-0785-45cd-8071-33170562031d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:41.352517 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235b445-0785-45cd-8071-33170562031d admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.362847 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1429/2871] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:41.367484 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d0d44-88ca-4cca-a9fd-04dae770ac40 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:41.377423 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d0d44-88ca-4cca-a9fd-04dae770ac40 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:41.382664 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d877f-262c-4e9e-bac8-675266b0cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:41.383304 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d877f-262c-4e9e-bac8-675266b0cf50 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.383585 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d877f-262c-4e9e-bac8-675266b0cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.383858 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d877f-262c-4e9e-bac8-675266b0cf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.384583 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d877f-262c-4e9e-bac8-675266b0cf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:41.386163 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d877f-262c-4e9e-bac8-675266b0cf50 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.395767 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1443/2872] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:41.399668 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235b445-0785-45cd-8071-33170562031d admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:41.409454 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235b445-0785-45cd-8071-33170562031d admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:41.414083 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cf810-5e4b-4e87-ac6c-5131fa1815be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:41.414986 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cf810-5e4b-4e87-ac6c-5131fa1815be admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.415265 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cf810-5e4b-4e87-ac6c-5131fa1815be admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.415534 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cf810-5e4b-4e87-ac6c-5131fa1815be admin admin] PATH_INFO: `/v3/projects/dd01a6e3ead9429b90e8202289d10bd3/users/fe715910acdb4692b9c875c6c9e34e50/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.430133 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cf810-5e4b-4e87-ac6c-5131fa1815be admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd01a6e3ead9429b90e8202289d10bd3, user_id=fe715910acdb4692b9c875c6c9e34e50, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:41.432814 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cf810-5e4b-4e87-ac6c-5131fa1815be admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.446370 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1430/2873] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:41 2022] PUT /identity/v3/projects/dd01a6e3ead9429b90e8202289d10bd3/users/fe715910acdb4692b9c875c6c9e34e50/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:41.457234 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129d170-1860-4561-94e0-290a2852066c None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.457523 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129d170-1860-4561-94e0-290a2852066c None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.457803 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129d170-1860-4561-94e0-290a2852066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.483365 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-7129d170-1860-4561-94e0-290a2852066c None None] MFA Rules not processed for user `fe715910acdb4692b9c875c6c9e34e50`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:41.484554 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-7129d170-1860-4561-94e0-290a2852066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:41.546391 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1444/2874] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:41.550834 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cf810-5e4b-4e87-ac6c-5131fa1815be admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:41.609696 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cf810-5e4b-4e87-ac6c-5131fa1815be admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:41.614329 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28127e71-bc59-415f-aeb5-a8cb85ecc92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:41.614988 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28127e71-bc59-415f-aeb5-a8cb85ecc92e admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.615935 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28127e71-bc59-415f-aeb5-a8cb85ecc92e admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.616134 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28127e71-bc59-415f-aeb5-a8cb85ecc92e admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.616737 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28127e71-bc59-415f-aeb5-a8cb85ecc92e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:41.618662 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28127e71-bc59-415f-aeb5-a8cb85ecc92e admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.643901 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1431/2875] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:41 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 16:05:41.648445 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129d170-1860-4561-94e0-290a2852066c None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:41.659592 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129d170-1860-4561-94e0-290a2852066c None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:41.714514 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec62d-432f-42f6-923b-c6d03bf4c16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:41.715179 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec62d-432f-42f6-923b-c6d03bf4c16a admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.715459 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec62d-432f-42f6-923b-c6d03bf4c16a admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.715732 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec62d-432f-42f6-923b-c6d03bf4c16a admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.716427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ec62d-432f-42f6-923b-c6d03bf4c16a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:41.718339 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ec62d-432f-42f6-923b-c6d03bf4c16a admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.738087 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1445/2876] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:41 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 14 16:05:41.742682 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28127e71-bc59-415f-aeb5-a8cb85ecc92e admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:41.752914 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28127e71-bc59-415f-aeb5-a8cb85ecc92e admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:41.757699 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b4c2d-f784-4b69-9394-201b2b4e50f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:41.758388 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b4c2d-f784-4b69-9394-201b2b4e50f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.758675 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b4c2d-f784-4b69-9394-201b2b4e50f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.758952 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b4c2d-f784-4b69-9394-201b2b4e50f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.759674 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b4c2d-f784-4b69-9394-201b2b4e50f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:41.761264 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b4c2d-f784-4b69-9394-201b2b4e50f8 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.771569 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1432/2877] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:41.775601 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec62d-432f-42f6-923b-c6d03bf4c16a admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:41.785369 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec62d-432f-42f6-923b-c6d03bf4c16a admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:41.791089 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db0743-09db-4ca0-a158-d0a60f4a9c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:41.791753 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db0743-09db-4ca0-a158-d0a60f4a9c05 admin admin] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.792038 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db0743-09db-4ca0-a158-d0a60f4a9c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.792313 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db0743-09db-4ca0-a158-d0a60f4a9c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.793111 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db0743-09db-4ca0-a158-d0a60f4a9c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:41.794759 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db0743-09db-4ca0-a158-d0a60f4a9c05 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.805271 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1446/2878] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:41.809577 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b4c2d-f784-4b69-9394-201b2b4e50f8 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:41.819938 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b4c2d-f784-4b69-9394-201b2b4e50f8 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:41.824568 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbafa30-e59e-4a4d-a3f9-8a2a5085c504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:41.825460 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbafa30-e59e-4a4d-a3f9-8a2a5085c504 admin admin] REQUEST_METHOD: `PUT` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.825745 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbafa30-e59e-4a4d-a3f9-8a2a5085c504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.826024 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbafa30-e59e-4a4d-a3f9-8a2a5085c504 admin admin] PATH_INFO: `/v3/projects/76f917e7010c479ca7be28cd3ec1e4e5/users/d7c69c9b787d4927a11fb43a1d43d97c/roles/15a2a347c19845c9ac397da513eb944a` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.841608 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbafa30-e59e-4a4d-a3f9-8a2a5085c504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f917e7010c479ca7be28cd3ec1e4e5, user_id=d7c69c9b787d4927a11fb43a1d43d97c, role_id=15a2a347c19845c9ac397da513eb944a)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:41.844352 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbafa30-e59e-4a4d-a3f9-8a2a5085c504 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:41.857421 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1433/2879] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:41 2022] PUT /identity/v3/projects/76f917e7010c479ca7be28cd3ec1e4e5/users/d7c69c9b787d4927a11fb43a1d43d97c/roles/15a2a347c19845c9ac397da513eb944a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:41.871247 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd91a7-ef62-47e0-93ca-795d8c8507ad None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:41.871541 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd91a7-ef62-47e0-93ca-795d8c8507ad None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:41.871818 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd91a7-ef62-47e0-93ca-795d8c8507ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:41.898086 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-74bd91a7-ef62-47e0-93ca-795d8c8507ad None None] MFA Rules not processed for user `d7c69c9b787d4927a11fb43a1d43d97c`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:41.899311 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-74bd91a7-ef62-47e0-93ca-795d8c8507ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:41.961744 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1447/2880] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:41.966089 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbafa30-e59e-4a4d-a3f9-8a2a5085c504 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:42.028093 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbafa30-e59e-4a4d-a3f9-8a2a5085c504 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:42.033707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff7d8-e30a-4679-a2a9-16fe82ba70e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:42.034392 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff7d8-e30a-4679-a2a9-16fe82ba70e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:42.034685 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff7d8-e30a-4679-a2a9-16fe82ba70e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:42.034961 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ff7d8-e30a-4679-a2a9-16fe82ba70e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:42.035667 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ff7d8-e30a-4679-a2a9-16fe82ba70e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:42.038500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ff7d8-e30a-4679-a2a9-16fe82ba70e6 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:42.066146 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1434/2881] 10.222.0.61 () {60 vars in 1152 bytes} [Sat May 14 16:05:41 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 16:05:42.070169 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd91a7-ef62-47e0-93ca-795d8c8507ad None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:42.080713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd91a7-ef62-47e0-93ca-795d8c8507ad None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:42.136861 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc4d78-ceb0-41d0-add5-ad6c9046964d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:42.137567 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4d78-ceb0-41d0-add5-ad6c9046964d admin admin] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:42.137853 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4d78-ceb0-41d0-add5-ad6c9046964d admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:42.138132 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc4d78-ceb0-41d0-add5-ad6c9046964d admin admin] PATH_INFO: `/v3/users` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:42.138888 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc4d78-ceb0-41d0-add5-ad6c9046964d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:42.140849 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc4d78-ceb0-41d0-add5-ad6c9046964d admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:42.160414 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1448/2882] 10.222.0.61 () {60 vars in 1143 bytes} [Sat May 14 16:05:42 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 14 16:05:42.164635 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff7d8-e30a-4679-a2a9-16fe82ba70e6 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:42.174668 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ff7d8-e30a-4679-a2a9-16fe82ba70e6 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:42.180279 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc3778-f169-4389-8df8-41f53d330bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:42.180936 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3778-f169-4389-8df8-41f53d330bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:42.181222 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3778-f169-4389-8df8-41f53d330bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:42.181500 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3778-f169-4389-8df8-41f53d330bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:42.182226 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc3778-f169-4389-8df8-41f53d330bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:42.183848 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc3778-f169-4389-8df8-41f53d330bc5 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:42.195322 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1435/2883] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:42.199393 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc4d78-ceb0-41d0-add5-ad6c9046964d admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:42.209416 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc4d78-ceb0-41d0-add5-ad6c9046964d admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:42.214060 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0ab8-11cc-4c9c-b17c-1da3049797ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:42.214911 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0ab8-11cc-4c9c-b17c-1da3049797ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:42.215192 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0ab8-11cc-4c9c-b17c-1da3049797ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:42.215463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a0ab8-11cc-4c9c-b17c-1da3049797ff admin admin] PATH_INFO: `/v3/projects/97a561da2766401182b45fe204e2b57c/users/e1b7e55466564f22824753ec0f256fa6/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:42.229723 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0ab8-11cc-4c9c-b17c-1da3049797ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a561da2766401182b45fe204e2b57c, user_id=e1b7e55466564f22824753ec0f256fa6, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:42.232603 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a0ab8-11cc-4c9c-b17c-1da3049797ff admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:42.245826 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1449/2884] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:42 2022] PUT /identity/v3/projects/97a561da2766401182b45fe204e2b57c/users/e1b7e55466564f22824753ec0f256fa6/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 16:05:42.250165 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc3778-f169-4389-8df8-41f53d330bc5 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:42.260604 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc3778-f169-4389-8df8-41f53d330bc5 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:42.313677 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43939cf0-d2b0-459e-9fe3-9d98873b50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:42.314368 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43939cf0-d2b0-459e-9fe3-9d98873b50cf admin admin] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:42.314679 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43939cf0-d2b0-459e-9fe3-9d98873b50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:42.314962 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43939cf0-d2b0-459e-9fe3-9d98873b50cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:42.315707 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43939cf0-d2b0-459e-9fe3-9d98873b50cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:42.317307 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43939cf0-d2b0-459e-9fe3-9d98873b50cf admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:42.331400 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1436/2885] 10.222.0.61 () {58 vars in 1121 bytes} [Sat May 14 16:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 14 16:05:42.332721 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0ab8-11cc-4c9c-b17c-1da3049797ff admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:42.343345 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a0ab8-11cc-4c9c-b17c-1da3049797ff admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:42.347952 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34b604-0cad-4001-80af-774096fd0fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:42.348823 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b604-0cad-4001-80af-774096fd0fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:42.349103 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b604-0cad-4001-80af-774096fd0fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:42.349377 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34b604-0cad-4001-80af-774096fd0fc5 admin admin] PATH_INFO: `/v3/projects/97a561da2766401182b45fe204e2b57c/users/e1b7e55466564f22824753ec0f256fa6/roles/e4796ab51a014dec8c68e61b88dedfdf` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:42.351586 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34b604-0cad-4001-80af-774096fd0fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a561da2766401182b45fe204e2b57c, user_id=e1b7e55466564f22824753ec0f256fa6, role_id=e4796ab51a014dec8c68e61b88dedfdf)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:42.354187 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34b604-0cad-4001-80af-774096fd0fc5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:42.364053 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1450/2886] 10.222.0.61 () {60 vars in 1482 bytes} [Sat May 14 16:05:42 2022] PUT /identity/v3/projects/97a561da2766401182b45fe204e2b57c/users/e1b7e55466564f22824753ec0f256fa6/roles/e4796ab51a014dec8c68e61b88dedfdf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 14 16:05:42.375784 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae8aa-7b28-408c-a20b-77ee7658138a None None] REQUEST_METHOD: `POST` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:42.376078 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae8aa-7b28-408c-a20b-77ee7658138a None None] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:42.376361 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fae8aa-7b28-408c-a20b-77ee7658138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:42.402020 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.auth.core [None req-b6fae8aa-7b28-408c-a20b-77ee7658138a None None] MFA Rules not processed for user `e1b7e55466564f22824753ec0f256fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=86463) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:42.403257 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b6fae8aa-7b28-408c-a20b-77ee7658138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:42.469285 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1437/2887] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:42.481138 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34b604-0cad-4001-80af-774096fd0fc5 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:42.482828 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-3a34b604-0cad-4001-80af-774096fd0fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:42.538299 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34b604-0cad-4001-80af-774096fd0fc5 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:42.541870 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a5b5e-7ffa-4241-88ba-b1b366ba9732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:42.542529 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a5b5e-7ffa-4241-88ba-b1b366ba9732 service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:42.542811 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a5b5e-7ffa-4241-88ba-b1b366ba9732 service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:42.543082 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a5b5e-7ffa-4241-88ba-b1b366ba9732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:42.604843 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a5b5e-7ffa-4241-88ba-b1b366ba9732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:42.606277 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5a5b5e-7ffa-4241-88ba-b1b366ba9732 service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:42.614906 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1451/2888] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:44.080239 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae8aa-7b28-408c-a20b-77ee7658138a None None] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:44.081656 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-b6fae8aa-7b28-408c-a20b-77ee7658138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:44.094108 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fae8aa-7b28-408c-a20b-77ee7658138a None None] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:44.097581 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee49247-c85f-4fdb-be7c-7bb8295c784a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:44.098222 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee49247-c85f-4fdb-be7c-7bb8295c784a service cinder] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:44.098544 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee49247-c85f-4fdb-be7c-7bb8295c784a service cinder] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:44.098825 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee49247-c85f-4fdb-be7c-7bb8295c784a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:44.153743 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee49247-c85f-4fdb-be7c-7bb8295c784a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:44.155216 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee49247-c85f-4fdb-be7c-7bb8295c784a service cinder] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:44.164463 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1438/2889] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:44.657618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a5b5e-7ffa-4241-88ba-b1b366ba9732 service cinder] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:44.666181 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a5b5e-7ffa-4241-88ba-b1b366ba9732 service cinder] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:44.669836 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa19587-a6d0-423f-8179-68f51bd0cd3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9b7a0202f394b16800af94487a21ef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:44.670535 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa19587-a6d0-423f-8179-68f51bd0cd3a service cinder] REQUEST_METHOD: `GET` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:44.670819 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa19587-a6d0-423f-8179-68f51bd0cd3a service cinder] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:44.671096 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa19587-a6d0-423f-8179-68f51bd0cd3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:44.680479 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa19587-a6d0-423f-8179-68f51bd0cd3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:44.681903 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa19587-a6d0-423f-8179-68f51bd0cd3a service cinder] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:44.691162 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1452/2890] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 14 16:05:48.685571 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee49247-c85f-4fdb-be7c-7bb8295c784a service cinder] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:48.745301 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee49247-c85f-4fdb-be7c-7bb8295c784a service cinder] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:48.750059 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:48.750943 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:48.751222 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:48.751495 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] PATH_INFO: `/v3/users/fe715910acdb4692b9c875c6c9e34e50` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:48.752670 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe715910acdb4692b9c875c6c9e34e50)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:48.754620 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:48.797128 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe715910acdb4692b9c875c6c9e34e50'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:48.808772 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe715910acdb4692b9c875c6c9e34e50'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:48.809419 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe715910acdb4692b9c875c6c9e34e50'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:48.810026 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe715910acdb4692b9c875c6c9e34e50'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:48.816536 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe715910acdb4692b9c875c6c9e34e50'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:48.828750 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1439/2891] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:48 2022] DELETE /identity/v3/users/fe715910acdb4692b9c875c6c9e34e50 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:48.833317 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f1c05-9a8b-4665-acbc-e5120cd082d5 None None] REQUEST_METHOD: `POST` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:48.833793 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f1c05-9a8b-4665-acbc-e5120cd082d5 None None] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:48.834435 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f1c05-9a8b-4665-acbc-e5120cd082d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:48.851827 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.auth.core [None req-3b1f1c05-9a8b-4665-acbc-e5120cd082d5 None None] MFA Rules not processed for user `a7162b13b2c54f8cadf583b1df8219b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86464) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 14 16:05:48.853007 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-3b1f1c05-9a8b-4665-acbc-e5120cd082d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:48.909463 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1453/2892] 10.222.0.61 () {58 vars in 957 bytes} [Sat May 14 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 14 16:05:48.919687 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:48.921076 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:48.975756 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cd1ab-d79b-44e7-9c5a-712c44d58786 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:48.979348 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ee2d5-8b93-42d0-a189-3c18e31a608f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abfc1e35362a4495a05475878db260f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:48.979979 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee2d5-8b93-42d0-a189-3c18e31a608f service neutron] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:48.980256 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee2d5-8b93-42d0-a189-3c18e31a608f service neutron] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:48.980527 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ee2d5-8b93-42d0-a189-3c18e31a608f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:48.989224 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ee2d5-8b93-42d0-a189-3c18e31a608f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:48.992926 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ee2d5-8b93-42d0-a189-3c18e31a608f service neutron] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:49.002582 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1440/2893] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 14 16:05:49.260465 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f1c05-9a8b-4665-acbc-e5120cd082d5 None None] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:49.261865 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-3b1f1c05-9a8b-4665-acbc-e5120cd082d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:49.276095 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f1c05-9a8b-4665-acbc-e5120cd082d5 None None] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:49.280757 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:49.281618 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:49.281896 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:49.282170 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] PATH_INFO: `/v3/projects/dd01a6e3ead9429b90e8202289d10bd3` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:49.283607 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd01a6e3ead9429b90e8202289d10bd3)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:49.285509 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:49.330468 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd01a6e3ead9429b90e8202289d10bd3', 'request_id': 'req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.337048 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd01a6e3ead9429b90e8202289d10bd3', 'request_id': 'req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.344613 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd01a6e3ead9429b90e8202289d10bd3', 'request_id': 'req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.354824 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] The token cache is being invalidate because project dd01a6e3ead9429b90e8202289d10bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:49.355112 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.355720 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.357244 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1454/2894] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:49 2022] DELETE /identity/v3/projects/dd01a6e3ead9429b90e8202289d10bd3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:49.361218 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ee2d5-8b93-42d0-a189-3c18e31a608f service neutron] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:49.370804 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ee2d5-8b93-42d0-a189-3c18e31a608f service neutron] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:49.424631 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:49.425507 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:49.425786 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:49.426058 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] PATH_INFO: `/v3/users/d7c69c9b787d4927a11fb43a1d43d97c` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:49.427255 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c69c9b787d4927a11fb43a1d43d97c)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:49.429305 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:49.472120 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c69c9b787d4927a11fb43a1d43d97c'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.483173 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c69c9b787d4927a11fb43a1d43d97c'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.483787 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c69c9b787d4927a11fb43a1d43d97c'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.484373 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c69c9b787d4927a11fb43a1d43d97c'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.490843 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c69c9b787d4927a11fb43a1d43d97c'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.503362 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1441/2895] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:49 2022] DELETE /identity/v3/users/d7c69c9b787d4927a11fb43a1d43d97c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:49.761150 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:49.762659 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:49.777835 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb95ef8-89d8-4c58-8b6e-5f003f34d232 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:49.833494 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:49.835000 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:49.835282 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:49.835576 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] PATH_INFO: `/v3/projects/76f917e7010c479ca7be28cd3ec1e4e5` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:49.836787 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f917e7010c479ca7be28cd3ec1e4e5)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:49.838719 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:49.885840 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f917e7010c479ca7be28cd3ec1e4e5', 'request_id': 'req-6aa47271-51fa-4003-85e7-f7955de0f5e5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.891761 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f917e7010c479ca7be28cd3ec1e4e5', 'request_id': 'req-6aa47271-51fa-4003-85e7-f7955de0f5e5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.899417 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f917e7010c479ca7be28cd3ec1e4e5', 'request_id': 'req-6aa47271-51fa-4003-85e7-f7955de0f5e5'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.909288 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] The token cache is being invalidate because project 76f917e7010c479ca7be28cd3ec1e4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:49.909571 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.910183 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:49.911749 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1455/2896] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:49 2022] DELETE /identity/v3/projects/76f917e7010c479ca7be28cd3ec1e4e5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:49.916186 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:49.917547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:49.930189 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b938d3a-5e81-4ce5-a55c-feee11a93b0b admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:49.987575 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:49.988461 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:49.988746 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:49.989021 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] PATH_INFO: `/v3/users/e1b7e55466564f22824753ec0f256fa6` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:49.990378 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b7e55466564f22824753ec0f256fa6)` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:49.992328 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:50.050547 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b7e55466564f22824753ec0f256fa6'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:50.063472 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b7e55466564f22824753ec0f256fa6'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:50.064210 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b7e55466564f22824753ec0f256fa6'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:50.064811 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b7e55466564f22824753ec0f256fa6'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:50.074695 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.notifications [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b7e55466564f22824753ec0f256fa6'} {{(pid=86463) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:50.089432 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1442/2897] 10.222.0.61 () {58 vars in 1223 bytes} [Sat May 14 16:05:49 2022] DELETE /identity/v3/users/e1b7e55466564f22824753ec0f256fa6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:05:50.397802 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] Authenticating user token {{(pid=86464) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:05:50.399251 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.fernet_utils [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86464) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:05:50.413941 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa47271-51fa-4003-85e7-f7955de0f5e5 admin admin] Validating token access rules against request {{(pid=86464) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:05:50.479094 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7162b13b2c54f8cadf583b1df8219b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '562024bfc95645e098dcd57dfe3300a0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86464) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:05:50.480546 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:05:50.480713 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] SCRIPT_NAME: `/identity` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:05:50.481191 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] PATH_INFO: `/v3/projects/97a561da2766401182b45fe204e2b57c` {{(pid=86464) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:05:50.482637 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a561da2766401182b45fe204e2b57c)` {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:05:50.484769 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] RBAC: Authorization granted {{(pid=86464) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:05:50.540652 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a561da2766401182b45fe204e2b57c', 'request_id': 'req-82f771fd-227b-4fb3-b39c-08d632b0e55f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:50.546949 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a561da2766401182b45fe204e2b57c', 'request_id': 'req-82f771fd-227b-4fb3-b39c-08d632b0e55f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:50.558081 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a561da2766401182b45fe204e2b57c', 'request_id': 'req-82f771fd-227b-4fb3-b39c-08d632b0e55f'} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:50.570105 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] The token cache is being invalidate because project 97a561da2766401182b45fe204e2b57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86464) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 14 16:05:50.570427 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:50.571091 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: DEBUG keystone.notifications [None req-82f771fd-227b-4fb3-b39c-08d632b0e55f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86464) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 14 16:05:50.572685 dv-cinder-839793-11-iscsi devstack@keystone.service[86464]: [pid: 86464|app: 0|req: 1456/2898] 10.222.0.61 () {58 vars in 1232 bytes} [Sat May 14 16:05:50 2022] DELETE /identity/v3/projects/97a561da2766401182b45fe204e2b57c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 14 16:09:48.128232 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] Authenticating user token {{(pid=86463) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 14 16:09:48.129660 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:09:48.263048 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d4a1c-194c-4233-a645-2fbce265d2c1 admin admin] Validating token access rules against request {{(pid=86463) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 14 16:09:48.319711 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a97f0-fa42-4c27-8663-d5758befa9fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fac310b740a40718191e905723222ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b979a4ee39014bb2bd5b3b6de1ecc2fc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86463) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 14 16:09:48.320358 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a97f0-fa42-4c27-8663-d5758befa9fb service placement] REQUEST_METHOD: `GET` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 14 16:09:48.320643 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a97f0-fa42-4c27-8663-d5758befa9fb service placement] SCRIPT_NAME: `/identity` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 14 16:09:48.321477 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a97f0-fa42-4c27-8663-d5758befa9fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86463) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 14 16:09:48.323350 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.fernet_utils [None req-dc4a97f0-fa42-4c27-8663-d5758befa9fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86463) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 14 16:09:48.334406 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a97f0-fa42-4c27-8663-d5758befa9fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 14 16:09:48.335996 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a97f0-fa42-4c27-8663-d5758befa9fb service placement] RBAC: Authorization granted {{(pid=86463) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 14 16:09:48.346237 dv-cinder-839793-11-iscsi devstack@keystone.service[86463]: [pid: 86463|app: 0|req: 1443/2899] 10.222.0.61 () {60 vars in 1365 bytes} [Sat May 14 16:09:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)